[Core] Pending tasks gets hanging instead of resubmitted

[hongchaodeng]

What happened + What you expected to happen

The following logs show that task 47544f75c34aab0 was resubmitted but never gets into RUNNING state.

37620:[2024-04-05 23:48:18,879 W 904 1135] task_manager.cc:1105: Task attempt 47544f75c34aab0fffffffffffffffffffffffff02000000 failed with error NODE_DIED Fail immediately? 0, status GrpcUnavailable: RPC Error message: Socket closed; RPC Error details: , error info error_message: "Task failed due to the node dying.\n\n...
37623:[2024-04-05 23:48:18,879 I 904 1135] task_manager.cc:998: task 47544f75c34aab0fffffffffffffffffffffffff02000000 retries left: 10, oom retries left: -1, task failed due to oom: 0
37624:[2024-04-05 23:48:18,879 I 904 1135] task_manager.cc:1002: Attempting to resubmit task 47544f75c34aab0fffffffffffffffffffffffff02000000 for attempt number: 0
37625:[2024-04-05 23:48:18,880 I 904 1135] core_worker.cc:411: Will resubmit task after a 0ms delay: ...

Versions / Dependencies

Ray 2.10.0

Reproduction script

none

Issue Severity

High: It blocks me from completing my task.