Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] Add PENDING_ACTOR_TASK_ARGS_FETCH and PENDING_ACTOR_TASK_ORDERING_OR_CONCURRENCY TaskStatus #48242

Merged
merged 10 commits into from
Oct 28, 2024

Conversation

jjyao
Copy link
Collaborator

@jjyao jjyao commented Oct 24, 2024

Why are these changes needed?

Currently we don't know which status an actor task has in between SUBMITTED_TO_WORKER AND RUNNING.

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

…CONCURRENCY TaskStatus

Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
@jjyao jjyao added the go add ONLY when ready to merge, run all tests label Oct 24, 2024
@jjyao jjyao requested review from pcmoritz, raulchen and a team as code owners October 24, 2024 08:33
@jjyao
Copy link
Collaborator Author

jjyao commented Oct 24, 2024

FYI: @alexeykudinkin

Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
src/ray/protobuf/common.proto Show resolved Hide resolved
src/ray/protobuf/common.proto Show resolved Hide resolved
src/ray/core_worker/core_worker.cc Show resolved Hide resolved
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
@jjyao jjyao requested a review from MengjinYan October 28, 2024 04:46
Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
@jjyao jjyao merged commit 62525c0 into ray-project:master Oct 28, 2024
5 checks passed
@jjyao jjyao deleted the jjyao/debb branch October 28, 2024 22:01
Comment on lines +830 to +834
// The actor task is fetching arguments. This happens after the actor worker
// receives the task and the actor task has object refs as arguments.
PENDING_ACTOR_TASK_ARGS_FETCH = 6;
// The actor task is waiting due to ordering or concurrency constraints.
PENDING_ACTOR_TASK_ORDERING_OR_CONCURRENCY = 7;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wait, why are these specific to actor tasks @jjyao?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For normal task, args fetch is before SUBMITTED_TO_WORKER and happens in raylet and is PENDING_ARGS_FETCH. Also normal task, you don't need to wait for concurrency, each a worker process only runs one normal task at a time.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Understood. It's a bit odd to encode the entity name into the state, but i see your point there.

Jay-ju pushed a commit to Jay-ju/ray that referenced this pull request Nov 5, 2024
…ING_OR_CONCURRENCY TaskStatus (ray-project#48242)

Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
JP-sDEV pushed a commit to JP-sDEV/ray that referenced this pull request Nov 14, 2024
…ING_OR_CONCURRENCY TaskStatus (ray-project#48242)

Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
mohitjain2504 pushed a commit to mohitjain2504/ray that referenced this pull request Nov 15, 2024
…ING_OR_CONCURRENCY TaskStatus (ray-project#48242)

Signed-off-by: Jiajun Yao <jeromeyjj@gmail.com>
Signed-off-by: mohitjain2504 <mohit.jain@dream11.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
go add ONLY when ready to merge, run all tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants