Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[serve] Handle RayActorError while awaiting system message #44184

Closed
edoakes opened this issue Mar 20, 2024 · 1 comment
Closed

[serve] Handle RayActorError while awaiting system message #44184

edoakes opened this issue Mar 20, 2024 · 1 comment
Assignees
@zcin
Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue

Comments

@edoakes
Copy link
Contributor

edoakes commented Mar 20, 2024 •
edited
Loading

We currently remove replicas from consideration when actively probing, this should be extended to when getting the system message.
@edoakes edoakes added enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue labels Mar 20, 2024
@edoakes edoakes self-assigned this Mar 20, 2024
@edoakes edoakes changed the title [serve] Remove replicas from consideration if we get a RayActorError while waiting for system message [serve] Handle RayActorError while awaiting system message Mar 20, 2024
@zcin zcin assigned zcin and unassigned edoakes Aug 2, 2024
@zcin
Copy link
Contributor

zcin commented Aug 13, 2024

closed by #47008

@zcin zcin closed this as completed Aug 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zcin zcin

Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@edoakes @zcin