Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Usage]: Terminates without any error 30 seconds after a successful run. #12160

Open
1 task done
hznnnnnn opened this issue Jan 17, 2025 · 0 comments
Open
1 task done
Labels
usage How to use vllm

Comments

@hznnnnnn
Copy link

Your current environment

The output of `python collect_env.py`

How would you like to use vllm

When I use distributed inference, my master node is on a computer with system ubantu, and after I run bash run_cluster.sh
vllm/vllm-openai
ip_of_head_node
--head
/path/to/the/huggingface/home/in/this/node

The system is running normally without any errors.
My child node is a wsl2 ubantu, and when I run the code to register the child node, it terminates without any error 30 seconds after a successful run.
What kind of problem is this causing? Is it the lack of cross-system support?

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@hznnnnnn hznnnnnn added the usage How to use vllm label Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
usage How to use vllm
Projects
None yet
Development

No branches or pull requests

1 participant