You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This used to work in v0.1.11 and previous versions. Since upgrading to v0.1.12 I get this error:
RuntimeError: There is no current event loop in thread 'Thread-4 (_launch_server)'.
/miniconda3/envs/sglang/lib/python3.10/threading.py:1011: RuntimeWarning: coroutine 'Server.serve' was never awaited
Starting the runtime with python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port 30000 works as usual.
The text was updated successfully, but these errors were encountered:
I'm using the following code to start a runtime from a Jupyter Notebook:
This used to work in v0.1.11 and previous versions. Since upgrading to v0.1.12 I get this error:
RuntimeError: There is no current event loop in thread 'Thread-4 (_launch_server)'. /miniconda3/envs/sglang/lib/python3.10/threading.py:1011: RuntimeWarning: coroutine 'Server.serve' was never awaited
Starting the runtime with
python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port 30000
works as usual.The text was updated successfully, but these errors were encountered: