You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We don't have a H100, and we don't try it on H100. But the vllm viewer seems to have tried it on H100 in vllm-project/vllm#5218 (comment). Our PR has been merged into vllm now, you can try qqq in vllm on H100 and see if it can work.
I tried to run it on H100, but it seems there is an illegal memory access inside the kernel.
The text was updated successfully, but these errors were encountered: