Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Misc. bug: llama-server web interface doesn't work in Firefox #11563

Open
ppearson opened this issue Jan 31, 2025 · 2 comments
Open

Misc. bug: llama-server web interface doesn't work in Firefox #11563

ppearson opened this issue Jan 31, 2025 · 2 comments

Comments

@ppearson
Copy link

Name and Version

./llama-server --version
version: 4607 (aa6fb13)
built with Apple clang version 15.0.0 (clang-1500.1.0.2.5) for arm64-apple-darwin23.4.0

Operating systems

Mac

Which llama.cpp modules do you know to be affected?

llama-server

Command line

./llama-server -m /Users/$USER/ml/qwen/qwen2.5-coder-32b-instruct-q5_k_m.gguf -c 8192

Problem description & steps to reproduce

Using latest master on MacOS to run llama-server on localhost, the web interface doesn't seem to work in Firefox, but works in Safari and Chrome.

Firefox brings up a modal popup with:

127.0.0.1:8080

TypeError: conv.messages[0] is undefined.

and then after clearing that popup, another appears with:

TypeError: ResizeObserver.observe: Argument 1 is not an object.

After which there's just a blank page. I can't see anything else in the DevTools Console.

This is with Firefox 134 on MacOS, (M1 silicon), and as mentioned above, the web interface works fine with Safari and Chrome on the same machine.

First Bad Commit

No response

Relevant log output

@wbruna
Copy link

wbruna commented Feb 2, 2025

FWIW, on that same rev different Qwen models (I can't run a 32b) seem to work fine on 128.6.0esr here (Debian 12, amd64, KDE Wayland). Could you check if the same happens with the ESR version, or with other models?

@ppearson
Copy link
Author

ppearson commented Feb 2, 2025

I've tried mixtral and llama models as well, same thing... They work fine in Chrome and Safari, not in Firefox...

Maybe it's MacOS-specific...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants