Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 5
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

334 Open 4,183 Closed
334 Open 4,183 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Eval bug: llama.cpp Incorrectly Parses and Reports sprintf Calls in C++ Code bug-unconfirmed
#11951 opened Feb 19, 2025 by perdubug
Misc. bug: hipGraph causes a crash in hipGraphDestroy AMD GPU Issues specific to AMD GPUs
#11949 opened Feb 18, 2025 by IMbackK
Eval bug: Segmentation fault with Docker ROCm image "full-rocm" bug-unconfirmed
#11947 opened Feb 18, 2025 by JFingerle
Add option to build CUDA backend without Flash attention enhancement New feature or request
#11946 opened Feb 18, 2025 by slaren
1
Feature Request: 推理minicpmv时，encoding_image_with_clip耗时很久 enhancement New feature or request
#11941 opened Feb 18, 2025 by EnzhiZhou
4 tasks done
2
Eval bug: Unexpected empty grammar stack after accepting piece: <｜tool_calls_begin｜> on DeepSeek-R1-Distill-Qwen-32B bug-unconfirmed
#11938 opened Feb 18, 2025 by chgjin
Compile bug: ./llama-server: symbol lookup error: ./llama-server: undefined symbol: llama_vocab_eos bug-unconfirmed
#11932 opened Feb 17, 2025 by sakshi-joshi-handle
Enhancement: Improve ROCm performance on various quants (benchmarks included) enhancement New feature or request
#11931 opened Feb 17, 2025 by cb88
4 tasks done
3
Compile bug: bug-unconfirmed
#11930 opened Feb 17, 2025 by sraouser
Misc. bug: RPC attempt fails with a specific error, but I cannot find any info on troubleshooting it bug-unconfirmed
#11929 opened Feb 17, 2025 by maglore9900
1
Eval bug: --api-key is invalid when i set a string contains % bug-unconfirmed
#11928 opened Feb 17, 2025 by zhangtao103239
Misc. bug: What is the model path on mac? bug-unconfirmed
#11921 opened Feb 17, 2025 by Alex4210987
7
Eval bug: DeepScaleR-1.5B-Preview produces random tokens on AArch64 with fp16fml bug-unconfirmed
#11920 opened Feb 17, 2025 by icecream95
1
Using OpenBlas to accelerate has no effect？
#11919 opened Feb 17, 2025 by buptmengjj
Misc. bug: ROCm images cannot be found bug-unconfirmed
#11913 opened Feb 16, 2025 by ExposedCat
3
Feature Request: Use direct_io for model load and inference enhancement New feature or request
#11912 opened Feb 16, 2025 by jagusztinl
4 tasks done
Misc. bug: Crashed on Intel Mac with AMD GPU. bug-unconfirmed
#11903 opened Feb 16, 2025 by halechan
1
Eval bug: Running model on IOS and macOS produces different results bug-unconfirmed
#11898 opened Feb 16, 2025 by maksymmatviievskyi
3
Misc. bug: I tried to integrate this simple application(/examples/simple/) to my android application with UI interface(.apk), but the performance is degraded very drastically( like 2 seconds to 200 seconds). bug-unconfirmed
#11889 opened Feb 15, 2025 by Ramees025
[Tracker] Docker build fails on CI for arm64
#11888 opened Feb 15, 2025 by ngxson
2
Compile bug: C++ One Definition Rule [-Wodr] violations in common/json.hpp bug-unconfirmed
#11876 opened Feb 14, 2025 by srcshelton
2
Feature Request: APIkey enhancement New feature or request
#11874 opened Feb 14, 2025 by gsm1258
4 tasks done
1
Feature Request: Use all (or configurable #) of threads for model loading, not constrainted by --threads specified for inference enhancement New feature or request
#11873 opened Feb 14, 2025 by VanceVagell
4 tasks done
2
Misc. bug: server metrics sometimes return "-nan" values
#11868 opened Feb 14, 2025 by aviallon
Misc. bug: Problems with official jinja templates (Gemma 2, Llama 3.2, Qwen 2.5) bug Something isn't working
#11866 opened Feb 14, 2025 by MoonRide303
@ochafik
11
ProTip! Type g i on any issue or pull request to go back to the issue listing page.