Skip to content

Commit

Permalink
sync with upstream llama.cpp source code (+gemma2 support) (#81)
Browse files Browse the repository at this point in the history
  • Loading branch information
ngxson authored Jul 2, 2024
1 parent 7919c3f commit d20441c
Show file tree
Hide file tree
Showing 5 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion llama.cpp
Submodule llama.cpp updated 67 files
+7 −10 .devops/nix/package.nix
+0 −2 .github/ISSUE_TEMPLATE/config.yml
+1 −0 .github/workflows/build.yml
+9 −2 CMakeLists.txt
+1 −0 CMakePresets.json
+8 −0 Makefile
+6 −0 README.md
+20 −4 common/common.cpp
+3 −1 common/common.h
+2 −2 common/json-schema-to-grammar.cpp
+1 −0 convert-hf-to-gguf-update.py
+176 −12 convert-hf-to-gguf.py
+0 −1 examples/embedding/README.md
+1 −0 examples/infill/README.md
+11 −10 examples/infill/infill.cpp
+3 −3 examples/json_schema_to_grammar.py
+0 −1 examples/lookup/README.md
+0 −1 examples/main-cmake-pkg/.gitignore
+0 −1 examples/main-cmake-pkg/CMakeLists.txt
+7 −4 examples/main/main.cpp
+0 −1 examples/server-embd.py
+1 −0 examples/server/README.md
+2 −2 examples/server/public/json-schema-to-grammar.mjs
+11 −5 examples/server/server.cpp
+0 −1 examples/server/tests/features/passkey.feature
+0 −1 examples/server/themes/buttons-top/index.html
+0 −1 examples/server/themes/wild/index.html
+0 −1 examples/sycl/run-llama2.sh
+0 −1 examples/sycl/win-build-sycl.bat
+0 −2 examples/sycl/win-run-llama2.bat
+3 −3 flake.lock
+0 −1 ggml/include/ggml-metal.h
+6 −2 ggml/src/CMakeLists.txt
+7 −7 ggml/src/ggml-common.h
+35 −24 ggml/src/ggml-cuda.cu
+51 −25 ggml/src/ggml-cuda/common.cuh
+0 −1 ggml/src/ggml-cuda/cpy.cu
+5 −45 ggml/src/ggml-cuda/fattn-common.cuh
+16 −10 ggml/src/ggml-cuda/mmvq.cu
+319 −369 ggml/src/ggml-cuda/vecdotq.cuh
+0 −1 ggml/src/ggml-metal.metal
+0 −1 ggml/src/ggml-quants.h
+44 −733 ggml/src/ggml-sycl.cpp
+2 −0 ggml/src/ggml-sycl/backend.hpp
+55 −0 ggml/src/ggml-sycl/common.hpp
+22 −22 ggml/src/ggml-sycl/dmmv.cpp
+64 −61 ggml/src/ggml-sycl/mmvq.cpp
+370 −0 ggml/src/ggml-sycl/norm.cpp
+35 −0 ggml/src/ggml-sycl/norm.hpp
+1 −1 ggml/src/ggml-sycl/presets.hpp
+275 −0 ggml/src/ggml-sycl/rope.cpp
+22 −0 ggml/src/ggml-sycl/rope.hpp
+0 −21 ggml/src/ggml-sycl/vecdotq.hpp
+0 −1 ggml/src/ggml-vulkan-shaders.hpp
+40 −0 gguf-py/gguf/constants.py
+9 −0 gguf-py/gguf/gguf_writer.py
+24 −9 gguf-py/gguf/tensor_mapping.py
+248 −10 grammars/README.md
+1 −0 include/llama.h
+0 −1 scripts/pod-llama.sh
+509 −48 src/llama.cpp
+0 −1 src/unicode-data.cpp
+1 −0 tests/test-backend-ops.cpp
+11 −3 tests/test-chat-template.cpp
+37 −2 tests/test-grammar-integration.cpp
+26 −45 tests/test-json-schema-to-grammar.cpp
+0 −1 tests/test-rope.cpp
2 changes: 1 addition & 1 deletion src/multi-thread/wllama.js

Large diffs are not rendered by default.

Binary file modified src/multi-thread/wllama.wasm
Binary file not shown.
2 changes: 1 addition & 1 deletion src/single-thread/wllama.js

Large diffs are not rendered by default.

Binary file modified src/single-thread/wllama.wasm
Binary file not shown.

0 comments on commit d20441c

Please sign in to comment.