{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":736821290,"defaultBranch":"master","name":"llama.cpp","ownerLogin":"NeoZhangJianyu","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2023-12-29T01:28:25.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/46982523?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1726906748.0","currentOid":""},"activityList":{"items":[{"before":"f557ccfd2c8adffe0bf964897b2b75e1c0da8bb3","after":"3ae8374b597fa79a55f5e8df10fb3dd017cd9536","ref":"refs/heads/update_oneapi","pushedAt":"2024-09-21T07:14:36.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"use 2024.1","shortMessageHtmlLink":"use 2024.1"}},{"before":null,"after":"f557ccfd2c8adffe0bf964897b2b75e1c0da8bb3","ref":"refs/heads/update_oneapi","pushedAt":"2024-09-20T02:58:39.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"update oneapi to 2024.2","shortMessageHtmlLink":"update oneapi to 2024.2"}},{"before":"c9c8575a1a8a170329afca4c4df4c005806efb1d","after":"6026da52d6942b253df835070619775d849d0258","ref":"refs/heads/master","pushedAt":"2024-09-20T02:53:22.000Z","pushType":"push","commitsCount":51,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"server : clean-up completed tasks from waiting list (#9531)\n\nggml-ci","shortMessageHtmlLink":"server : clean-up completed tasks from waiting list (ggerganov#9531)"}},{"before":"df4b7945aeccae2a71348e5a9c1eab5241e3e0ef","after":"c9c8575a1a8a170329afca4c4df4c005806efb1d","ref":"refs/heads/master","pushedAt":"2024-09-12T09:44:57.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"enhance run script to be easy to change the parameters (#9448)\n\nCo-authored-by: arthw <14088817+arthw@users.noreply.github.com>","shortMessageHtmlLink":"enhance run script to be easy to change the parameters (ggerganov#9448)"}},{"before":null,"after":"7a6f9e0be21d2ba1900110cab7855303df0f9468","ref":"refs/heads/refactor_run_script","pushedAt":"2024-09-12T02:56:27.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"enhance run script to be easy to change the parameters","shortMessageHtmlLink":"enhance run script to be easy to change the parameters"}},{"before":"9b2c24c0993487d3b34a873980e292da571481f3","after":"df4b7945aeccae2a71348e5a9c1eab5241e3e0ef","ref":"refs/heads/master","pushedAt":"2024-09-12T02:34:06.000Z","pushType":"push","commitsCount":57,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"cann: Fix error when running a non-exist op (#9424)","shortMessageHtmlLink":"cann: Fix error when running a non-exist op (ggerganov#9424)"}},{"before":"f39b66deb5f36a4e1b8f86ab7d32b0c554b55983","after":"e106feb048280b31c8e335c4d50f2b65e9088b60","ref":"refs/heads/check_malloc_on_device","pushedAt":"2024-09-08T09:35:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"update for review comments, check all malloc_device() result","shortMessageHtmlLink":"update for review comments, check all malloc_device() result"}},{"before":null,"after":"f39b66deb5f36a4e1b8f86ab7d32b0c554b55983","ref":"refs/heads/check_malloc_on_device","pushedAt":"2024-09-07T08:54:50.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"add check malloc result on device","shortMessageHtmlLink":"add check malloc result on device"}},{"before":"de280085e7917dbb7f5753de5842ff4455f82a81","after":"9b2c24c0993487d3b34a873980e292da571481f3","ref":"refs/heads/master","pushedAt":"2024-09-07T06:24:13.000Z","pushType":"push","commitsCount":229,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"server : simplify state machine for slot (#9283)\n\n* server : simplify state machine for slot\r\n\r\n* add SLOT_STATE_DONE_PROMPT\r\n\r\n* pop_deferred_task\r\n\r\n* add missing notify_one\r\n\r\n* fix passkey test\r\n\r\n* metrics : add n_busy_slots_per_decode\r\n\r\n* fix test step\r\n\r\n* add test\r\n\r\n* maybe fix AddressSanitizer?\r\n\r\n* fix deque ?\r\n\r\n* missing lock\r\n\r\n* pop_deferred_task: also notify\r\n\r\n* Update examples/server/server.cpp\r\n\r\nCo-authored-by: Georgi Gerganov \r\n\r\n---------\r\n\r\nCo-authored-by: Georgi Gerganov ","shortMessageHtmlLink":"server : simplify state machine for slot (ggerganov#9283)"}},{"before":"f619024764e72261f14d7c31d892b8fb976603b4","after":"de280085e7917dbb7f5753de5842ff4455f82a81","ref":"refs/heads/master","pushedAt":"2024-07-24T01:39:23.000Z","pushType":"push","commitsCount":158,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"examples : Fix `llama-export-lora` example (#8607)\n\n* fix export-lora example\r\n\r\n* add more logging\r\n\r\n* reject merging subset\r\n\r\n* better check\r\n\r\n* typo","shortMessageHtmlLink":"examples : Fix llama-export-lora example (ggerganov#8607)"}},{"before":null,"after":"5dece9f922dea89fb9b2ddc8d87dac6a6ac4a520","ref":"refs/heads/refactor_get_max_wg","pushedAt":"2024-07-04T01:49:11.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"rm get_work_group_size() by local cache for performance","shortMessageHtmlLink":"rm get_work_group_size() by local cache for performance"}},{"before":"172c8256840ffd882ab9992ecedbb587d9b21f15","after":"f619024764e72261f14d7c31d892b8fb976603b4","ref":"refs/heads/master","pushedAt":"2024-07-04T01:09:26.000Z","pushType":"push","commitsCount":146,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"[SYCL] Remove unneeded semicolons (#8280)","shortMessageHtmlLink":"[SYCL] Remove unneeded semicolons (ggerganov#8280)"}},{"before":"4e96a812b3ce7322a29a3008db2ed73d9087b176","after":"172c8256840ffd882ab9992ecedbb587d9b21f15","ref":"refs/heads/master","pushedAt":"2024-06-14T05:31:31.000Z","pushType":"push","commitsCount":429,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"rpc : fix ggml_backend_rpc_supports_buft() (#7918)","shortMessageHtmlLink":"rpc : fix ggml_backend_rpc_supports_buft() (ggerganov#7918)"}},{"before":"facb8b56f8fd3bb10a693bf0943ae9d69d0828ef","after":"4e96a812b3ce7322a29a3008db2ed73d9087b176","ref":"refs/heads/master","pushedAt":"2024-04-23T00:59:54.000Z","pushType":"push","commitsCount":28,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"[SYCL] Windows default build instructions without -DLLAMA_SYCL_F16 flag activated (#6767)\n\n* Fix FP32/FP16 build instructions\r\n\r\n* Fix typo\r\n\r\n* Recommended build instruction\r\n\r\nCo-authored-by: Neo Zhang Jianyu \r\n\r\n* Recommended build instruction\r\n\r\nCo-authored-by: Neo Zhang Jianyu \r\n\r\n* Recommended build instruction\r\n\r\nCo-authored-by: Neo Zhang Jianyu \r\n\r\n* Add comments in Intel GPU linux\r\n\r\n---------\r\n\r\nCo-authored-by: Anas Ahouzi <112881240+aahouzi-intel@users.noreply.github.com>\r\nCo-authored-by: Neo Zhang Jianyu ","shortMessageHtmlLink":"[SYCL] Windows default build instructions without -DLLAMA_SYCL_F16 fl…"}},{"before":"8a56075b07a8b571bf95a912ffdce4c928c2b414","after":"facb8b56f8fd3bb10a693bf0943ae9d69d0828ef","ref":"refs/heads/master","pushedAt":"2024-04-17T01:32:42.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"convert : fix autoawq gemma (#6704)\n\n* fix autoawq quantized gemma model convert error\r\n\r\nusing autoawq to quantize gemma model will include a lm_head.weight tensor in model-00001-of-00002.safetensors. it result in this situation that convert-hf-to-gguf.py can't map lm_head.weight. skip loading this tensor could prevent this error.\r\n\r\n* change code to full string match and print necessary message\r\n\r\nchange code to full string match and print a short message to inform users that lm_head.weight has been skipped.\r\n\r\n---------\r\n\r\nCo-authored-by: Zheng.Deng <32841220+CUGfred@users.noreply.github.com>","shortMessageHtmlLink":"convert : fix autoawq gemma (ggerganov#6704)"}},{"before":"17e98d4c96a583d420f12046bc92102381dbd28e","after":"8a56075b07a8b571bf95a912ffdce4c928c2b414","ref":"refs/heads/master","pushedAt":"2024-04-16T14:41:02.000Z","pushType":"push","commitsCount":7,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"gritlm : add --outdir option to hf.sh script (#6699)\n\nThis commit updates the hf.sh script usage to include the --outdir option\r\nand specifies the models directory as the output directory.\r\n\r\nThe motivation for this is to avoid cluttering the root directory with\r\nmodel files.\r\n\r\nSigned-off-by: Daniel Bevenius ","shortMessageHtmlLink":"gritlm : add --outdir option to hf.sh script (ggerganov#6699)"}},{"before":"1958f7e06ca2d2e3ab5698cc67513ba359144d8e","after":"17e98d4c96a583d420f12046bc92102381dbd28e","ref":"refs/heads/master","pushedAt":"2024-04-15T09:54:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"fix mul_mat_id() for new input, make the ut pass (#6682)","shortMessageHtmlLink":"fix mul_mat_id() for new input, make the ut pass (ggerganov#6682)"}},{"before":null,"after":"811fa4574bcb7f6de8bd4c1089f25dbdf7b30c34","ref":"refs/heads/fix_mul_mat_id","pushedAt":"2024-04-15T06:12:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"fix mul_mat_id() for new input, make the ut pass","shortMessageHtmlLink":"fix mul_mat_id() for new input, make the ut pass"}},{"before":"8228b66dbc16290c5cbd70e80ab47c068e2569d8","after":"1958f7e06ca2d2e3ab5698cc67513ba359144d8e","ref":"refs/heads/master","pushedAt":"2024-04-15T05:35:30.000Z","pushType":"push","commitsCount":27,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"llama : add missing kv clear in llama_beam_search (#6664)","shortMessageHtmlLink":"llama : add missing kv clear in llama_beam_search (ggerganov#6664)"}},{"before":"29ebe38619448a9e26c8a860f53e990d06d4db0d","after":"9db2000849a81cc68336f967f76795dd82cc029f","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-14T01:26:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"revert to malloc/free solution, for threaad safe","shortMessageHtmlLink":"revert to malloc/free solution, for threaad safe"}},{"before":"4b8b7a6c0189e5e41732e7012ebf8f06496a6355","after":"29ebe38619448a9e26c8a860f53e990d06d4db0d","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-13T07:47:46.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"use host buff to reduce malloc times","shortMessageHtmlLink":"use host buff to reduce malloc times"}},{"before":"7e54166562a463b672e3d311b11c336a4edbc5d2","after":"4b8b7a6c0189e5e41732e7012ebf8f06496a6355","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-12T09:19:25.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"keep to support mmap()","shortMessageHtmlLink":"keep to support mmap()"}},{"before":"5a759a0f80613e3be2217b1167bb7565d5b81364","after":"7e54166562a463b672e3d311b11c336a4edbc5d2","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-12T08:55:03.000Z","pushType":"push","commitsCount":13,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"Merge branch 'master' into fix_memcpy_crash","shortMessageHtmlLink":"Merge branch 'master' into fix_memcpy_crash"}},{"before":"391decad1ca3096f4a0ebba00cb10d5a784facf8","after":"5a759a0f80613e3be2217b1167bb7565d5b81364","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-12T07:38:58.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"fix compile error in other os","shortMessageHtmlLink":"fix compile error in other os"}},{"before":"d053698c129f061c1e6b5fb4de976dd6a9cb8606","after":"391decad1ca3096f4a0ebba00cb10d5a784facf8","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-12T07:23:10.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"refactor to disable mmap for SYCL backend","shortMessageHtmlLink":"refactor to disable mmap for SYCL backend"}},{"before":null,"after":"d053698c129f061c1e6b5fb4de976dd6a9cb8606","ref":"refs/heads/fix_memcpy_crash","pushedAt":"2024-04-12T01:44:48.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"disable mmap to fix memcpy crash, add missed cmd in guide, fix softmax","shortMessageHtmlLink":"disable mmap to fix memcpy crash, add missed cmd in guide, fix softmax"}},{"before":"cc4a95426d17417d3c83f12bdb514fbe8abe2a88","after":"8228b66dbc16290c5cbd70e80ab47c068e2569d8","ref":"refs/heads/master","pushedAt":"2024-04-11T09:17:04.000Z","pushType":"push","commitsCount":13,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"gguf : add option to not check tensor data (#6582)\n\nThis commit adds an option to the gguf example to not check the tensor\r\ndata.\r\n\r\nThe motivation for this is that it can be nice to use the gguf tool to\r\nread other .gguf files that were not created by the gguf tool.\r\n\r\nSigned-off-by: Daniel Bevenius ","shortMessageHtmlLink":"gguf : add option to not check tensor data (ggerganov#6582)"}},{"before":"54ea0698fbf87e36a5d68a98c95f6bdd0fb91557","after":"cc4a95426d17417d3c83f12bdb514fbe8abe2a88","ref":"refs/heads/master","pushedAt":"2024-04-09T00:58:24.000Z","pushType":"push","commitsCount":15,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"llama : fix attention layer count sanity check (#6550)\n\n* llama : fix attention layer count sanity check\r\n\r\n* llama : fix parentheses in attention layer count sanity check\r\n\r\nThere was otherwise a warning when compiling.\r\n\r\n---------\r\n\r\nCo-authored-by: Francis Couture-Harpin ","shortMessageHtmlLink":"llama : fix attention layer count sanity check (ggerganov#6550)"}},{"before":null,"after":"f381347e0db8ed18f449f9963c0a90034f1c2046","ref":"refs/heads/support_more_IQ_ops","pushedAt":"2024-04-07T02:15:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"support/fix OPs GGML_TYPE_IQ4_NL, GGML_TYPE_IQ4_XS, GGML_TYPE_IQ3_XXS, GGML_TYPE_IQ3_S, GGML_TYPE_IQ2_XXS, GGML_TYPE_IQ2_XS, GGML_TYPE_IQ2_S, GGML_TYPE_IQ1_S, GGML_TYPE_IQ1_M","shortMessageHtmlLink":"support/fix OPs GGML_TYPE_IQ4_NL, GGML_TYPE_IQ4_XS, GGML_TYPE_IQ3_XXS…"}},{"before":"4399f13fb9462cd06f3f154d0aee738425000fea","after":"54ea0698fbf87e36a5d68a98c95f6bdd0fb91557","ref":"refs/heads/master","pushedAt":"2024-04-07T00:45:48.000Z","pushType":"push","commitsCount":19,"pusher":{"login":"NeoZhangJianyu","name":"Neo Zhang Jianyu","path":"/NeoZhangJianyu","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/46982523?s=80&v=4"},"commit":{"message":"sync : ggml","shortMessageHtmlLink":"sync : ggml"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yMVQwNzoxNDozNi4wMDAwMDBazwAAAAS8lhb4","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNC0wN1QwMDo0NTo0OC4wMDAwMDBazwAAAAQp3LUf"}},"title":"Activity · NeoZhangJianyu/llama.cpp"}