{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":812249381,"defaultBranch":"master","name":"llama.cpp","ownerLogin":"legraphista","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2024-06-08T11:05:37.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/962643?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1717844886.977862","currentOid":""},"activityList":{"items":[{"before":"7fbb7a1b9dcdf57096d0d3e4fc517291ac6f8a23","after":"d9452267a0069a2873f4855cfc0b671b31704889","ref":"refs/heads/master","pushedAt":"2024-06-14T11:38:19.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"fix: QWEN2MOE support for expert_feed_forward_length\n\npreviously, expert ff was taken from n_ff (intermediate size) but it is now properly taken from LLM_KV_EXPERT_FEED_FORWARD_LENGTH\n\nn_ff_exp and n_ff_shexp are now properly calculated","shortMessageHtmlLink":"fix: QWEN2MOE support for expert_feed_forward_length"}},{"before":"46777ddaf370ec6f6b03d9a9d1797269855e4b30","after":"7fbb7a1b9dcdf57096d0d3e4fc517291ac6f8a23","ref":"refs/heads/master","pushedAt":"2024-06-14T11:29:48.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"fix: QWEN2MOE support for expert_feed_forward_length\n\npreviously, expert ff was taken from n_ff (intermediate size) but it is now properly taken from LLM_KV_EXPERT_FEED_FORWARD_LENGTH\n\nn_ff_exp and n_ff_shexp are now properly calculated","shortMessageHtmlLink":"fix: QWEN2MOE support for expert_feed_forward_length"}},{"before":"559b77819f7f6842a0dd467c5f536aeaed7433bd","after":"46777ddaf370ec6f6b03d9a9d1797269855e4b30","ref":"refs/heads/master","pushedAt":"2024-06-14T10:38:54.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"fix: QWEN2MOE support for expert_feed_forward_length\n\npreviously, expert ff was taken from n_ff (intermediate size) but it is now properly taken from LLM_KV_EXPERT_FEED_FORWARD_LENGTH\n\nn_ff_exp and n_ff_shexp are now properly calculated","shortMessageHtmlLink":"fix: QWEN2MOE support for expert_feed_forward_length"}},{"before":"06531cbaec419c247fcaad96f080676e958f5d70","after":"559b77819f7f6842a0dd467c5f536aeaed7433bd","ref":"refs/heads/master","pushedAt":"2024-06-12T14:00:46.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"add: support for SHARED_EXPERT_FEED_FORWARD_LENGTH\n\n- add SHARED_EXPERT_FEED_FORWARD_LENGTH key\n- GGUFWriter.add_shared_expert_feed_forward_length\n- Qwen2MoeForCausalLM support for shared_expert_intermediate_size\n- n_ff_shared_exp in hparams\n- QWEN2MOE support for n_ff_shared_exp","shortMessageHtmlLink":"add: support for SHARED_EXPERT_FEED_FORWARD_LENGTH"}},{"before":"173788db0fc956b594323c983cfca1fee47b25a2","after":"06531cbaec419c247fcaad96f080676e958f5d70","ref":"refs/heads/master","pushedAt":"2024-06-12T11:30:26.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"update: convert-hf-to-gguf.py cleanup for Qwen2MoeForCausalLM","shortMessageHtmlLink":"update: convert-hf-to-gguf.py cleanup for Qwen2MoeForCausalLM"}},{"before":"284cec438bf2445db7eb93fe0f8c12833eaffe6a","after":"173788db0fc956b594323c983cfca1fee47b25a2","ref":"refs/heads/master","pushedAt":"2024-06-10T17:51:23.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"update: convert-hf-to-gguf.py cleanup for Qwen2MoeForCausalLM","shortMessageHtmlLink":"update: convert-hf-to-gguf.py cleanup for Qwen2MoeForCausalLM"}},{"before":"7a16ce7db2a74a223f0f3b9cee66d4539c5bce8f","after":"284cec438bf2445db7eb93fe0f8c12833eaffe6a","ref":"refs/heads/master","pushedAt":"2024-06-08T11:16:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"legraphista","name":"Ștefan-Gabriel Muscalu","path":"/legraphista","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/962643?s=80&v=4"},"commit":{"message":"update: convert-hf-to-gguf.py to support Qwen2-57B-A14B","shortMessageHtmlLink":"update: convert-hf-to-gguf.py to support Qwen2-57B-A14B"}}],"hasNextPage":false,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNi0xNFQxMTozODoxOS4wMDAwMDBazwAAAARlZnTF","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNi0wOFQxMToxNjoxNS4wMDAwMDBazwAAAARf4b8s"}},"title":"Activity · legraphista/llama.cpp"}