-
🤗 I mainly use: C++, Python
-
😀 I can speak: 中文, English
-
💻 I am using: Arch Linux ;-)
-
😋 You can find interesting models and datasets on my hf_website
🤗 I mainly use: C++, Python
😀 I can speak: 中文, English
💻 I am using: Arch Linux ;-)
😋 You can find interesting models and datasets on my hf_website
A fast inference library for running LLMs locally on modern consumer-class GPUs
An OAI compatible exllamav2 API that's both lightweight and fast
Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
Llama3、Llama3.1 中文仓库(随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档)
Large-scale LLM inference engine