Pinned Loading

1. thu-nics/DiTFastAttn thu-nics/DiTFastAttn Public

   Jupyter Notebook 102 8

2. nn_tools nn_tools Public

   Neural Network Tools: Converter and Analyzer. For caffe, pytorch, draknet and so on.

   Python 355 63

3. LLM-Viewer LLM-Viewer Public

   Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

   Python 313 37

4. RPTQ4LLM RPTQ4LLM Public

   Reorder-based post-training quantization for large language model

   Python 181 11

5. PTQ4ViT PTQ4ViT Public

   Post-Training Quantization for Vision transformers.

   Python 192 27

6. PB-LLM PB-LLM Public

   PB-LLM: Partially Binarized Large Language Models

   Python 148 10