Popular repositories Loading

1. onnxruntime onnxruntime Public

   Forked from microsoft/onnxruntime

   ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

   C++

2. XRT XRT Public

   Forked from Xilinx/XRT

   Xilinx Run Time for FPGA

   C

3. tvm tvm Public

   Forked from apache/tvm

   Open deep learning compiler stack for cpu, gpu and specialized accelerators

   Python

4. neural-compressor neural-compressor Public

   Forked from intel/neural-compressor

   Provide unified APIs for SOTA model compression techniques, such as low precision (INT8/INT4/FP4/NF4) quantization, sparsity, pruning, and knowledge distillation on mainstream AI frameworks such as…

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. flashinfer flashinfer Public

   Forked from flashinfer-ai/flashinfer

   FlashInfer: Kernel Library for LLM Serving

   Cuda