mxformat

Here are 2 public repositories matching this topic...

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

An innovative library for efficient LLM inference via low-bit quantization

Add a description, image, and links to the mxformat topic page so that developers can more easily learn about it.

To associate your repository with the mxformat topic, visit your repo's landing page and select "manage topics."