AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models

FedScale is a scalable and extensible open-source federated learning (FL) platform.

A model compilation solution for various hardware

Machine Learning Framework for Operating Systems - Brings ML to Linux kernel

An acceleration library that supports arbitrary bit-width combinatorial quantization operations

Deep Learning Energy Measurement and Optimization

A scalable & efficient active learning/data selection system for everyone.

A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems

Optimal Sparse Decision Trees

Materials for my 2021 NYU class on NLP and ML Systems (Master of Engineering).

Federated Learning Systems Paper List

sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data

NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference

TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention

GraphSnapShot: Caching Local Structure for Fast Graph Learning

Code for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]

GPU-initiated Large-scale GNN System [ATC 23]

Accelerating Deep Learning Training (DLT) from Storage Perspective