An Open Source Machine Learning Framework for Everyone

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）

A flexible, high-performance serving system for machine learning models

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

header only, dependency-free deep learning framework in C++14

A C++ standalone library for machine learning

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

Lightning fast C++/CUDA neural network framework

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.

On-device AI across mobile, embedded and edge for PyTorch

An End-To-End, Lightweight and Flexible Platform for Game Research

C++ image processing and machine learning library with using of SIMD: SSE, AVX, AVX-512, AMX for x86/x64, NEON for ARM.

C++ Implementation of PyTorch Tutorials for Everyone

SLING - A natural language frame semantics parser

Official github repository for Fast Artificial Neural Network Library (FANN)

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.