Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
-
Updated
Dec 9, 2024 - C++
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
LizardFS is an Open Source Distributed File System licensed under GPLv3.
Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++
A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.
distributed dataflows with functional list operations for data processing with C++14
Distributed training framework with parameter server
A computation-centric distributed graph processing system.
A distributed block-based data storage and compute engine
The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.
Simple, reliable & efficient distributed task queue for C++17
TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
An Asynchronous Distributed C++ Array Processing Toolkit
Framework of vectorized and distributed data analytics
Distributed View Extension for Kokkos
Decentralized framework for the distribution of lambda functions to multiple serverless platforms
KaMPIng: (Near) zero-overhead MPI wrapper for modern C++
WRENCH: Cyberinfrastructure Simulation Workbench
An MPI-based C++ or Python library for easy distributed pipeline processing
A system for development of high-performance, data-intensive, distributed computing, applications, tools, and libraries.
Trillion-edge Scale Graph Edge Partitioning
Add a description, image, and links to the distributed-computing topic page so that developers can more easily learn about it.
To associate your repository with the distributed-computing topic, visit your repo's landing page and select "manage topics."