Pinned Loading

1. InftyAI/Awesome-LLMOps InftyAI/Awesome-LLMOps Public

   🎉 An awesome & curated list of best LLMOps tools.

   30 9

2. InftyAI/llmaz InftyAI/llmaz Public

   ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

   Go 33 10

3. InftyAI/Manta InftyAI/Manta Public

   💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

   Go 12 2

4. InftyAI/scheduler-plugins InftyAI/scheduler-plugins Public

   Scheduler plugins designed for smart scheduling with llmaz.

   Go 3 1

5. InftyAI/llmboard InftyAI/llmboard Public

   ChatUI for LLMs on llmaz.

   Python 3 5

6. InftyAI/omnistore InftyAI/omnistore Public

   🎯 An unified python client to communicate with various kinds of object-store providers.

   Python 2 2