- sozercan/aikit - ποΈ Fine-tune, build, and deploy open-source LLMs easily! (3 days ago)
- mudler/LocalAI - π€ The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference (1 week ago)
- sozercan/k8s-distributed-inference - π¦ Distributed Inference on Kubernetes with DRA and MIG (1 week ago)
- open-policy-agent/gatekeeper - π Gatekeeper - Policy Controller for Kubernetes (2 weeks ago)
- project-copacetic/copacetic - 𧡠CLI tool for directly patching container images! (2 weeks ago)
- sozercan/k8s-distributed-inference - π¦ Distributed Inference on Kubernetes with DRA and MIG
- sozercan/buildkit-nvidia - ποΈ Build with NVIDIA GPUs using buildkit
- sozercan/copa-test - π¬ Examples of Copa usage with GitHub Actions
- sozercan/gatekeeper-demo - π¬ Gatekeeper demo - CEL+Rego+PubSub
- sozercan/aikit - ποΈ Fine-tune, build, and deploy open-source LLMs easily!
- chore: bump unsloth to sept-2024 on sozercan/aikit (2 days ago)
- fix: fix llama 3.1 70b on sozercan/aikit (3 days ago)
- fix: set config file env on sozercan/aikit (3 days ago)
- ci: allow hf.co in update models on sozercan/aikit (3 days ago)
- chore: update update-models script on sozercan/aikit (3 days ago)
- ggerganov/llama.cpp (b3848, 1 day ago) - LLM inference in C/C++
- sozercan/aikit (v0.14.0, 3 days ago) - ποΈ Fine-tune, build, and deploy open-source LLMs easily!
- mudler/LocalAI (v2.21.1, 5 days ago) - π€ The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
- open-policy-agent/gatekeeper (v3.17.1, 2 weeks ago) - π Gatekeeper - Policy Controller for Kubernetes
- eraser-dev/eraser (v1.5.0-beta.0, 2 weeks ago) - π§Ή Cleaning up images from Kubernetes nodes
- exo-explore/exo - Run your own AI cluster at home with everyday devices π±π» π₯οΈβ (2 days ago)
- canonical/rocks-toolbox - A collection of standalone tools for rocks. (3 days ago)
- prompt-security/ps-fuzz - Make your GenAI Apps Safe & Secure π Test & harden your system prompt (3 days ago)
- e-p-armstrong/augmentoolkit - Convert Compute And Books Into Instruct-Tuning Datasets! Makes: QA, RP, Classifiers. (3 days ago)
- evilsocket/nerve - Instrument any LLM to do actual stuff. (4 days ago)