Skip to content

@CentML CentML

Change the repository type filter

All

    Repositories list

    34 repositories

    • platform_api_python_client

      Public
      Python
      •0•0•0•1•Updated Jan 19, 2025Jan 19, 2025

    • flexible-inference-bench

      Public
      A modular, extensible LLM inference benchmarking framework that supports multiple benchmarking frameworks and paradigms.
      Python
      •
      Apache License 2.0
      •0•6•8•2•Updated Jan 17, 2025Jan 17, 2025

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1.4k•0•0•0•Updated Jan 16, 2025Jan 16, 2025

    • DeepView.Profile

      Public
      🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
      machine-learningdeep-neural-networksdeep-learningneural-network
      Python
      •
      Apache License 2.0
      •7•58•1•1•Updated Jan 14, 2025Jan 14, 2025

    • centml_platform_docs

      Public
      MDX
      •0•0•0•0•Updated Jan 14, 2025Jan 14, 2025

    • aisuite

      Public
      Simple, unified interface to multiple Generative AI providers
      Python
      •
      MIT License
      •886•0•0•6•Updated Jan 13, 2025Jan 13, 2025

    • ai-benchmarks

      Public
      Benchmarking suite for popular AI APIs
      Python
      •
      MIT License
      •14•0•0•1•Updated Jan 5, 2025Jan 5, 2025

    • llama-stack

      Public
      Composable building blocks to build Llama Apps
      Python
      •
      MIT License
      •752•0•0•0•Updated Jan 2, 2025Jan 2, 2025

    • centml-python-client

      Public
      Python
      •
      Apache License 2.0
      •0•1•10•1•Updated Dec 20, 2024Dec 20, 2024

    • DeepView.Predict

      Public
      🔮 Execution time predictions for deep neural network training iterations across different GPUs.
      Python
      •
      Apache License 2.0
      •3•14•3•0•Updated Dec 16, 2024Dec 16, 2024

    • codex

      Public
      A comprehensive collection of integration examples for CentML. This repository serves as a resource hub for developers looking to seamlessly incorporate CentML's capabilities into their applications. Explore a variety of use cases and implementations to accelerate your integration process.
      TypeScript
      •
      Apache License 2.0
      •0•2•0•0•Updated Dec 12, 2024Dec 12, 2024

    • DeepView.Explore

      Public
      🛠 VSCode plugin that provides visual interface for CentML Tools
      TypeScript
      •2•14•2•0•Updated Dec 5, 2024Dec 5, 2024

    • ecr-anywhere

      Public
      Pull from private ECR repos... anywhere
      Go
      •0•0•0•0•Updated Nov 19, 2024Nov 19, 2024

    • platform_docs

      Public archive
      CentML Platform Documentation
      MDX
      •5•0•0•0•Updated Nov 5, 2024Nov 5, 2024

    • FastChat

      Public
      An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
      Python
      •
      Apache License 2.0
      •4.6k•0•0•0•Updated Sep 17, 2024Sep 17, 2024

    • training-operator

      Public
      Distributed ML Training and Fine-Tuning on Kubernetes
      Go
      •
      Apache License 2.0
      •712•0•0•1•Updated Aug 22, 2024Aug 22, 2024

    • Sylva

      Public
      Boost fine-tuning performance with sparse embedded adapters and hierarchical approximate second-order information.
      Python
      •
      Apache License 2.0
      •0•2•0•0•Updated Aug 10, 2024Aug 10, 2024

    • simple-sidecar

      Public
      A simple configurable kubernetes sidecar injector.
      Go
      •
      Apache License 2.0
      •1•0•0•0•Updated Jul 11, 2024Jul 11, 2024

    • llm-inference-bench

      Public
      Lightweight and extensible LLM Inference serving benchmark tool written in Rust.
      benchmarkingllm-servingllm-inference
      Rust
      •0•2•0•0•Updated Apr 4, 2024Apr 4, 2024

    • cserve-client

      Public
      CServe client library
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Mar 8, 2024Mar 8, 2024

    • examples

      Public
      A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •9.6k•0•0•0•Updated Feb 28, 2024Feb 28, 2024

    • coreweave-app

      Public
      Jupyter Notebook
      •0•0•0•0•Updated Jun 14, 2023Jun 14, 2023

    • tmls-workshop-2023

      Public
      Repository containing the necessary files for TMLS 2023 demo
      Python
      •0•0•0•0•Updated Jun 6, 2023Jun 6, 2023

    • pulumi

      Public
      Pulumi - Infrastructure as Code in any programming language. Build infrastructure intuitively on any cloud using familiar languages 🚀
      Go
      •
      Apache License 2.0
      •1.1k•0•0•0•Updated May 2, 2023May 2, 2023

    • gpu-usage-estimator

      Public
      Python script to estimate GPU utilization using NVIDIA Nsight Systems
      scriptgpuprofiling
      Python
      •0•4•0•0•Updated Apr 27, 2023Apr 27, 2023

    • cortex

      Public
      Production infrastructure for machine learning at scale
      Go
      •
      Apache License 2.0
      •608•0•0•0•Updated Mar 31, 2023Mar 31, 2023

    • asplos23-tutorial

      Public
      Jupyter Notebook
      •0•2•0•0•Updated Mar 26, 2023Mar 26, 2023

    • build-pytorch-from-source

      Public
      Build PyTorch from source
      pytorch
      Dockerfile
      •
      Apache License 2.0
      •1•2•0•0•Updated Mar 26, 2023Mar 26, 2023

    • transformers

      Public
      🤗Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •28k•0•0•0•Updated Mar 5, 2023Mar 5, 2023

    • VectorWorkshop

      Public
      Jupyter Notebook
      •
      MIT License
      •2•8•0•0•Updated Feb 10, 2023Feb 10, 2023