Skip to content

OpenCSGs/llm-scheduler-api

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM Scheduler API

Prerequisite

Slurm engine was installed. Reference: Slurm Installation

Installation

  1. Install dependency: Python 3.10+
pip install -r requirements.txt
  1. API
python main.py

or

uvicorn main:app --host 0.0.0.0 --port 3000

API document

http://localhost:3000/docs