LLM proxy application powered by AWS Chalice and LiteLLM.
-
Install dependencies
pip install -r requirements.txt
-
Build and deploy the application
chalice deploy --stage dev
-
Test it out!
curl -s -X POST `chalice url --stage dev`/images/generations \ --user "$AWS_ACCESS_KEY_ID":"$AWS_SECRET_ACCESS_KEY" \ --aws-sigv4 "aws:amz:$AWS_DEFAULT_REGION:execute-api" \ -H "x-amz-security-token: $AWS_SESSION_TOKEN" \ -H "Accept: application/json" \ -H "Content-Type: application/json" \ -d @assets/goblet.json | jq -r .data[0].b64_json | base64 -d > assets/goblet.jpg
This project includes a justfile that simplifies the process of building, deploying and testing the application.
# Run 🛠️
just local
just deploy
# Check ✅
just check
# Test 🚀
just talk "What is the meaning of life?"
just embed "So long and thanks for all the fish"
just image "An astronaut riding a horse on Mars"
# Clean 🧹
just destroy
Want to learn more about just? Check out the Just Programmer's Manual 📖