Skip to content

Latest commit

 

History

History
19 lines (15 loc) · 776 Bytes

README.md

File metadata and controls

19 lines (15 loc) · 776 Bytes

Sentient-AGI AlpineX Benchmark

Locust Testing Framework for Sentient AGI for Testing AlpineX Inference

Get AlpineX API Key

From here: https://app.alpinex.ai/apiKeys

Instructions to Run

  1. Make sure you have poetry installed: https://python-poetry.org/docs/#installation

  2. Install packes with poetry install

  3. run in poetry shell poetry shell

  4. Change SENTIENT_TEST = "reasoning-ttft" in the code (we support two ttft tests for now)

  5. Fix .env:

    a. Copy the example file: cp .example-env .env
    b. Replace ALPINEX_API_KEY with your API key

  6. Run Locust: locust -f alpinex-load-test-ttft.py:

    a. Open the UI at http://0.0.0.0:8089/
    b. Test with user = 100 and ramp up = 5 (wait 1 minute for it to warm up)