Skip to content

Add a benchmark script for in-batch prefix caching #3101

Add a benchmark script for in-batch prefix caching

Add a benchmark script for in-batch prefix caching #3101

Annotations

2 errors

unit-test-backend-1-gpu (0-6)

cancelled Dec 17, 2024 in 4m 57s
Set up job
6s
Checkout code
6s
Install dependencies
48s
Run test
3m 48s
Post Checkout code
0s
Complete job
0s