PR Test

Add a benchmark script for in-batch prefix caching #3101

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
unit-test-backend-1-gpu (0-6)	4m 57s
unit-test-backend-1-gpu (6-15)	4m 51s
accuracy-test-1-gpu	4m 42s
performance-test-1-gpu-part-1	4m 40s
unit-test-backend-1-gpu (15-23)	4m 47s
unit-test-backend-1-gpu (23-30)	4m 56s
performance-test-1-gpu-part-2	4m 52s
unit-test-backend-1-gpu (30-100)	4m 46s
performance-test-2-gpu	4m 47s
unit-test-backend-2-gpu	1s
unit-test-frontend	1s
accuracy-test-2-gpu	1s
finish	1s
	43m 22s