Skip to content
PR Test

[Fix] Adjust default chunked prefill size and cuda graph max bs according to GPU memory capacity #1927

Sign in to view logs

[Fix] Adjust default chunked prefill size and cuda graph max bs according to GPU memory capacity

[Fix] Adjust default chunked prefill size and cuda graph max bs according to GPU memory capacity #1927

Annotations

2 errors

accuracy-test-2-gpu

accuracy-test-2-gpu
cancelled Nov 15, 2024 in 15m 6s