fix: resolve correctness_test issue

[zhyncs]

Motivation

as titled cc @merrymercy @Ying1123 @hnyls2002 @min-xu-et

tested with

python -m sglang.bench_latency --model-path internlm/internlm2-chat-7b --load-format dummy --trust-remote-code
python -m sglang.bench_latency --model-path internlm/internlm2-chat-7b --batch 1 12 14 --input-len 256 512 --output-len 32 256 --result-filename out.jsonl --trust-remote-code
python -m sglang.bench_latency --model-path internlm/internlm2-chat-7b --batch 1 12 14 --input-len 256 512 --output-len 32 256 --result-filename out.jsonl --run-name after --trust-remote-code
python -m sglang.bench_latency --result-filename out.jsonl --graph-sql="select run_name, batch_size, prefill_throughput from results" 
python -m sglang.bench_latency --model-path internlm/internlm2-chat-7b --correct --trust-remote-code

Modification

Briefly describe the changes made in this PR.

Checklist

1. Ensure pre-commit pre-commit run --all-files or other linting tools are used to fix potential lint issues.
2. Confirm that modifications are covered by complete unit tests. If not, please add more unit tests for correctness.
3. Modify documentation as needed, such as docstrings or example tutorials.

[min-xu-et]

Thanks for the fix!