Skip to content

Commit

Permalink
fix docs typo, remove commented out benchmark params
Browse files Browse the repository at this point in the history
  • Loading branch information
tstescoTT committed Jan 14, 2025
1 parent 0ea6f52 commit fbd705c
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 10 deletions.
9 changes: 0 additions & 9 deletions benchmarking/vllm_online_benchmark.py
Original file line number Diff line number Diff line change
Expand Up @@ -83,15 +83,6 @@ def main():
{"input_len": 128, "output_len": 4096, "batch_size": 32, "num_prompts": 32 * 4},
{"input_len": 2048, "output_len": 128, "batch_size": 32, "num_prompts": 32 * 16},
{"input_len": 2048, "output_len": 2048, "batch_size": 32, "num_prompts": 32 * 4},
# {"input_len": 128, "output_len": 128, "batch_size": 32, "num_prompts": 32},
# {"input_len": 128, "output_len": 2048, "batch_size": 32, "num_prompts": 32},
# {"input_len": 128, "output_len": 4096, "batch_size": 32, "num_prompts": 32},
# {"input_len": 2048, "output_len": 128, "batch_size": 32, "num_prompts": 32},
# {"input_len": 2048, "output_len": 2048, "batch_size": 32, "num_prompts": 32},
# {"input_len": 1000, "output_len": 1000, "batch_size": 32, "num_prompts": 32},
# {"input_len": 500, "output_len": 2000, "batch_size": 32, "num_prompts": 32},
# {"input_len": 5000, "output_len": 500, "batch_size": 32, "num_prompts": 32},
# {"input_len": 20000, "output_len": 2000, "batch_size": 32, "num_prompts": 32},
]
# fmt: on

Expand Down
2 changes: 1 addition & 1 deletion evals/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,5 +68,5 @@ Running the `run_evals.sh` script will:

```bash
cd ~/app/evals
. run_evals.sh
./run_evals
```

0 comments on commit fbd705c

Please sign in to comment.