Skip to content

Commit

Permalink
rebase
Browse files Browse the repository at this point in the history
  • Loading branch information
alexm-redhat committed Jul 11, 2024
1 parent cb3b178 commit bfa1647
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/worker/model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -744,7 +744,7 @@ def _prepare_model_input_tensors(
" Otherwise, the output might be wrong."
" Set Flashinfer backend by "
"export VLLM_ATTENTION_BACKEND=FLASHINFER.")

if log_runner:
print("Final tensors:")
for name, tensor in [("input_tokens_tensor", input_tokens_tensor),
Expand Down

0 comments on commit bfa1647

Please sign in to comment.