Skip to content

Commit

Permalink
oh shoot! i missed some brackets!
Browse files Browse the repository at this point in the history
Signed-off-by: Konrad Zawora <kzawora@habana.ai>
  • Loading branch information
kzawora-intel committed Jan 17, 2025
1 parent 0ecfe56 commit 46d59ea
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions vllm/worker/hpu_worker.py
Original file line number Diff line number Diff line change
Expand Up @@ -146,6 +146,10 @@ def execute_model(
if log_graph_compilation or log_cpu_fallbacks and \
execute_model_req is not None:
from habana_frameworks.torch.hpu.metrics import metric_localcontext

# NOTE(kzawora): This assertion is needed to avoid [union-attr]
# mypy error, even though we guarantee it in the if condition.
assert execute_model_req is not None
seq_group_metadata_list = execute_model_req.seq_group_metadata_list
is_prompt = any([
seq_group_metadata.is_prompt
Expand Down

0 comments on commit 46d59ea

Please sign in to comment.