Skip to content

Commit

Permalink
#0: Improve falcon7b device perf threshold because literally NO ONE I…
Browse files Browse the repository at this point in the history
…S FIXING IT
  • Loading branch information
tt-rkim committed Nov 4, 2024
1 parent d46ba83 commit ea9c15d
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
"batch_size, test, expected_perf",
[
[1, "BFLOAT16-L1-falcon_7b-layers_32-prefill_seq256", 3.666],
[32, "BFLOAT16-L1-falcon_7b-layers_32-decode_batch32", 139],
[32, "BFLOAT16-L1-falcon_7b-layers_32-decode_batch32", 142],
],
)
@pytest.mark.models_device_performance_bare_metal
Expand Down

0 comments on commit ea9c15d

Please sign in to comment.