Code

Enabled int8 weights by default#31

Code

Merged

ilya-lavrenov merged 1 commit intoilya-lavrenov:openvino-model-executorilya-lavrenov/vllm:openvino-model-executorfrom slyalin:int8_enabled_by_defaultslyalin/vllm:int8_enabled_by_defaultCopy head branch name to clipboardApr 20, 2024

+3-1

Commits

Commits on Apr 19, 2024

• Enabled int8 weights by default for performnace benchmarking purposes

  slyalin

  committed
  4931727

  Copy full SHA for 4931727