From db511e0ac4d3f00615ee140143b264d7ffd38162 Mon Sep 17 00:00:00 2001 From: "Huang, Tai" Date: Mon, 16 Oct 2023 02:06:58 +0000 Subject: [PATCH] util: minor update readme of llm carbon calculator --- .../utils/llm_carbon_calc_readme.md | 6 +----- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/intel_extension_for_transformers/utils/llm_carbon_calc_readme.md b/intel_extension_for_transformers/utils/llm_carbon_calc_readme.md index e4136177d1f8..fd2fb3dddd9d 100644 --- a/intel_extension_for_transformers/utils/llm_carbon_calc_readme.md +++ b/intel_extension_for_transformers/utils/llm_carbon_calc_readme.md @@ -27,22 +27,18 @@ options:
When the total time of one inference procedure is measured, you can specific -t or --time like following command line - ```shell $python llm_carbon_calc.py -m 27412.98 --ct 350 -c 0.56 -t 6510.3 CPU TDP (W): 350 Memory Consumption (MB) 27412.98 Output token number: 32 Total time of one infernce (ms) 6510.3 Carbon emission in one inference (kgCO2e) 0.0003575115963544682 - ``` When the total time of one inference procedure is not measured but first token latency and next token latency are measured, you can refer to following example - ```shell $ python llm_carbon_calc.py -m 27412.98 --ct 350 -c 0.56 --fl 2284.75 --nl 136.31 -n 32 CPU TDP (W): 350 Memory Consumption (MB) 27412.98 Output token number: 32 Total time of one infernce (ms) 6510.36 - Carbon emission in one inference (kgCO2e) 0.00035751489124038457 - ``` + Carbon emission in one inference (kgCO2e) 0.00035751489124038457 \ No newline at end of file