Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

Commit

Permalink
util: minor update readme of llm carbon calculator
Browse files Browse the repository at this point in the history
  • Loading branch information
thuang6 committed Oct 16, 2023
1 parent 1f0259f commit db511e0
Showing 1 changed file with 1 addition and 5 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -27,22 +27,18 @@ options:<br>

When the total time of one inference procedure is measured, you can specific -t or --time like following command line

```shell
$python llm_carbon_calc.py -m 27412.98 --ct 350 -c 0.56 -t 6510.3
CPU TDP (W): 350
Memory Consumption (MB) 27412.98
Output token number: 32
Total time of one infernce (ms) 6510.3
Carbon emission in one inference (kgCO2e) 0.0003575115963544682
```

When the total time of one inference procedure is not measured but first token latency and next token latency are measured, you can refer to following example

```shell
$ python llm_carbon_calc.py -m 27412.98 --ct 350 -c 0.56 --fl 2284.75 --nl 136.31 -n 32
CPU TDP (W): 350
Memory Consumption (MB) 27412.98
Output token number: 32
Total time of one infernce (ms) 6510.36
Carbon emission in one inference (kgCO2e) 0.00035751489124038457
```
Carbon emission in one inference (kgCO2e) 0.00035751489124038457

0 comments on commit db511e0

Please sign in to comment.