Skip to content

Commit

Permalink
include cm commands - accuracy and calibration
Browse files Browse the repository at this point in the history
  • Loading branch information
anandhu-eng authored Dec 23, 2024
1 parent b2ce7c8 commit 7c163f5
Showing 1 changed file with 11 additions and 0 deletions.
11 changes: 11 additions & 0 deletions graph/R-GAT/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -149,6 +149,10 @@ python3 tools/split_seeds.py --path igbh --dataset_size full

The calibration dataset contains 5000 nodes from the training paper nodes of the IGBH dataset. We provide the [Node ids](../../calibration/IGBH/calibration.txt) and the [script](tools/split_seeds.py) to generate them (using the `--calibration` flag).

**CM Command**
```
cm run script --tags=get,dataset,igbh,_full,_calibration --outdirname=<path to download>
```

### Run the benchmark
#### Debug Run
Expand All @@ -170,6 +174,13 @@ cd $GRAPH_FOLDER
python3 main.py --dataset igbh-dgl --dataset-path igbh/ --profile rgat-dgl-full [--model-path <path_to_ckpt>] [--in-memory] [--device <cpu or gpu>] [--dtype <fp16 or fp32>] [--scenario <SingleStream, MultiStream, Server or Offline>]
```

### Evaluate the accuracy
```bash
cm run script --tags=process,mlperf,accuracy,_igbh --result_dir=<Path to directory where files are generated after benchmark run>
```

Please click [here](https://github.com/mlcommons/inference/blob/dev/graph/R-GAT/tools/accuracy_igbh.py) to view the python script for evaluating accuracy for the igbh dataset.

#### Run using docker

Not implemented yet
Expand Down

0 comments on commit 7c163f5

Please sign in to comment.