Skip to content

Commit

Permalink
Update compression config for psmathur/orca_mini_3b (#862)
Browse files Browse the repository at this point in the history
* Update compression config for psmathur/orca_mini_3b

* Remove dataset parameter
  • Loading branch information
nikita-savelyevv authored Aug 10, 2024
1 parent 3559c6a commit cb32118
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions optimum/intel/openvino/configuration.py
Original file line number Diff line number Diff line change
Expand Up @@ -84,8 +84,6 @@ class OVQuantizationMethod(str, Enum):
"sym": True,
"group_size": 64,
"all_layers": True,
"dataset": "wikitext2",
"quant_method": OVQuantizationMethod.AWQ,
},
"bigscience/bloomz-560m": {
"bits": 4,
Expand Down

0 comments on commit cb32118

Please sign in to comment.