support convert and quantize from hf models#167

Merged

zhiyuan8 merged 17 commits intomainfrom perry/convert-and-quantize

Oct 23, 2024

+667-91

Commits on Oct 15, 2024

implemented basic quantization api
zhycheng614
committed
WIP - added basic convert from hf to gguf logic, and the the convert - quantize pipeline
zhycheng614
committed
added directory checking logic, and added main function for covnert
zhycheng614
committed