Commits on Jun 18, 2024

1. fixing scripts …

   Summary:
   
   a few bugfixes for scripts
   
   1) convert_hf_checkpoint.py had a gpt-fast dependency that wasn't caught
      due to it being in the path
   
   2) eval.py had a bug due to the switch to aqt apis
   3) generate.py had a bug due to the deprecation of the old quant apis
   
   Test Plan:
   
   python eval.py
   python eval.py -q int8dq --compile --limit 2
   python eval.py -q int8wo --compile --limit 2
   python eval.py -q int4wo-64 --compile --limit 2
   python eval.py -q int4wo-64-gptq --compile
   sh benchmarks.sh
   
   (going to add the output results once they finish
   
   Reviewers:
   
   Subscribers:
   
   Tasks:
   
   Tags:

   

   HDCharles committed Jun 18, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for 3fa636f
   • Browse repository at this point

   Copy the full SHA

   3fa636f View commit details

   Browse the repository at this point in the history