Online conversion with Colab
[New] After memory optimization, Colab free users can now convert 7B and 13B models online!
If you are familiar with Google Colab (if you have Pro and higher subscriptions), you can use our written Notebook to combine and quantify models online.
- Support online conversion of LLaMA/Alpaca model 7B and 13B versions
- After the run is over, you can download the combined full volume and quantized weights on demand (you can also transfer to your own Google Drive)
- For specific steps, please move to the Google Colab notebook to view and run it (also available in the
notebooksdirectory, for reference):
