Skip to content

Commit

Permalink
[doc] Add QAT tutorial
Browse files Browse the repository at this point in the history
  • Loading branch information
andrewor14 committed Jun 22, 2024
1 parent ef6e196 commit 44a2b4b
Show file tree
Hide file tree
Showing 3 changed files with 397 additions and 0 deletions.
Binary file added docs/source/_static/img/qat_diagram.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
8 changes: 8 additions & 0 deletions docs/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,13 @@ torchtune tutorials.
:link: tutorials/qlora_finetune.html
:tags: finetuning,llama2,qlora

.. customcarditem::
:header: Finetuning with QAT in torchtune
:card_description: Finetuning of Llama3 using QAT
:image: _static/img/generic-pytorch-logo.png
:link: tutorials/qat_finetune.html
:tags: finetuning,llama3,qat,quantization,evals

.. customcarditem::
:header: End-to-End Workflow with torchtune
:card_description: Train, Evaluate, Quantize and then Generate with your LLM.
Expand Down Expand Up @@ -99,6 +106,7 @@ torchtune tutorials.
tutorials/llama3
tutorials/lora_finetune
tutorials/qlora_finetune
tutorials/qat_finetune
tutorials/e2e_flow
tutorials/datasets
tutorials/chat
Expand Down
Loading

0 comments on commit 44a2b4b

Please sign in to comment.