Build a Large Language Model (From Scratch)

• Build a Large Language Model (From Scratch)
  • Quick Start
  • Table of Contents

This repo is my note for the book Build a Large Language Model (From Scratch). I will follow the book to build a large language model from scratch.

The difference from the official repo is that in this repo I will add some of my own notes and some of my own implementation methods.

Quick Start

1. Clone the repo

   git clone https://github.com/kyriekevin/LLMs-from-scratch.git

2. Setup the environment The detailed environment setup can be found in the setup
3. Run the code You can run python code or ipynb code in the src folder. All chapter codes in the src folder are consistent with the official repo.

Table of Contents

Chapter Title	Main Code (for Quick Access)	All Code + Supplementary
Setup recommendations	-	-
Ch 1: Understanding Large Language Models	No Code	-

Note

The setup part will be continuously updated. When new libraries need to be used, pyproject.toml and requirements.txt will be updated.