moGPT

Building my first GPT model.

A statitican journey to master GPT models.

First step, load shakespeare data

python  python data/get_data.py

This would load a training data which has 301,966 tokens, and validation data with 36,059 tokens.

preparing the model