Skip to content

rahulgang06/llm-scratch

Repository files navigation

training.py file contain the all the module which required for create the llm from scratch.

chatbot.py file having the pkl file which we get from the training.py. Model is trained from scratch using this dataset : https://huggingface.co/datasets/Skylion007/openwebtext

**Steps to execute this project : Clone this repo -> run pip install -r requirements.txt -> download the dataset from above huggingface link.

      Run the training.py for train the model use the pkl file generated from this and then run the chatbot.py file 

      cmd to run chatbot.py : python chatbot.py -batch_size = 32. 

Output :

52ea7763-045d-49b3-be39-96c4946b86ba.1.mp4

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published