Finetune Transformer decoder only models like GPT2 with causal language model objective
python finetune_gpt2_clm_pytorch.py \
--model-name gpt2 \
--dataset-path train.txt \
--batch-size 8 \
--epoch 4 \
--model-version-no 1 \
--model-dir ./
-
Notifications
You must be signed in to change notification settings - Fork 0
This repository contains notebooks and pipelines exploring internal working of GPT2, visualization of its embeddings, its capabilities for different NLP tasks - text completion, classification, reading comprehension etc.
Taaniya/exploring-gpt2-language-model
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This repository contains notebooks and pipelines exploring internal working of GPT2, visualization of its embeddings, its capabilities for different NLP tasks - text completion, classification, reading comprehension etc.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published