Notebook showing how to implement a decoder transformer model and train it for language modeling on the WebText dataset.
Note: Work in progress!
-
Notifications
You must be signed in to change notification settings - Fork 0
Notebook showing how to implement and train a transformer for language modeling
License
jbergq/transformer-language-modeling
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Notebook showing how to implement and train a transformer for language modeling
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published