Building Transformers from scratch for regression and classification tasks. The modules include:
Multi-head Attention
Transformer Block(s)
Positional Encoding
Encoder / Decoder
-
Notifications
You must be signed in to change notification settings - Fork 0
An EncoderTransformer Architecture developed from scratch using pytorch's neural network module as the base class. The developed model used for sentiment analysis and time series prediction tasks.
Ogunfool/EncoderTransformerArchitecture-FromScratch
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
An EncoderTransformer Architecture developed from scratch using pytorch's neural network module as the base class. The developed model used for sentiment analysis and time series prediction tasks.
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published