Corpus2GPT v0.1.0-alpha
abhaskumarsinha
released this
27 Apr 18:01
·
45 commits
to main
since this release
Corpus2GPT - The easiest way to make and train GPTs from scratch.
Key Features
- Classical Multihead Attention
- Decoder Module
- Random Sampling Search Strategies
- Multiple Language Support
- Sentence Piece Tokenizer and Vectorizer
- GPT Builder
- Distributed Learning Support
- Scaling Utilities Support
Currently, in alpha
phase, serialization and de-serialization will be implemented in beta
version and import directories would be changed to support import Corpus2GPT
.
Full Changelog: https://github.com/abhaskumarsinha/Corpus2GPT/commits/v0.1.0-alpha