Skip to content

Corpus2GPT v0.1.0-alpha

Compare
Choose a tag to compare
@abhaskumarsinha abhaskumarsinha released this 27 Apr 18:01
· 45 commits to main since this release
ae3aa74

Corpus2GPT - The easiest way to make and train GPTs from scratch.

Key Features

  • Classical Multihead Attention
  • Decoder Module
  • Random Sampling Search Strategies
  • Multiple Language Support
  • Sentence Piece Tokenizer and Vectorizer
  • GPT Builder
  • Distributed Learning Support
  • Scaling Utilities Support

Currently, in alpha phase, serialization and de-serialization will be implemented in beta version and import directories would be changed to support import Corpus2GPT.

Full Changelog: https://github.com/abhaskumarsinha/Corpus2GPT/commits/v0.1.0-alpha