Releases: lucidrains/MEGABYTE-pytorch
Releases · lucidrains/MEGABYTE-pytorch
0.3.5
Full Changelog: 0.3.4...0.3.5
0.3.4
fix regression and some dimension conditional
0.3.3
0.3.2
Full Changelog: 0.3.1...0.3.2
0.3.1
Full Changelog: 0.3.0...0.3.1
0.3.0
Full Changelog: 0.2.1...0.3.0
0.2.1
make sure it supports greater than 2 hierarchies
0.2.0
move closer to what the paper did, with local and global token embedd…
0.1.7
switch to rotary embeddings, as they did in the paper
0.1.6
evidence is emerging that decoders generate implicit absolute and rel…