Releases: lucidrains/recurrent-memory-transformer-pytorch
Releases · lucidrains/recurrent-memory-transformer-pytorch
0.5.6
Full Changelog: 0.5.5...0.5.6
0.5.5
address https://github.com/lucidrains/recurrent-memory-transformer-py…
0.5.4
address https://github.com/lucidrains/recurrent-memory-transformer-py…
0.5.3
allow for customizing whether read memory is stop gradded, the one ad…
0.5.2
reinject the write memory positions
0.5.1
address https://github.com/lucidrains/recurrent-memory-transformer-py…
0.5.0
give a null key / value to protect against entirely masked out row, a…
0.4.3
address https://github.com/lucidrains/recurrent-memory-transformer-py…
0.4.2
address https://github.com/lucidrains/recurrent-memory-transformer-py…
0.4.1
turns out resiDual is prone to overflowing in fp16. add the scaling s…