Skip to content

Releases: lucidrains/infini-transformer-pytorch

0.1.6

09 Oct 13:19
Compare
Choose a tag to compare

0.1.5

09 May 17:58
Compare
Choose a tag to compare
isolate fastweight mem logic into module and make exportable, so some…

0.1.1a

09 May 14:29
Compare
Choose a tag to compare
fix an issue with rotary embeddings and cached kv

0.1.0

09 May 13:24
Compare
Choose a tag to compare
seems to tbe working

0.0.25

08 May 23:36
Compare
Choose a tag to compare
allow for infini-transformer learning on detached past memories, hand…

0.0.24

08 May 20:23
Compare
Choose a tag to compare
handle edge case where different batch samples can have different num…

0.0.23

08 May 20:18
Compare
Choose a tag to compare
training works with any sequence length

0.0.22

08 May 20:11
Compare
Choose a tag to compare
simplify

0.0.21

08 May 19:58
Compare
Choose a tag to compare
able to generate

0.0.20

08 May 19:40
Compare
Choose a tag to compare
start using dropout again bc of https://arxiv.org/abs/2305.16179