Skip to content

schauppi/xLSTM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

49 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Paper implementation of the memory cells sLSTM and mLSTM as well as the xLSTM architecture presented in xLSTM: Extended Long Short-Term Memory.

Figure 1

Initial Results

Results on an sine wave with 5 hidden units and 500 epochs.

sLSTM

Figure 2

mLSTM

Figure 3

To Do

  • Check implementation of mLSTM - seems somewhat off
  • Implement xLSTM - stack Cells together

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages