How to integrate RMT with Conformer #21
pfeatherstone
started this conversation in
General
Replies: 1 comment
-
@pfeatherstone the memories need to be excised before the convolutions. the convolutions will also need to be causal it is all around tricky and requires non trivial engineering work |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
If i were to integrate RMT inside Conformer, would there be any extra states, e.g. from the convolutional layers, that would have to be cached for the next time steps. I can't see how one would do that. Or would caching the memories from RMT be sufficient?
Beta Was this translation helpful? Give feedback.
All reactions