YaRN has now been implemented.
Additionally, position embedders are no longer implicitly instantiated through keyword arguments to CompressiveMemory, InfiniTransformer, or MoDInfiniTransformer. Now, the classes RoPEEmbeddings and YaRNEmbeddings are exposed and can be passed to CompressiveMemory, InfiniTransformer, and MoDInfiniTransformer via the position_embedder argument.