VachanVY / Rotary-Embeddings Public

Notifications You must be signed in to change notification settings
Fork 0
Star 3

Simple Implementation of Rotary Positional Embeddings (RoPE) and Sinusoidal Positional Embeddings in JAX

3 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
LICENSE		LICENSE
README.md		README.md
rope.py		rope.py
rope1.png		rope1.png
rope2.png		rope2.png
rope3.png		rope3.png

Repository files navigation

Rotary Positional Embedding: [paper]

Also See

About

Simple Implementation of Rotary Positional Embeddings (RoPE) and Sinusoidal Positional Embeddings in JAX

embeddings paper-implementations jax positional-embedding rotary-embeddings

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%