Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
Repository health snapshot: 67 forks and 21 open issues at review time. Platform support is inferred conservatively from repository topics and description.
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch Fossfits includes rotary-embedding-torch as an actively maintained vector db option: its public repository was updated on 2026-06-20, uses the MIT license, and had 824 stars when reviewed. Check its documentation and release notes before production adoption.
artificial intelligence · deep learning · positional encoding