This repository contains an educational implementation of Rotary Positional Encodings (RoPE) in PyTorch. RoPE is a method introduced in the paper RoFormer: Enhanced Transformer with Rotary Position Embedding by Jianlin Su, Yu Lu, Shengfeng Pan, Ahmed Murtadha, Bo Wen, and Yunfeng Liu.