search

bojone / rerope

Rectified Rotary Position Embeddings
338 stars 30 forks source link

position_ids_q - position_ids_k < window #19

Closed wzhcz8902 closed 5 months ago