Open bclarkson-code opened 2 months ago
Modern LLMs basically all use rotary position embeddings. these should be added to tricycle
Modern LLMs basically all use rotary position embeddings. these should be added to tricycle