search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Gradient rope formula with offsets #938

Closed Nexesenex closed 1 week ago

Nexesenex commented 1 week ago

Positive for Solar models Negative for Llama 1 and 2 models