vgel / repeng

A library for making RepE control vectors
https://vgel.me/posts/representation-engineering/
MIT License
435 stars 31 forks source link

GGUF export #5

Closed vgel closed 5 months ago

vgel commented 5 months ago

Adds a method to export a vector to a .gguf file, using an optional gguf dependency. This file can't be used with llama.cpp yet.

Also normalizes layer indices passed to ControlVector/ControlModel—if you pass negative indices, they'll be stored as positive ones now.