search

vgel / repeng

A library for making RepE control vectors
https://vgel.me/posts/representation-engineering/
MIT License
435 stars 31 forks source link

Control Vector Arithmetic #3

Closed mory91 closed 5 months ago

mory91 commented 5 months ago

Hi, First of all, I read your blog post and it was great! Thanks for that. I had an idea I wanted to see if you tried that or not. Did you try to control vector arithmetic? e.g. adding jealousy and wrath control vectors and getting a jealous angry llm.

vgel commented 5 months ago

Yeah that should be possible, planning to add it soon along with a notebook demonstration.

mory91 commented 5 months ago

I'm down to contribute this notebook if you like.

vgel commented 5 months ago

Added in #6 ! Happy to accept additional examples, you can either append to the vector_ops notebook or make vector_ops_2 if what you have in mind is sufficiently different.