search

vgel / repeng

A library for making RepE control vectors
https://vgel.me/posts/representation-engineering/
MIT License
435 stars 31 forks source link

Q: repeng vs system prompt #20

Closed nmandic78 closed 4 months ago

nmandic78 commented 4 months ago

This sounds like a cool idea! Watching your PR in llama.cpp. I have just few questions. What is the difference in effect on generation when compared with system prompt? Stronger and/or more precise influence? Speed? Could multiple control vectors be combined? In series or in parallel? Thank you!

vgel commented 4 months ago

I discuss this somewhat in the blog post here: https://vgel.me/posts/representation-engineering/#Control_Vectors_v.s._Prompt_Engineering , but it's worth testing with your specific task!

nmandic78 commented 4 months ago

Thank you. Blog explains the gist very well. Should have red it at start, thanks for pointing to it. For other questions I should test it myself and I will. I see it as some kind of 'latent space' (embeddings and hidden states) navigation bias. Very interesting.