search

vgel / repeng

A library for making RepE control vectors
https://vgel.me/posts/representation-engineering/
MIT License
435 stars 31 forks source link

Bug in control.py #18

Closed sam-scale closed 4 months ago

sam-scale commented 4 months ago

If model has an attribute called model, then you should get the layers via model.model.layers not model.layers

sam-scale commented 4 months ago

Hey @vgel let me know what you think!

vgel commented 4 months ago

You're completely right, thank you! I really need to get a Mistral-architecture model in CI :sweat_smile:

vgel commented 4 months ago

Fixes #16