stanfordnlp / pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions
http://pyvene.ai
Apache License 2.0
545 stars 46 forks source link

[P0] Make interface compatible with HF trainer #121

Closed aryamanarora closed 3 months ago

aryamanarora commented 4 months ago

Suggestion / Feature Request

Need to make sure HF trainer can easily hook onto pv.IntervenableModel. This means getting the right parameters for the optimiser, making sure model state is set correctly, etc.