Add saving/loading of trainable parameters in the model (e.g. classification heads) to IntervenableModel.save() and IntervenableModel.load(). Draft PR since some tests are failing, will finalise tomorrow.
Testing Done
Saving/loading of Gemma 2B-IT for sequence classification works perfectly.
Checklist:
[ ] My PR title strictly follows the format: [Your Priority] Your Title
Description
Add saving/loading of trainable parameters in the model (e.g. classification heads) to
IntervenableModel.save()andIntervenableModel.load(). Draft PR since some tests are failing, will finalise tomorrow.Testing Done
Saving/loading of Gemma 2B-IT for sequence classification works perfectly.
Checklist:
[Your Priority] Your Title