search

stanfordnlp / pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions
http://pyvene.ai
Apache License 2.0
545 stars 46 forks source link

Add Llava integration to Pyvene #151

Closed ZhengPeterWang closed 2 months ago

ZhengPeterWang commented 2 months ago

Description

Only integrates the language model part of the vision language model

Testing Done

Checklist:

PinetreePantry commented 2 months ago

Q: Do we only do the intervention on the language model part?

aryamanarora commented 2 months ago

I think it's okay to start with the LM, like we have implemented for BLIP