huggingface / peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
https://huggingface.co/docs/peft
Apache License 2.0
16.34k stars 1.61k forks source link

Vision question answering #682

Closed ppyt closed 1 year ago

ppyt commented 1 year ago

Feature request

Would you please add an example about how to fine-tune BLIP2 on a VQA dataset?

Motivation

VQA IS VERY IMPORANT

Your contribution

Sorry.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

dszpr commented 9 months ago

Hi bro, I am also working on BLIP2-VQA task and want to use LoRA to fine-tune the LLM module. Have you already accomplished this? @ppyt

chengjiali commented 5 months ago

Same question here. This is not resolved. Please re-open it.