search

X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

Modality-Adaptive Module #226

Open Davilian7 opened 2 months ago

Davilian7 commented 2 months ago

How to implement the modality-adaptive module in code?

vateye commented 2 months ago

Please see https://github.com/X-PLUG/mPLUG-Owl/blob/main/mPLUG-Owl2/mplug_owl2/model/multiway.py