search

X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.32k stars 176 forks source link

Modality-Adaptive Module #226

Open Davilian7 opened 4 months ago

Davilian7 commented 4 months ago

How to implement the modality-adaptive module in code?

vateye commented 4 months ago

Please see https://github.com/X-PLUG/mPLUG-Owl/blob/main/mPLUG-Owl2/mplug_owl2/model/multiway.py