X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

A video inference problem #149

Open Aonionhead opened 1 year ago

Aonionhead commented 1 year ago

Hello, I am a graduate student and using video inference.

After inputting a video into the model, I found that in the 18th encoder layer of the MplugOwlVisionEncoderLayer, during mlp, after QuickGELU activation function, the values of hidden_states have all changed to nan.

Hope to receive some help here. Thank you!