Does the inference need to run on 8 A100?

X-PLUG / mPLUG-2

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

Apache License 2.0

220 stars 18 forks source link

Does the inference need to run on 8 A100? #9

Open simanw304 opened 1 year ago

simanw304 commented 1 year ago

I tried to run inference for video captioning on 1 A100 but got OOM issues. Does the inference need to run on 8 A100 or can it run one one A100? Thanks in advance.

rose-jinyang commented 1 year ago

Hello @Roleone123 and @MAGAer13 Is it possible to do inference of mPLUG-2 model for video captioning on multiple GPUs?