search

X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

Why can only CPU be used for video inference code in reademe? Is there any code that uses GPU for inference? #163

Open Fly-hub opened 11 months ago

Fly-hub commented 11 months ago

Why can only CPU be used for video inference code in reademe? Is there any code that uses GPU for inference?

shaswati1 commented 10 months ago

@Fly-hub, you can do this by using the code below: model = MplugOwlForConditionalGeneration.from_pretrained( pretrained_ckpt, device_map={'': 1}, )