search

mbzuai-oryx / Video-ChatGPT

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.
https://mbzuai-oryx.github.io/Video-ChatGPT
Creative Commons Attribution 4.0 International
1.05k stars 92 forks source link

CUDA error: invalid device ordinal #62

Closed tkarthikeyan132 closed 8 months ago

tkarthikeyan132 commented 8 months ago

image

while I was running the training code, i faced this issue NOTE: I have 2 A100 gpus and 8 cpus

mmaaz60 commented 8 months ago

Hi @tkarthikeyan132,

Thank you for your interest in our work. Please share the script you are running and the command you are using for reproducing the issue. Thanks

tkarthikeyan132 commented 8 months ago

Hi @mmaaz60, I haven't changed the script and I run the torchrun command, image

tkarthikeyan132 commented 8 months ago

I changed nproc_per_node to 2 and the cuda error went away. Thanks