search

InternLM / InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.
1.91k stars 120 forks source link

Multi-GPU inference #322

Open Han230104 opened 1 month ago

Han230104 commented 1 month ago

Hello! I got this error when running examples/example_chat.py and share-cap_batch_infer.py with multiple gpus. Does anyone know how to solve it ? image

Han230104 commented 1 month ago

When I set os.environ['CUDA_LAUNCH_BLOCKING'] = '1', it reveals more details. image