search

OpenGVLab / InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
https://internvl.readthedocs.io/en/latest/
MIT License
6.02k stars 467 forks source link

每次推理，显存占用都会不断增加是什么问题 #575

Closed Note-Liu closed 2 months ago

Note-Liu commented 2 months ago

命令：CUDA_VISIBLE_DEVICES=0 python3.10 model_worker.py --host 0.0.0.0 --controller $CONTROLLER_URL --port 40001 --worker http://0.0.0.0:40001 --model-path InternVL2-8B