search

Ucas-HaoranWei / Vary

[ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
1.77k stars 156 forks source link

3090的24G显存不够用于推理，怎么减少显存占用 #65

Open MathamPollard opened 8 months ago

MathamPollard commented 8 months ago

我通过邮箱获取了vary-llava80k权重，但是3090的24G显存不够用于推理，且无法多卡推理，请问怎么多卡推理或者减少显存占用？或者有更小的vary模型吗？