Open RuaYiii opened 1 year ago
Have the same issue.
Out of memory error on GPU 0. Cannot allocate 558.000000MB memory on GPU 0, 7.999695GB memory has been allocated and available memory is only 0.000000B.
It's the only program running on gpu.
Same here with 16 GB GPU (RTX3080), throws this error...
Same here with 16 GB GPU
同问,我用的云服务器 开启 use_DAIN 也是不行
i have the same issue,i used 12G 3060,how can 1 resolve the issue
6g的显存完全可以胜任推理任务,但是加了DAIN后就炸显存了,换了10G的机子还是炸 想知道作者用的配置是多大显存进行推理的?
6g of video memory is fully capable of reasoning tasks, but after the addition of DAIN will blow up the memory, replaced by a 10G machine or fried I would like to know how much video memory the author used for the configuration for reasoning?