search

chenfei-wu / TaskMatrix

Other
34.52k stars 3.32k forks source link

CUDA out of memory #59

Open marvelmaster opened 1 year ago

marvelmaster commented 1 year ago

CUDA out of memory. Tried to allocate 86.00 MiB (GPU 0; 24.00 GiB total capacity; 22.99 GiB already allocated; 0 bytes free; 23.20 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Want to use 1xrtx3090 what can i do?

powderblock commented 1 year ago

Please see issue #31

You need to delete some of the tools from self.tools

K-tang-mkv commented 1 year ago

I already implement the Google Colab version and I only choose two models T2I and ImageCaption, everything is fine, you can try it on my Colab notebook, checkout this https://github.com/K-tang-mkv/visual-chatgpt-googlecolab