nkv123
commented
2 years ago From what I see
allocate 128.00 MiB can not be taken from free space is 15.75 MiB. so the "RuntimeError: CUDA out of memory."
since 128>15.75.
PyTorch wants to take 14.88 GiB.
Some user programs like web browser and graphical environment do take some of GPU memory.
All programs on your PC want to take have taken 14.78 GiB/15.90 GiB.
I do not know how but try using a smaller model size.
Alternative is to go with CPU and RAM memory if its bigger then GPU memory.
Apologies for rubbish formatting, but Github's code insert is broken.
Using Pixray Pixeldraw, with the settings as they come, aside from: aspect: square drawer: vqgan
` /content/pixray/vqgan.py in load_model(self, settings, device) 156 self.e_dim = model.quantize.e_dim 157 self.n_toks = model.quantize.n_e --> 158 self.z_min = model.quantize.embedding.weight.min(dim=0).values[None, :, None, None] 159 self.z_max = model.quantize.embedding.weight.max(dim=0).values[None, :, None, None] 160
RuntimeError: CUDA out of memory. Tried to allocate 128.00 MiB (GPU 0; 15.90 GiB total capacity; 14.78 GiB already allocated; 15.75 MiB free; 14.88 GiB reserved in total by PyTorch) `
Using GPU on Colab Pro (again github code insert doesn't work):
+-----------------------------------------------------------------------------+ | NVIDIA-SMI 495.44 Driver Version: 460.32.03 CUDA Version: 11.2 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 Tesla P100-PCIE... Off | 00000000:00:04.0 Off | 0 | | N/A 42C P0 32W / 250W | 16265MiB / 16280MiB | 0% Default | | | | N/A | +-------------------------------+----------------------+----------------------+