Open Misterkiwi500 opened 10 months ago
@AUTOMATIC1111
See the same bug in Google Colab.
@ctawong yeah, How to fix?
Can one of you confirm if launching with --disable-model-loading-ram-optimization
resolves this issue?
@catboxanon wait, First, I have to prepare something and then test it.
@catboxanon that worked very well! I don't see any errors or bugs, otherwise there are no errors. Thanks!
@catboxanon The funny story is that I have two accounts on github lol ^^
Can one of you confirm if launching with
--disable-model-loading-ram-optimization
resolves this issue?
This was the workaround for me too for using a safetensors model generated using this script, at least on my AMD RX 6800 setup :)
The above fix worked for me as well. Thank you!
I wanted to report that adding --disable-model-loading-ram-optimization
to launch did not resolve my issue.
This crept up the other day when I first started learning how to use Supermerger and LoRa merging. Restarting the server sometimes helps it, waiting till server is fully booted before opening browser. It seems as though when attempting to merge a LoRa into a checkpoint, I have to shut everything down first. Seems hit or miss as to whether the issue will present itself during a specific run, but it will lean more towards being an issue than working flawlessly.
I don't know to what length of time this may have been an issue because I just started merging stuff yesterday.
If it's only occurring when using Supermerger, then that's an extension issue, not a webui issue.
If it's only occurring when using Supermerger, then that's an extension issue, not a webui issue.
It does also occur repeatedly after attempting merges, even when trying to generate images using other non-merged checkpoints. It does occasionally happen when using merges that did complete successfully. I have not tried these scenarios after applying the previous workaround. I will report again if I can reproduce.
When inpainting, If I use a batch count > 1 , I get the error. the --disable-model-loading-ram-optimization doesn't seem to solve it. Any tip?
similar issue: https://stackoverflow.com/questions/77547377/notimplementederror-cannot-copy-out-of-meta-tensor-no-data
Marwan Rabi says: "By searching I found that: GPU is the problem This error is caused by Accelerate auto-offloading weights to either the CPU or disk because of insufficient memory on the GPU."
I also found the same error when I upgraded from 1.61 to 1.70
While copying the parameter named "first_stage_model.decoder.up.3.block.2.norm1.bias", whose dimensions in the model are torch.Size([512]) and whose dimensions in the checkpoint are torch.Size([512]), an exception occurred : ('Cannot copy out of meta tensor; no data!',).
While copying the parameter named "first_stage_model.decoder.up.3.block.2.norm2.weight", whose dimensions in the model are torch.Size([512]) and whose dimensions in the checkpoint are torch.Size([512]), an exception occurred : ('Cannot copy out of meta tensor; no data!',).
While copying the parameter named "first_stage_model.decoder.up.3.block.2.norm2.bias", whose dimensions in the model are torch.Size([512]) and whose dimensions in the checkpoint are torch.Size([512]), an exception occurred : ('Cannot copy out of meta tensor; no data!',).
While copying the parameter named "first_stage_model.decoder.norm_out.weight", whose dimensions in the model are torch.Size([128]) and whose dimensions in the checkpoint are torch.Size([128]), an exception occurred : ('Cannot copy out of meta tensor; no data!',).
While copying the parameter named "first_stage_model.decoder.norm_out.bias", whose dimensions in the model are torch.Size([128]) and whose dimensions in the checkpoint are torch.Size([128]), an exception occurred : ('Cannot copy out of meta tensor; no data!',).
It means you are running out of vram, or at least should be because of that if everything else should be working
Is there an existing issue for this?
What happened?
I've already started and the error shows up for me. And of course... I can't generate the image, nothing! and that always depends on what error. and i make google colab, not for my pc. @aut
Steps to reproduce the problem
What should have happened?
the webui can't generate for images and that's why there are lots of errors.
Sysinfo
What browsers do you use to access the UI ?
Google Chrome
Console logs
Additional information
No response