TheLastBen / fast-stable-diffusion

fast-stable-diffusion + DreamBooth
MIT License
7.41k stars 1.27k forks source link

V2 generate noise instead of images. #751

Open ozeron opened 1 year ago

ozeron commented 1 year ago

First of all, thank you for your work, you are amazing. πŸ™‡β€β™‚οΈ πŸ™‡β€β™‚οΈ πŸ™‡β€β™‚οΈ

I tried from scratch V2 notebook a few times and it consistently generate only noise, I tried a few prompts different variations of sampler, number of training. It generates noisy images, which are far from what I prompt.

I tried a picture of person with negative prompt/and without (((stock photo))), ((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), ((ugly)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), out of frame, ugly, extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), grayscale, black and white, (((bad composition))), ((((stock photo)))) 00000-705790541-a picture of p

Screenshot 2022-11-29 at 20 12 07 Screenshot 2022-11-29 at 20 17 06

Tried various sampling steps:

Any suggestions?

P.S. wiped everything. Remove sd folder and got same results:

Screenshot 2022-11-29 at 20 32 27
TheLastBen commented 1 year ago

Hi, did you delete/rename the folder sd recently ? if you didn't you should, and always use the colab from the link to avoid being out of date : https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast_stable_diffusion_AUTOMATIC1111.ipynb

Topzie commented 1 year ago

We've all been there, just change the resolution to the trained model 768 x 768 (or higher)

Ted-Teddy commented 1 year ago

I had the same problem with the V2 colab version for free colab users. What worked for me is: Select under the point "Start stable-diffusion -> Model_Version:" the model V2-768 instead of the V2-512 (with the V2-512 comes only noise, no matter what you set in the Web-UI). After you have executed the point and started the web UI, set the resolution to 768x768 and everything works normally without noise.

acjbizar commented 1 year ago

I had the same problem with the V2 colab version for free colab users. What worked for me is: Select under the point "Start stable-diffusion -> Model_Version:" the model V2-768 instead of the V2-512 (with the V2-512 comes only noise, no matter what you set in the Web-UI). After you have executed the point and started the web UI, set the resolution to 768x768 and everything works normally without noise.

That fixed it for me, thanks! However, I still do get noise with some settings in the Web UI. Not sure which specifically are triggering this.

orshi commented 12 months ago

Have u fixed the issue?

RRooyyCChheenn commented 3 months ago

i started to change the config file from v2-inference.yaml to v2-inference-v.yaml , then fixed this problem. hope it can help you