nipponjo / deepfillv2-pytorch

A PyTorch reimplementation of the paper Free-Form Image Inpainting with Gated Convolution (DeepFill v2) (https://arxiv.org/abs/1806.03589)
140 stars 32 forks source link

The object does not get removed but gets filled with noise on running test.py #25

Open HG2407 opened 10 months ago

HG2407 commented 10 months ago

same as the title. I have tried all the models but the result is same. I am uploading some pictures to get the idea inpainting_output inpainting_output1

HG2407 commented 10 months ago

Woah!!! Fast ! back to topic, I haven't tried ui because I am using a cloud machine for testing and it can't load the models in the ui due to some reason. But I have a mask image with background removed and the image to inpaint. I am getting weird noises. Could It be due to the weights being corrupted or something ?

these are some more examples:

chair_mask-removebg image inpainting_output

HG2407 commented 10 months ago

@nipponjo I'll try running it on a local machine with the ui to find out if it solves the issue. But please let me know if you find what might be causing the issue. Because if it works then it'll be epic!

nipponjo commented 10 months ago

Using your image and mask I get this output when running test.py. That noise looks very unusual. With random weights, the model would fill with grey color. out1

HG2407 commented 10 months ago

I downloaded the fine tuned weights and used the pt places2 weight for inpainting

HG2407 commented 10 months ago

@nipponjo can you please provide the weights again ? I might be using the wrong or corrupted weights

nipponjo commented 10 months ago

I just tested the weights from the link in the Readme and didn't have any problems with it https://drive.google.com/u/0/uc?id=1L63oBNVgz7xSb_3hGbUdkYW1IuRgMkCa&export=download

HG2407 commented 10 months ago

@nipponjo any last ideas on what could be causing the issue ? because I am not able to resolve it and I have re-cloned the directory. This is exactly what I am looking for and it would be such a waste for it to be not able to work. I really hope it works, can you think about what might be causing these issues ?