inpainting with arbitrary size

[YuQiao0303]

Hi authors, thank you for this amazing work!

I try to inpaint an image of arbitrary size with random mask. Here's the command I use: cd DDNM/hq_demo python main.py --resize_y --config confs/inet256.yml --path_y data/datasets/gts/inet256/orange.png --class 950 --deg "inpainting" --scale 4 -i orange_cond_inpainting

However it raises error as: NotImplementedError: degradation type not supported

Any suggestions? Thank you!

[wyhuai]

Maybe try to change "--scale 4" to "--scale 1"?

[YuQiao0303]

Maybe try to change "--scale 4" to "--scale 1"?

Thank you so much! I've figured it out.

1. As you say, change --'scale 4' to '--scale 1'.

2. And then, in hq_dmeo/guided_diffusion/gaussian_diffusion.py, add the following configuration for inpainting:

                       # normal DDNM sampling
                       if t_cur < t_last:  
                           with th.no_grad():
                               if model_kwargs['deg']=='inpainting': # add this
                                   A = lambda z: z*mask[:,:,h_l:h_r,w_l:w_r]
                                   Ap = A
                                   A_temp = A
                                   model_kwargs['A'] = A
                                   model_kwargs['Ap'] = Ap
                               image_before_step = image_after_step.clone()
                               out = self.p_sample( 
                                   model,
                                   image_after_step,
                                   t_last_t,
                                   clip_denoised=clip_denoised,
                                   denoised_fn=denoised_fn,
                                   cond_fn=cond_fn,
                                   model_kwargs=model_kwargs,
                                   conf=conf,
                                   x0_t=x0_t
                               )

3. You may also want to change elif model_kwargs['deg']=='inpainting' and conf.name=='face256' into elif model_kwargs['deg']=='inpainting': for inpainting other things than faces

4. Finally, make sure you upload a mask with the same size as the input image:

   mask = model_kwargs.get('gt_keep_mask') # It should be the same size as GT: [1,3,desired_h,desired_w],torch.float32, values are 0 or 1