ZhendongWang6 / DIRE

[ICCV 2023] Official implementation of the paper: "DIRE for Diffusion-Generated Image Detection"
266 stars 21 forks source link

After actual testing, the images generated by stable diffusion cannot be recognized. #23

Open TheBloodthirster opened 8 months ago

TheBloodthirster commented 8 months ago

image give the samples from test result , which predict score are all 0.0000

TheBloodthirster commented 8 months ago

give one more all predict 0.0000 test result image

lukovnikov commented 5 months ago

Can you please be more specific about what exactly you did? What model were these generated with, how did you save these images? Could you try saving them as .jpg and try again?

aditipanda commented 2 months ago

@lukovnikov

I ran compute_dire for CelebAHQ images - both Recons and DIRE, and strangely enough, the celebahqsdv2 ckpt classifies all these real images as fake!

lsun-adm, lsun_iddpm and lsun_stylegan correctly classify real images but not the other three ckpts. Very strange as the celebahq checkpoint is trained on celebahq real dataset I presume?

aditipanda commented 2 months ago

@lukovnikov

I ran compute_dire for CelebAHQ images - both Recons and DIRE, and strangely enough, the celebahqsdv2 ckpt classifies all these real images as fake!

lsun-adm, lsun_iddpm and lsun_stylegan correctly classify real images but not the other three ckpts. Very strange as the celebahq checkpoint is trained on celebahq real dataset I presume?

You have to run with dire versions and not original/raw images. See guided-diffusion/compute_dire.sh for more. I could get almost same results as Table 3 of the paper.