ZhendongWang6 / DIRE

[ICCV 2023] Official implementation of the paper: "DIRE for Diffusion-Generated Image Detection"
307 stars 24 forks source link

The results in the paper? #9

Open eecoder-dyf opened 1 year ago

eecoder-dyf commented 1 year ago

I ran test.sh on LSUN-B dataset and its corresponding generated images by ADM, with checkpoint lsun_adm.pth, the output in terminal is:

'lsun_adm:lsun_adm' model testing on...                                                                                                                                                                                                                                                   
lsun_adm:                                                                                                                                                                                                                                                                                 
ACC: 0.89900                                                                                                                                                                                                                                                                              
AP: 0.99890                                                                                                                                                                                                                                                                               
R_ACC: 0.79800                                                                                                                                                                                                                                                                            
F_ACC: 1.00000

Are your results of AP and ACC refer to F_ACC,not including the result of real dataset?

Rapisurazurite commented 1 year ago

I encountered the same issue and also conducted testing on the LSUN dataset in the test/lsun_bedroom/imagenet directory, specifically the 0_real and 1_adm subsets. Here are the results of my test:

lsun_bedroom/imagenet:
ACC: 0.81600
AP: 0.99248
R_ACC: 0.63200
F_ACC: 1.00000

However, I'm unsure about the distinction between test/lsun_bedroom/imagenet and test/lsun_bedroom/lsun_bedroom. Could the author please provide an explanation? Thank you.

RichardSunnyMeng commented 1 year ago

I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the results :

ACC: 1.00000
AP: 1.00000
R_ACC: 1.00000
F_ACC: 1.00000

If convert the images in the "adm" folder into JPG same as issue #11 , I get the results:

ACC: 0.50000
AP: 0.63497
R_ACC: 1.00000
F_ACC: 0.00000
WWQ203 commented 1 year ago

@eecoder-dyf I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the same result as you do.But RichardSunnyMeng(commented on Sep 5) said he got ACC:1 AP:1.Do you know how to get the same result as RichardSunnyMeng did?

RichardSunnyMeng commented 1 year ago

@eecoder-dyf I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the same result as you do.But RichardSunnyMeng(commented on Sep 5) said he got ACC:1 AP:1.Do you know how to get the same result as RichardSunnyMeng did?

The only modification I made was runing the code on cpu because I encountered an error on cuda.

daaiwoni commented 1 year ago

I ran test.sh on LSUN-B dataset and its corresponding generated images by ADM, with checkpoint lsun_adm.pth, the output in terminal is:

'lsun_adm:lsun_adm' model testing on...                                                                                                                                                                                                                                                   
lsun_adm:                                                                                                                                                                                                                                                                                 
ACC: 0.89900                                                                                                                                                                                                                                                                              
AP: 0.99890                                                                                                                                                                                                                                                                               
R_ACC: 0.79800                                                                                                                                                                                                                                                                            
F_ACC: 1.00000

Are your results of AP and ACC refer to F_ACC,not including the result of real dataset?

I got the same result. ACC: 0.89900 AP: 0.99890 R_ACC: 0.79800 F_ACC: 1.00000 I used "dire\test\lsun_bedroom\lsun_bedroom\adm" and "dire\test\lsun_bedroom\lsun_bedroom\real" as dataset , and the used model is "checkpoints/lsun_adm.pth".