ZhendongWang6 / DIRE

[ICCV 2023] Official implementation of the paper: "DIRE for Diffusion-Generated Image Detection"
306 stars 24 forks source link

About AP #16

Open magneto0124 opened 1 year ago

magneto0124 commented 1 year ago

I used lsun_bed.pth and test on the dire testset lsun_bedroom/lsun_bedroom/adm, 3 accuracy rates are okay but the ap is very low, far less than 1.0. ACC: 1.00000 AP: 0.30710 R_ACC: 1.00000 F_ACC: 1.00000 I don't know how this happened. Has anyone encountered similar problem?

WWQ203 commented 1 year ago

@magneto0124 I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the results: ACC:0.899 AP:0.9989 R_ACC:0.798 F_ACC:1.000 I don't know how this happened,either.

Rapisurazurite commented 1 year ago

@magneto0124 I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the results: ACC:0.899 AP:0.9989 R_ACC:0.798 F_ACC:1.000 I don't know how this happened,either.

same

baiqingookii commented 1 year ago

But I got the same results with the author. lsun_adm: ACC: 1.00000 AP: 1.00000 R_ACC: 1.00000 F_ACC: 1.00000

daaiwoni commented 1 year ago

@magneto0124 I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the results: ACC:0.899 AP:0.9989 R_ACC:0.798 F_ACC:1.000 I don't know how this happened,either.

same I got the same result. ACC: 0.89900 AP: 0.99890 R_ACC: 0.79800 F_ACC: 1.00000 I used "dire\test\lsun_bedroom\lsun_bedroom\adm" and "dire\test\lsun_bedroom\lsun_bedroom\real" as dataset , and the used model is "checkpoints/lsun_adm.pth".

daaiwoni commented 1 year ago

@magneto0124 I run test.py on dire/test/lsun_bedroom/lsun_bedroom using lsun_adm.pth and get the results: ACC:0.899 AP:0.9989 R_ACC:0.798 F_ACC:1.000 I don't know how this happened,either.

Same Result

daaiwoni commented 1 year ago

But I got the same results with the author. lsun_adm: ACC: 1.00000 AP: 1.00000 R_ACC: 1.00000 F_ACC: 1.00000

Which datasets did you use to test? There is "adm" and "real" in "dire\test\lsun_bedroom\lsun_bedroom","dire\test\lsun_bedroom\imagenet" and "dire\test\imagenet\lsun_bedroom". I don't know which pair of real and adm dataset should be used to do lsun_adm test.