deep-floyd / IF

Other
7.63k stars 495 forks source link

What is the FID-30K test subset? #131

Open songtianhui opened 1 year ago

songtianhui commented 1 year ago

Hi, thanks for your awesome work! I want to know what is the FID-30K from MSCOCO val set, since as the paper says that the 30k samples are drawn randomly. Are the evaluation result is aligned with the original Imagen paper?

Mywifi commented 1 year ago

Hi, thanks for your awesome work! I want to know what is the FID-30K from MSCOCO val set, since as the paper says that the 30k samples are drawn randomly. Are the evaluation result is aligned with the original Imagen paper?

COCO FID-30K is a metric used to evaluate the quality of face generative models. It stands for:

COCO Face Identification at 30K

It measures how different 30,000 generated faces from a generative model are from 30,000 real human faces. https://cocodataset.org/#home

songtianhui commented 1 year ago

As far as I know, COCO FID-30k is MSCOCO val2014. I think that current diffusion models are not designed and tested fro face identification task?