Artanisax / Six-CD

Six-CD: Benchmarking Concept Removals for Benign Text-to-image Diffusion Models
MIT License
5 stars 0 forks source link

500 benign prompts from LAION #1

Closed KevinLight831 closed 1 week ago

KevinLight831 commented 1 week ago

Did the author forget to release the subset with 500 benign prompts from LAION for the out-of-prompt CLIP score?

Artanisax commented 1 week ago

Thanks for the reminder. We didn't release them since one can sample benign prompts from the original LAION dataset to achieve a similar result. Now we've put them under Datasets directory.

KevinLight831 commented 1 week ago

Thank you for the reply. However, the column "evaluation_seed" of this benign prompt csv file is missing. is the same specific "evaluation_seed" used?

Artanisax commented 1 week ago

Yes, the same evaluation seeds are applied to all methods. And they are in the last (third) column of the .csv file.