LAION-AI / CLIP-based-NSFW-Detector

Other
302 stars 27 forks source link

Annotations for the NSFW test set? #3

Open s4chin opened 2 years ago

s4chin commented 2 years ago

The README mentions that the manually annotated test set is here. I took a look at the test set and it has only the image embeddings. How do I find the labels of the images?

janekm commented 1 year ago

Same. This is a big issue given the importance that this test set has. As it stands it is not documented how to validate the test set so it is effectively a hidden test set.

HCA97 commented 1 year ago

Hi, it looks like the dataset for testing and training collected using https://github.com/alex000kim/nsfw_data_scraper

yangh-zzf-itcast commented 11 months ago

Hi, it looks like the dataset for testing and training collected using https://github.com/alex000kim/nsfw_data_scraper

Hello, can you obtain this dataset?

HCA97 commented 11 months ago

I followed the readme, it took me a couple of hours to download. I used https://github.com/servin/nsfw_data_scraper/tree/main instead of the original one seems like it is more up-to-date. Btw. I downloaded the data a couple of months ago so I am not sure if is it still working though. Additionally, you check on this dataset too https://archive.org/download/NudeNet_classifier_dataset_v1

yangh-zzf-itcast commented 11 months ago

I followed the readme, it took me a couple of hours to download. I used https://github.com/servin/nsfw_data_scraper/tree/main instead of the original one seems like it is more up-to-date. Btw. I downloaded the data a couple of months ago so I am not sure if is it still working though. Additionally, you check on this dataset too https://archive.org/download/NudeNet_classifier_dataset_v1

Thanks for your reply!By the way, can you share the dataset https://github.com/servin/nsfw_data_scraper/tree/main you have already downloaded?

HCA97 commented 11 months ago

Hi, unfortunately, I deleted the dataset I needed some space for other projects. Anyway even if I had the dataset I wouldn't feel comfortable uploading GBs of NSFW content to Kaggle or Huggingface :smile: