search

hendrycks / outlier-exposure

Deep Anomaly Detection with Outlier Exposure (ICLR 2019)
Apache License 2.0
541 stars 107 forks source link

Removing duplicates #15

Closed sesmae closed 3 years ago

sesmae commented 3 years ago

Hi,

In your paper, you mention that 'We remove all examples of 80 Million Tiny Images which appear in the CIFAR datasets'. I was trying to download 80 million Tinyimagenet but apparantly it is not available anymore. Instead, I am trying to use imagenet32X32. Is there an effective way to remove duplicates of cifar10 or cifar100 from imagenet32X32 ?

hendrycks commented 3 years ago

A mirror of 80 Million Tiny Images is here: http://www.archive.org/download/80-million-tiny-images-2-of-2/tiny_images.bin

sesmae commented 3 years ago

Thank you for the link and quick response. How about removing the duplicates of cifar from it?

hongxin001 commented 2 years ago

Hello, @sesmae Do you solve the problem? I also encounter that.