Jingkang50 / OpenOOD

Benchmarking Generalized Out-of-Distribution Detection
MIT License
858 stars 108 forks source link

Include ROBIN dataset #131

Closed khawar-islam closed 1 year ago

khawar-islam commented 1 year ago

Dear @Jingkang50

Are you planning to include Robin dataset presented at ECCV 2022?

Jingkang50 commented 1 year ago

Dear @khawar-islam I am afraid not. Robin is a dataset for OOD generalization, which aims to keep a high accuracy for samples from various domains. But our OpenOOD here is for OOD detection, aiming to give samples that not in training classes, with a low confidence score. Actually, OOD detection is to detect samples that OOD generalization cannot generalize, that is, samples not belong to any one of the training classes. Therefore, Robin is not quite within our scope.

khawar-islam commented 1 year ago

Dear @Jingkang50

Thank you, I understand.