Jingkang50 / OpenOOD

Benchmarking Generalized Out-of-Distribution Detection
MIT License
858 stars 108 forks source link

Can't find the file of SEM #222

Closed keao23 closed 8 months ago

keao23 commented 9 months ago

Hi! I have a question. Which postprocessor file corresponds to the implementation of the method SEM?

Jingkang50 commented 9 months ago

Please check here

keao23 commented 9 months ago

Thank you for your reply!

jS5t3r commented 6 months ago

Why the imagenet file loads configs/postprocessors/gmm.yml. Here: https://github.com/Jingkang50/OpenOOD/blame/18c6f5174a2f518e2a8e819ffb1cd1914bcf12e0/scripts/ood/sem/imagenet_test_ood_sem.sh#L19

This does not work:

python scripts/eval_ood_imagenet.py \
    --tvs-pretrained \
    --arch vit-b-16 \
    --postprocessor sem \ # or should be ensemble here?
    --save-score --save-csv

There is no sem available. Is sem and ensemble the same?

zjysteven commented 6 months ago

Please check here

@jS5t3r As Jingkang mentioned, the script for sem can be found via that link, where you would see that currently sem is not supported with the newer evaluation api (which is called by eval_ood_imagenet.py in your comment).