search

mala-lab / NegPrompt

The official implementation of CVPR 24' Paper "Learning Transferable Negative Prompts for Out-of-Distribution Detection"
MIT License
22 stars 2 forks source link

How to reproduce the results on Tab.2 Prompt learning methods #1

Open mmmeya opened 3 months ago

mmmeya commented 3 months ago

Dear authors,

I followed your given command "python ./scripts/train_test_ood.py", but it cannot reproduce the results.

Compared with the paper, I found some differences between the code and the paper:

  1. code "open_set_method = 'MSP' open_score = 'OE'". but in paper "open_set_method = 'OE'" = open_score = 'MSP'"
  2. in the paper, you said that there are two stages for training. what is the stage 3. what's the difference between stage 2 and 3.
  3. what's the number of epochs for stage 2 and 3. In the code, you set 100 for stage 3. But in the paper, it's 10 for stage 2.

Could you give us an updated command for reproducing the result?

I look forward to your reply. Thanks.

arbiterleo commented 2 months ago

I have met the same problem as him. Besides, I also disocver that the code require more then 48G Vram to excute, but in the paper it says the code can be run with only one V100(32G). I wonder does any one meet the same problem with me. Any update on this will be good, thanks!

myhakureimu commented 1 month ago

May I ask if you met the following issue when running the script train_test_ood.py?

However, POMP and POMP_k are not defined in the code.

myhakureimu commented 1 month ago

Dear authors,

I followed your given command "python ./scripts/train_test_ood.py", but it cannot reproduce the results.

Compared with the paper, I found some differences between the code and the paper:

  1. code "open_set_method = 'MSP' open_score = 'OE'". but in paper "open_set_method = 'OE'" = open_score = 'MSP'"
  2. in the paper, you said that there are two stages for training. what is the stage 3. what's the difference between stage 2 and 3.
  3. what's the number of epochs for stage 2 and 3. In the code, you set 100 for stage 3. But in the paper, it's 10 for stage 2.

Could you give us an updated command for reproducing the result?

I look forward to your reply. Thanks.

May I ask whether you met the issue of "KeyError: 'CSC'" when running their code with "python ./scripts/train_test_ood.py"?