Open wenxichen2746 opened 1 month ago
This is an edge case of the new evaluator where the config passed to the postprocessor doesn't really have config.network
(this is why you see the error 'NoneType' object has no attribute 'name'
). A quick fix would be to just comment out the assertion in your site-packages/openood/postprocessors/ensemble_postprocessor.py
# assert self.postprocessor_args.network_name == \
# self.config.network.name,\
# 'checkpoint network type and model type do not align!'
Also note that to get the ensemble postprocessor working correctly you will need to modify the configs/postprocessors/ensemble.yml
according to your case.
Thank you for getting back to me! That feedback is really helpful.
Also, I wonder if the trained ensemble models should be downloaded through:
sh ./scripts/download/dowanload.sh
It seems that there is a permission issue with the shared document:
/.local/lib/python3.8/site-packages/gdown/download.py", line 267, in download url = get_url_from_gdrive_confirmation(res.text) File "/home/aims-exxact/.local/lib/python3.8/site-packages/gdown/download.py", line 55, in get_url_from_gdrive_confirmation raise FileURLRetrievalError( gdown.exceptions.FileURLRetrievalError: Cannot retrieve the public link of the file. You may need to change the permission to 'Anyone with the link', or have had many accesses. Check FAQ in https://github.com/wkentaro/gdown?tab=readme-ov-file#faq.
I wonder if you could kindly look into this. Again, I would greatly appreciate your help. I am trying to test my OOD detection algorithm under this framework, and the ensemble really serves as a key baseline that I want to reproduce.
Best regards,
@wenxichen2746 Try upgrade gdown by python -m pip install --upgrade gdown
. I just tested locally and saw the same error, which got fixed after upgrading gdown.
Dear authors,
Amazing works on the benchmark testing of OOD detections. Please kindly suggest on how to test ensemble method using openood. I can see ensemble method is defined among postprocessors, but the string 'ensemble' can not be passed to Evaluator directly as its config is not loaded somehow.
The specific lines of code I am running is as follow:
Your help would be greatly appreciated, thanks! Best.