Pter61 / context-i2w

Context-I2W: Mapping Images to Context-dependent words for Accurate Zero-Shot Composed Image Retrieval [AAAI 2024 Oral]
Apache License 2.0
39 stars 0 forks source link

[Q]difference between the "cirr" option and the "cirr_test" option in the eval settings #6

Closed YuetianW closed 7 months ago

YuetianW commented 7 months ago

Hello, I would like to ask what is the difference between the "cirr" option and the "cirr_test" option in the eval settings? Thanks again for your excellent work!💕

Pter61 commented 7 months ago

Thank you for your interest in my work! The "cirr" option means we evaluate on offline validation dataset, while the "cirr_test" option means we output the test datasets' results and send them to the online test on the CIRR benchmark for evaluation. The results of the "cirr_test" option are reported in our paper.

YuetianW commented 7 months ago

Got it! Thanks for your reply.✨