search

intersun / LightningDOT

source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
https://arxiv.org/abs/2103.08784
MIT License
73 stars 9 forks source link

Demo Notebook #6

Open shivangibithel opened 3 years ago

shivangibithel commented 3 years ago

Hi @intersun @ChenRocks

Can you share the data checkpoints used in Image_retriever.ipynb? And if you can share any updated notebook that can be used as a demo to check what actual images are retrieved for a given single query then that will be really helpful.

Thanks

intersun commented 3 years ago

Thanks @shivangibithel for your interests. Actually to successfully run the demo, you need to use the extracted image features as input, which is not available for now.

Please check https://github.com/ChenRocks/UNITER for more details. (FYI, "Unfortunately, we cannot host CC/SBU features due to their large size. Users will need to process them on their own. "). So you need to run BUTD on MSCOCO and Flickr30k yourself, and use them as input.