uvavision / RerankingTransformer

[ICCV 2021] Instance-level Image Retrieval using Reranking Transformers
GNU General Public License v3.0
124 stars 23 forks source link

Test on other dataset #18

Closed kaiyi98 closed 3 weeks ago

kaiyi98 commented 10 months ago

Hi! I'm testing RRT on the Oxford RobotCar dataset, using daytime images as the database and nighttime images as the query, but the retrieval results are very poor. Is this because the RRT network is not trained in this cross day/night scenario? Also, to what order of magnitude does this cross entropy loss function based loss eventually converge? Thanks!

fwtan commented 10 months ago

Hi! I'm testing RRT on the Oxford RobotCar dataset, using daytime images as the database and nighttime images as the query, but the retrieval results are very poor. Is this because the RRT network is not trained in this cross day/night scenario? Also, to what order of magnitude does this cross entropy loss function based loss eventually converge? Thanks!

Hi Kaiyi98,

The released model was pretrained on landmark datasets. It won't work out-of-the-box for traffic/driving benmarks, e.g. Oxford RobotCar. To adapt RRT for such scenes, you may consider further re-training/fine-tuning the model. We provide an example training log file in https://github.com/uvavision/RerankingTransformer/tree/main/RRT_GLD/logs/r50_gldv1_log_retrained, which tracked the training loss of the model.

fwtan commented 3 weeks ago

Feel free to re-open the issue if you have any further questions.