fartashf / vsepp

PyTorch Code for the paper "VSE++: Improving Visual-Semantic Embeddings with Hard Negatives"
Apache License 2.0
488 stars 125 forks source link

problem in evaluation #9

Closed kevin8new closed 6 years ago

kevin8new commented 6 years ago

I have some problem in evaluation, and need some help !

I can run the evaluation of VSE++(1C) following the instruction in the README, and it gives out the result of 1k test images.

When I run the evaluation on my own trained model on VSE++(RC), it by default test on 5k images like below:

Computing results... Test: [0/196] Le 62.9998 (62.9998) Time 3.004 (0.000) Test: [10/196] Le 63.0371 (64.4791) Time 0.263 (0.000) Test: [20/196] Le 64.0825 (64.2898) Time 0.259 (0.000) Test: [30/196] Le 64.6391 (64.2518) Time 0.263 (0.000) Test: [40/196] Le 64.9525 (64.1494) Time 0.260 (0.000) Test: [50/196] Le 61.6837 (64.0605) Time 0.263 (0.000) Test: [60/196] Le 62.2307 (64.0485) Time 0.262 (0.000) Test: [70/196] Le 62.4721 (63.8480) Time 0.273 (0.000) Test: [80/196] Le 64.6234 (63.8591) Time 0.268 (0.000) Test: [90/196] Le 62.8796 (63.8349) Time 0.261 (0.000) Test: [100/196] Le 61.5295 (63.8687) Time 0.262 (0.000) Test: [110/196] Le 63.7632 (63.8381) Time 0.260 (0.000) Test: [120/196] Le 66.5532 (63.8105) Time 0.263 (0.000) Test: [130/196] Le 64.4752 (63.8554) Time 0.262 (0.000) Test: [140/196] Le 67.8941 (63.8907) Time 0.261 (0.000) Test: [150/196] Le 61.7584 (63.8451) Time 0.264 (0.000) Test: [160/196] Le 66.8306 (63.8695) Time 0.264 (0.000) Test: [170/196] Le 62.1828 (63.8233) Time 0.266 (0.000) Test: [180/196] Le 64.8306 (63.7709) Time 0.263 (0.000) Test: [190/196] Le 59.2744 (63.8022) Time 0.264 (0.000) Images: 5000, Captions: 25000

How can I use 1k test images to test rather than 5k?