search

SilvioGiancola / TrackingNet-devkit

Development kit for TrackingNet
https://tracking-net.org/
170 stars 32 forks source link

how to use the evaluation server？ #22

Closed Chenzixi1 closed 3 years ago

Chenzixi1 commented 3 years ago

Thanks for your work.

I wonder how to use evalation server.

In evalution, there is no way to eval but the link to this github, I am very confused.

Or, can we get the GT of TestDataset?

SilvioGiancola commented 3 years ago

Hi @Chenzixi1,

We segregated the ground truth for the test set for participant to avoid overfitting on it, so you won't have access to it. Once you have trained a model (train/val as you like) you can infer your results and send them to our evaluation server.

See here for details on how to evaluate your predictions, in particular metrics.py that provides you with the evaluation function currently used in EvalAI. You can zip any inference results and with any GT to evaluate its performances on any list of tracking sequence.