search

votchallenge / toolkit

The official VOT Challenge evaluation and analysis toolkit
http://www.votchallenge.net/
GNU General Public License v3.0
153 stars 43 forks source link

About VOT2022 submit SIF container to run vot evaluation command #57

Closed davidyang180 closed 2 years ago

davidyang180 commented 2 years ago

Hi! We learned that the source code submission of VOT2022 uses the singularity container, but because the VOT toolkit will write the track results in the file system during evaluation and analysis, and the sif container is a read-only system, so the sif container cannot be used for run. We found that using the singularity command: singularity build --sandbox --fakeroot xxx/ xxx.sif

Singularity>vot evaluate --workspace <workspace-path> <tracker-name>
Singularity>vot analysis --workspace <workspace-path> <tracker-name> --format json

To convert the sif container into a writable sanbox can run normally. Does the official approve this submission method?

davidyang180 commented 2 years ago

Sorry, didn't notice that the above shows the commit .def file.