search

MasterBin-IIAU / UNINEXT

[CVPR'23] Universal Instance Perception as Object Discovery and Retrieval
MIT License
1.5k stars 158 forks source link

Ideas for arbitrary video testing of MOT/MOTS #35

Open ajdroid opened 1 year ago

ajdroid commented 1 year ago

Hi, I've looked at #8 and #12 as well as the codebase and I'm trying to come up with a script that can run the UNINEXT models on the MOT/MOTS task on any arbitrary video as input. It looks like the main constraint is that I will have to make a custom evaluator and dataloader for something like this. Any ideas on how to approach this or any alternative approaches?

Mainly, it looks like the data loader currently uses the DatasetCatalog but we should use something else?

ajdroid commented 1 year ago

I see that there is a UNINEXTPredictor but it seems to work only for object level tasks. I am looking into extending it for video level tasks by looking at uninext_vid but any help in terms of approaches is appreciated!