hkchengrex / Cutie

[CVPR 2024 Highlight] Putting the Object Back Into Video Object Segmentation
https://hkchengrex.com/Cutie/
MIT License
662 stars 66 forks source link

Automated processing script #91

Closed luoshuiyue closed 1 month ago

luoshuiyue commented 1 month ago

Hello, does the code support automatic mask extraction without human interaction, or how can I make simple changes to the code to extract mask based on prompt such as text prompt.

hkchengrex commented 1 month ago

On a high level, we have something like this: https://github.com/hkchengrex/Tracking-Anything-with-DEVA which is quite a complicated pipeline supporting new objects and different base models.

For something simpler like detection at the first frame + propagation, you can start with the scripting demo (by replacing mask with your automatic generation).

hkchengrex commented 1 month ago

Feel free to re-open if there are any updates.