hkchengrex / Cutie

[CVPR 2024 Highlight] Putting the Object Back Into Video Object Segmentation
https://hkchengrex.com/Cutie/
MIT License
691 stars 69 forks source link

Memory settings #40

Closed Zarxrax closed 8 months ago

Zarxrax commented 8 months ago

I was wondering if you could provide an overview of the memory settings on the right side of the gui. While I understand what most of them do at a high level, from a practical standpoint I am not sure when to change them, or if I should change them.

What are some situations where it might be beneficial to increase them? Are higher settings just better if you have a lot of vram? Also, I'm not quite sure what "memory frame every (r)" actually does.

hkchengrex commented 8 months ago

This repo primarily serves as a research project and unfortunately, I currently do not have the capacity to write additional user guides. The meaning of different memory parameters can be found in the paper and previous works (e.g., XMem/STCN/STM).

In general, users can start with the default parameters. Optimal settings are probably data-specific, specifically regarding FPS and the rate of object/scene movement.