SysCV / sam-pt

SAM-PT: Extending SAM to zero-shot video segmentation with point-based tracking.
https://arxiv.org/abs/2307.01197
Apache License 2.0
950 stars 60 forks source link

Different number of positive points #37

Open Mahdi-Koochali opened 3 months ago

Mahdi-Koochali commented 3 months ago

Hi, Thanks for your work again.

I have two questions about the code.

  1. For the non-interactive demo, passing a different number of positive points for each object is not possible. Is there any way that I can pass the different number of positive points?

  2. The other question is about "mask_n_timestep" which you mentioned here

Can you explain how does it work?

I thought "mask_n_timestep" means the frame number where an object appears in the frame for the first time.

But I experimented on the same sequence and the results were like these:

If we only have three objects in the "Query Points" text file and they all appear in the first frame:

only_3

If we have the same objects in the "Query Points" text file + three other points that appear in the next frames for the first time (Like frames 234, 520, 640)] :

3_add_cell

If we have the same objects in the "Query Points" text file + only one other point that appears in the next frames for the first time (Like frames 234)] :

1_add_point

I don't why there are some random points appear in the first frame although I mentioned the right frame number for them and I followed your format.

Thanks for your answers in advance.