Open jong372 opened 3 years ago
I speak only as a reader of the publication, the authors would be able to give a more informed answer:
xm
and ym
while training for segmentation here and hereSpatialEmbedding
model used by the authors, which is inspired from the work of Neven et al but in principle, you could use any segmentation approach as the first step. The next step would be training a model to associate these segmentations for which you would need to train the PointTrack model.Let me know if there are more questions :+1:
I speak only as a reader of the publication, the authors would be able to give a more informed answer:
- It should be possible to track on custom datasets.
- Different image resolution would also be possible. For the resolution specified (1296*972) , I think it would be fine. But for larger resolutions, you may have to adjust the
xm
andym
while training for segmentation here and here- To train on a custom dataset, first you would need to train a segmentation model - this could be the
SpatialEmbedding
model used by the authors, which is inspired from the work of Neven et al but in principle, you could use any segmentation approach as the first step. The next step would be training a model to associate these segmentations for which you would need to train the PointTrack model.- Yes, basically you need some segmentation approach before training PointTrack - those could also be generated in a non-learnt way if your objects are quite regularly shaped
- Prior to training PointTrack, the authors create a dictionary where they save properties such as global position of an expanded view of each object in an image, the image crop, the label crop etc. This allows them to query these crops later during training and sample points from each object - this is related to the training scheme which the authors suggest in the publication.
Let me know if there are more questions +1
Hi, do you have a way to visualize the tracking results?Thank you.
First of all, thanks for your major contributions to the multi object tracking and segmentation! I would like to apply PointTrack on a custom dataset. Nevertheless, I have some questions related to the implementation of it.
Thanks in advance!