downeslab / marigold

Marigold: Zebrafish pose tracking made easier
https://downeslab.github.io/marigold/
GNU General Public License v3.0
0 stars 0 forks source link

efficient labelling? #4

Open vigji opened 1 month ago

vigji commented 1 month ago

I tried to do some manual labelling of frames from converted videos.

From what I could do myself, the labelling procedure is a bit painful, especially in the case where no arena specification is required. For every frame, one needs to: 1) Navigate to a new frame in the movie 2) click "Start new label" 3) select "keypoints" instead of Arena 4) click on the keypoints 5) go back and click "done" 6) repeat

This is not terrible but requires a lot of overhead mouse movements, with some minimal streamlining or hotkeys options I feel that labelling time could be sped up by an order of magnitude, eg: 1) navigate to a new frame in the movie -> this automatically opens the mask for inputting keypoints 2)the "arena" option never changes unless one wants to redefine it (I actually expect the arena never to be changing over time no?) 3) instead of confirming, just navigating to a new frame should save the state of the previous frame labelling

I think that labelling could be 5-10x faster with something like that!

If I missed shortcuts and hotkeys sorry for the comment and please let me know.

downeslab commented 1 month ago

Thanks for the great feedback!

Changing the arena makes a lot of sense in the context of labeling fish in multiwell plates, where it may be necessary to label fish from more than one well. I agree with you that changing the arena may be largely redundant for recordings which only contain a single arena (although even then I'd argue that randomizing the arena a bit during labeling could be beneficial for training).

Overall, I agree with you that the labeling workflow could be more streamlined. We'll keep your suggestions in mind for future updates as time permits!