DeepLabCut / DeepLabCut-live

SDK for running DeepLabCut on a live video stream
https://elifesciences.org/articles/61909
Other
187 stars 49 forks source link

Cropping bug #104

Open tomsains opened 12 months ago

tomsains commented 12 months ago

I have noticed that there is an issue with tracking near the edge of the frames. When displaying keypoints it looks like they become clipped on one side of the video frame. This appears to be not just a display issue as the saved keypoints are also clipped. I managed to temporarily resolve this issue by cropping to a different part of the camera sensor which suggests that the issue may be related to the cropping in the camera processor vs the cropping parameters in the DLC processor?

Camera: Imaging source System: Windows

MMathisLab commented 12 months ago

@n-poulsen can you take a look at this asap, it's a blocker for lab work.

sneakers-the-rat commented 12 months ago

ignore me if this is an internal lab issue that y'all are handling, but seeing if i can be useful if not.

@tomsains could u post a MRE, or at least the project config/calls made to instantiate objects/do prediction if the data can't be posted?

edit: I can see some potentially interesting interactions between static and dynamic cropping if you're using both. but yes would be happy 2 help debug with more info on how to evoke the bug :)