Some models are shifting after temporal_optimize enabled

Arthur151 / ROMP

Monocular, One-stage, Regression of Multiple 3D People and their 3D positions & trajectories in camera & global coordinates. ROMP[ICCV21], BEV[CVPR22], TRACE[CVPR2023]

https://www.yusun.work/

Apache License 2.0

1.36k stars 231 forks source link

Some models are shifting after temporal_optimize enabled #306

Open sylyt62 opened 2 years ago

sylyt62 commented 2 years ago

I'm using bev to infer a video. After adding -t -sc 5.0 when inferring a video, I got some models at the far end shifting randomly. Is it likely causing by the OneEuro algorithm or the calculation of cam_trans?

https://user-images.githubusercontent.com/80388134/178896919-e5c6e395-df6c-4289-a4f7-70ebea611aee.mp4

Arthur151 commented 2 years ago

As people repeatly showing up and disappearing, the simple center-based tracking algorithm we employed failed in this process.

Awj2021 commented 1 year ago

hi, @Arthur151, when I use this setting of temporal_optimize=true, and the both people, although the real distance is very large, these two person's meshes are overlaped together. Why this happened? Can you give some advices about it? Thanks.