philkr / gamehook_gtav

GTA V plugin for gamehook
BSD 2-Clause "Simplified" License
42 stars 7 forks source link

Wrong flow on human limbs #13

Open gengshan-y opened 4 years ago

gengshan-y commented 4 years ago

Thanks for sharing the code! I'm able to run the latest version (the forked repo from bradyz) and trying to generate optical flow data for training.

However, I find that flow on human limbs are usually incorrect. If I warp the prev. frame according to the flow, some parts of the human are missing while pixels of the cars and background are aligned well. As shown in the figure below (left: current frame, right: warped previous frame), the leg region circled in red in missing. left-reference-right-warped

To further examine this issue, I plot the 3D points of the (t-1) frame in red and the 3D points in the prev_pos variable of the (t) frame in blue under the same coordinate. They are supposed to perfectly overlap. However, the points on the limbs do not overlap. pasted image 0

I'm trying to debug this, but find it difficult. Could you give me some hints of what could go wrong?

dihuangdh commented 4 years ago

Same problem here.

fabbrimatteo commented 3 years ago

Did you solve this issue?