search

JiangWenPL / multiperson

Code repository for the paper: "Coherent Reconstruction of Multiple Humans from a Single Image" in CVPR'20
https://jiangwenpl.github.io/multiperson/
376 stars 50 forks source link

How to use opencv calibration parameter in neural mesh render with K,R,t? #19

Closed sunshinnnn closed 3 years ago

sunshinnnn commented 3 years ago

Hi, I want to use ordinary calibration camera parameters in the differentiable render, but I find it is non-trival to direct use K, R, t which are obtained from calibration camera parameters.

JiangWenPL commented 3 years ago

Well, I didn't see any relationship between your question and our repo. But of course you can set K, R, t for neural renderer.

sunshinnnn commented 3 years ago

Well...Since your repo gives a modified version of NMR, namely you add a projection of render. However, I find using the K,R,t from camera calibration parameters will not outputs results as other renderer(Blender, or [u,v,1] = Px) results.(I guess your R,R,t may in a new coordinate(which is not the same as a OpenGL coordinate) or you may have normalized K or something else). In a word, the projection of NMR is x'P' not Px as you writen in your code, I can not render iamges as [u,v,1]=Px projection.

sunshinnnn commented 3 years ago

Sorry, maybe I should pay more attention to debug the NMR or give issue in the NMR repo. Thanks all the same. 😄