First of all, the results of this paper are so exciting, great work!
I really loved the visualization of the scenes (cameras/avatar) on the project page.
Therefore, I wanted to try out the three.js script you used for the visualization on my own camera poses (no avatar).
I did get everything to run without avatar, and with the hardcoded camera matrices.
Unfortunately, when I insert my own camera/transformation matrices I get some weird results.
I see that cam_transforms is a flattened 4x4 transformation matrix, which I have as well.
What do the transformation matrices in cam_transforms represent?
My transformation matrices follow the nerfstudio transforms.jsondata conventions.
As a side note, I know for certain that the transformation matrices are valid since I'm getting good results with them.
In case you're curious, these are the "weird results":
MvWouden
commented
1 year ago
First of all, the results of this paper are so exciting, great work!
I really loved the visualization of the scenes (cameras/avatar) on the project page. Therefore, I wanted to try out the three.js script you used for the visualization on my own camera poses (no avatar).
I did get everything to run without avatar, and with the hardcoded camera matrices. Unfortunately, when I insert my own camera/transformation matrices I get some weird results. I see that
cam_transformsis a flattened 4x4 transformation matrix, which I have as well. What do the transformation matrices incam_transformsrepresent?My transformation matrices follow the nerfstudio
transforms.jsondata conventions. As a side note, I know for certain that the transformation matrices are valid since I'm getting good results with them.In case you're curious, these are the "weird results":