search

SamsungLabs / DINAR

Inference code for "DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars"
Other
100 stars 6 forks source link

Wrong camera angle in output video. How to change it ? #9

Open mayank64ce opened 11 months ago

mayank64ce commented 11 months ago

So I managed to generate a video with my own animation sequence but the camera point of view was messed up. It was from under the floor to the top. Here is a sample:

https://github.com/SamsungLabs/DINAR/assets/43180708/deeb7264-7e83-4ac5-93a0-b6cf1ad294fb

The avatar is supposed to be crawling on the floor.

Is there a way to change the camera angle ?

mayank64ce commented 11 months ago

Update: when I manipulate "global_orient" parameter for each frame, it changes the orientation of the render. But I don't understand how those 3 numbers are affecting the output ? If I am correct, those are the rotations along x, y and z axis right ?

Update: so the "global_orient" are rotation vectors in radians. I managed to rotate the avatar so that it faces the camera by adding pi/2 to the first index of global_orient of every frame. But still it seems that the camera is following the person in some sense.

https://github.com/SamsungLabs/DINAR/assets/43180708/5496d49c-8da2-4eeb-86e2-1f274bfbbf3b

It looks as if the floor is not fixed but keeps moving.