search

zju3dv / neuralbody

Code for "Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans" CVPR 2021 best paper candidate
Other
907 stars 130 forks source link

Training Custom dataset like people_snapshot example #159

Closed treesturn closed 6 months ago

treesturn commented 10 months ago

Hello I am trying to use this model on a custom dataset, given a mp4 file how do you generate the masks.hdf5, keypoints.hdf5 and camera.pkl. From what I understand these 3 files are needed to process the dataset and train the model?

image

treesturn commented 10 months ago

@pengsida how to generate masks images and keypoints

Dipankar1997161 commented 10 months ago

@pengsida how to generate masks images and keypoints

are you working on a mono view or a multi_view, you can always use EasyMocap for all such file generations

treesturn commented 10 months ago

@Dipankar1997161 thanks for the reply! i have managed to obtain the masks and keypoints hdf5 files, now im trying to obtain the reconstructed_poses.hdf5 file, do u by any chance know how to get that file?

pengsida commented 6 months ago

You could use this for generating masks: https://github.com/zju3dv/im4d/blob/main/docs/studio_data_preprocess.md#mask