search

apple / ml-neuman

Official repository of NeuMan: Neural Human Radiance Field from a Single Video (ECCV 2022)
Other
1.27k stars 143 forks source link

Missing output files when preprocessing on my own data #65

Open TiantianWang opened 1 year ago

TiantianWang commented 1 year ago

Hi,

When I run the gen_run.py to preprocess my own data. For the step 10, errors are shown below when running optimize_smpl.py file.

########### can not find keypoints for 00000.png
can not find densepose for 00000.png
can not find keypoints for 00001.png
can not find densepose for 00001.png
can not find keypoints for 00002.png
can not find densepose for 00002.png ......
############

It seems that the Step 5 DensePose and Step 6 2D keypoints did not generate the required .npy file. May I know how to obtain both files for Step 5 and Step 6?

Thanks!

jiangwei221 commented 1 year ago

Hmmmmm, is there any error messages when running pose estimation(mmpose/detectron2)?

TiantianWang commented 1 year ago

Hmmmmm, is there any error messages when running pose estimation(mmpose/detectron2)?

This part can be run successfully. The output is ./densepose/output.pkl without single frame .npy output.

jiangwei221 commented 1 year ago

I don't recall I save the output.pkl file... Do you use the customized repo? https://github.com/apple/ml-neuman/blob/0149d258b2afe6ef65c91557bba9f874675871e4/preprocess/Dockerfile#L86-L94

jiangwei221 commented 1 year ago

are there any visualizations saved?

TiantianWang commented 1 year ago

I don't recall I save the output.pkl file... Do you use the customized repo?

https://github.com/apple/ml-neuman/blob/0149d258b2afe6ef65c91557bba9f874675871e4/preprocess/Dockerfile#L86-L94

are there any visualizations saved?

I have checked the 2 repos and found that I used the wrong ones. After installing the repos you mentioned above, the .npy files can be generated.

Thanks a lot for the help!