apple / ml-neuman

Official repository of NeuMan: Neural Human Radiance Field from a Single Video (ECCV 2022)
Other
1.27k stars 141 forks source link

Wrong output format when predicting keypoints in preprocess #100

Open nothonfz opened 3 months ago

nothonfz commented 3 months ago

I preprocess my own data, and when predicting keypoints, the output is .jpg images instead of a .npy files.

I cloned a specific repository using the link provided in the Dockerfile, using the command git clone --recurse-submodules https://github.com/jiangwei221/mmpose.git.

Then, I created the open-mmlab env with python 3.8 and the following commands.

  1. pip install torch==2.1.0 torchvision==0.16.0 torchaudio==2.1.0 --index-url https://download.pytorch.org/whl/cu121
  2. pip install mmcv-full==1.5.0
  3. cd mmpose
  4. pip install -r requirements.txt
  5. pip install -v -e .

I also downloaded the pretrained model by myself and put it in the mmpose.

Using this env, this command { python demo/bottom_up_img_demo.py configs/body/2d_kpt_sview_rgb_img/associative_embedding/coco/higherhrnet_w48_coco_512x512_udp.py higher_hrnet48_coco_512x512_udp-7cad61ef_20210222.pth --img-path /root/ml-neuman-main/preprocess/data/my_video/output/images --out-img-root /root/ml-neuman-main/preprocess/data/my_video/output/keypoints --kpt-thr=0.3 --pose-nms-thr=0.9 } can be run successfully.

Howerve, when I ran the command bash -i run.sh, all the steps can run successfully but the tenth step. the output are like this.

e721068461a39254aaf19423e3cf224

And the error from the tenth step image I looked up the output in keypoints

0b09e6dee3259728431e2e0b4f2b1f1

the output is .jpg images instead of a .npy files.

I looked up the code in /mmpose/demo/bottom_up_img_demo.py and found that save operation only exists in method vis_pose_result

eed7376d4ab10ec3c88edc080793977

I steped into the method vis_pose_result. And found that no code to save the result as .npy files.

afd5d7088928c078a5b698ed7427009

Has anyone encountered the same issue? How can I save the result as .npy file with correct format?

jiangwei221 commented 3 months ago

You need to checkout to the docker branch. https://github.com/jiangwei221/mmpose/tree/docker This branch has the dump code.

jiangwei221 commented 3 months ago

https://github.com/jiangwei221/mmpose/blob/8b788f93200ce6485e885da0c736f114e4de8eaf/demo/bottom_up_img_demo.py#L127-L131

nothonfz commented 3 months ago

Thanks!