ChennyDeng
commented
1 year ago I've noticed a small typo on the https://mmhuman3d.readthedocs.io/en/main/preprocess_dataset.html page. According to the VIBE config file, the spin.pth file should be stored in mmhuman3d/data/pretrained/spin.pth instead of mmhuamn3d/data/checkpoints/spin.pth.
Additionally, ${MMHUMAN3D_CHECKPOINT_FILE} refers to the mmhuman3d checkpoints available for download from the model zoo (https://mmhuman3d.readthedocs.io/en/main/model_zoo.html). Please note that the checkpoint can be found in the 'Results and Models - download - model' section located at the bottom of each method's page.
https://github.com/open-mmlab/mmhuman3d/issues/99
I am trying to run the offline demo for VIBE. I follow the data preparation instructions on https://github.com/open-mmlab/mmhuman3d/blob/main/docs/getting_started.md#data-preparation and place the downloaded spin.pth in mmhuman3d/data/checkpoints/spin.pth as instructed in the afore-mentioned link.
Then i run the following command to run the offline demo for VIBE: python demo/estimate_smpl.py configs/vibe/resnet50_vibe_pw3d.py data/checkpoints/spin.pth --single_person_demo --det_config demo/mmdetection_cfg/faster_rcnn_r50_fpn_coco.py --det_checkpoint https://download.openmmlab.com/mmdetection/v2.0/faster_rcnn/faster_rcnn_r50_fpn_1x_coco/faster_rcnn_r50_fpn_1x_coco_20200130-047c8118.pth --input_path demo/resources/single_person_demo.mp4 --show_path vis_results/single_person_demo.mp4 --output demo_result --smooth_type savgol --speed_up_type deciwatch --draw_bbox
However, it gives the following error message: FileNotFoundError: data/pretrained/spin.pth can not be found.
My first question comes: after receiving this error, i changed the location of spin.pth file to mmhuman3d/data/pretrained/spin.pth and run the following command in terminal: python demo/estimate_smpl.py configs/vibe/resnet50_vibe_pw3d.py data/pretrained/spin.pth --single_person_demo --det_config demo/mmdetection_cfg/faster_rcnn_r50_fpn_coco.py --det_checkpoint https://download.openmmlab.com/mmdetection/v2.0/faster_rcnn/faster_rcnn_r50_fpn_1x_coco/faster_rcnn_r50_fpn_1x_coco_20200130-047c8118.pth --input_path demo/resources/single_person_demo.mp4 --show_path vis_results/single_person_demo.mp4 --output demo_result --smooth_type savgol --speed_up_type deciwatch --draw_bbox
This time, the code was successfully run, but the results was really bad as you can see here
As the demo result looks pretty bad, i wonder if i have downloaded the wrong pretrained model or place it in the wrong folder? thank you for your clarification. Wish you a lovely day!