vchoutas / smplify-x

Expressive Body Capture: 3D Hands, Face, and Body from a Single Image
https://smpl-x.is.tue.mpg.de/
Other
1.78k stars 340 forks source link

where is images and keypoints for DATA_FOLDER? #118

Open TomatoBoy90 opened 4 years ago

TomatoBoy90 commented 4 years ago

hi, your job so great .however,how to download those data?

keeelho commented 4 years ago

you need to put image and keypoint, and use openpose to make keypoint

tetsu commented 4 years ago

Do you know what kind of format for images and keypoints? Can we use PNG images and 2D keypoints in JSON format?

Anirudh257 commented 3 years ago

@tetsu Yes, the openpose keypoints is in Openpose json format and the images are in .png format.

poincarelee commented 3 years ago

hi, I would like to know how many images processed by openpose are enough to run in the model. @TomatoBoy90 @Anirudh257 @keeelho @geopavlakos

Anirudh257 commented 3 years ago

@poincarelee one image is also fine to run the model.

whois-byte commented 3 years ago

Does Data_FOLDER have an existing file link, and what should the file format below it look like?

Anirudh257 commented 3 years ago

@who123sy, it is like:

data_folder/
data_folder/images/
data_folder/images/image_1.jpg
data_folder/keypoints/
data_folder/keypoints/image_openpose_1.jpg
sparshgarg23 commented 2 years ago

@Anirudh257 is it mandatory to use openpose,or will any keypoint detection like alphapose/deepcut/mediapipe work?

Anirudh257 commented 2 years ago

@sparshgarg23 anything will work. Follow the folder structure of the images and key points.

sparshgarg23 commented 2 years ago

Ok,but mediapipe's output consists of detecing 33 landmarks(including full body face,hand and landmark),whereas open pose output consists of detecting 25 points.So wouldn't that be a problem when we are reprojecting the 3d points outputted by the model back into 2d? from mediapipe site The landmark model in MediaPipe Pose predicts the location of 33 pose landmarks from openpose Pose Output Format (BODY_25)

I mean the main goal of SMPL is to reduce the error between the projected 3d points and the 2d points,so wouldn't there be a dimensional mismatch. Thanks for taking the time to get back,hope you can clarify my doubt.

Anirudh257 commented 2 years ago

@sparshgarg23 Okay, that is true. Try to use the 25 keypoints corresponding to Openpose only. You may have to do some manual changes.