hongsukchoi / TCMR_RELEASE

Official Pytorch implementation of "Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Video", CVPR 2021
MIT License
287 stars 39 forks source link

Details about data preprocessing. #33

Closed linjing7 closed 2 years ago

linjing7 commented 2 years ago

Hi, thanks for your excellent work.

In addition to the feature map, I want to take the RGB image as input of the network. However, the provided preprocessed data do not include the RGB image. I wonder if you could provide a preprocessed data that contain the RGB image.

Or could you please tell me how to preprocess the data? You mention in 'data.md' that "You may need to change details (ex. scale), so check comments in {dataset_name}_utils.py files.". So I worry about that I could not correctly preprocess the data if there is something wrong with the details.

Thank you very much!

hongsukchoi commented 2 years ago

Hi @linjing7

Are you trying to build a new network on top of TCMR?

linjing7 commented 2 years ago

Yes, I'm trying. If it works, I'll cite TCMR and thank you in the acknowledgement :)

hongsukchoi commented 2 years ago

Hi @linjing7,

OK, I will tell you how to preprocess data. I asked you because there's one thing you should know about the InstaVariety. It is preprocessed by VIBE's authors and the images are saved in tf-record. I don't know the details about extracting images from them but you could do it, though it will take some time.

Anyway, to preprocess other datasets by yourself, note two things: 'scale' and 'occ'

linjing7 commented 2 years ago

Okay, thank you very much.