korrawe / harp

HARP: Personalized Hand Reconstruction from a Monocular RGB Video
68 stars 10 forks source link

Will the Hand Appearance Dataset and Synthetic Dataset be made publicly available? #4

Closed delaprada closed 1 year ago

delaprada commented 1 year ago

Hi, thank you for providing such a good work! It has provided me with valuable insights.

May I ask if the hand appearance dataset and synthetic dataset will be made publicly available? Or if it would be possible to make the code for generating the synthetic dataset using Blender and Nimble available to the public?

Thank you very much!

korrawe commented 1 year ago

Hi, I added the additional data which includes subject 1 from the dataset and 4 different appearance variations that we used in the supplementary. Sequences from other subjects might take some time due to privacy issues.

We did not plan to release the synthetic dataset from NIMBLE as we did not have the licenses for them. To render the synthetic dataset, we used the provided Blender environment (assets/render.blend) from NIMBLE and render them manually with some modifications on lighting and environment map. You can manually edit the albedo sampled from NIMBLE directly before rendering in Blender. We provide the code for fitting NIMBLE to the hand surface vertex here. You can use these poses to synthesize new synthetic datasets with sampled/edited appearances from NIMBLE. To export mesh sequences for Blender, you can use a plugin like Stop-motion-OBJ. Although, you might need some familiarity with NIMBLE and Blender.

Best,

delaprada commented 1 year ago

Thanks a lot!