zc-alexfan / arctic

[CVPR 2023] Official repository for downloading, processing, visualizing, and training models on the ARCTIC dataset.
https://arctic.is.tue.mpg.de
Other
314 stars 20 forks source link

What difficulties might arise when transferring existing methods for single-hand and object joint reconstruction to joint reconstruction of two hands and an object? #53

Closed liushawn618 closed 1 month ago

liushawn618 commented 1 month ago

What difficulties might arise when transferring existing methods for single-hand and object joint reconstruction to joint reconstruction of two hands and an object?

zc-alexfan commented 1 month ago

In two hand setting, the contact is not always in one hand. Your model needs to reason hand-object contact for the correct hand (see CDev in our paper). Also depth ambiguity (see MRRPE).

See our new paper: https://arxiv.org/abs/2403.16428