search

hassony2 / homan

[3dv 2021] Joint fitting of hands and object from short RGB video clips
98 stars 14 forks source link

Is the relative distance between hand and object predicted? #1

Open buaacyw opened 3 years ago

buaacyw commented 3 years ago

Thanks for your great work! The results are fascinating! And I have some questions.

  1. Is the relative distance between hand and object predicted? I want to let robots imitate object-lifting videos to lift objects. So I need the relative distance between hand and object.
  2. I haven't seen the object scale parameters for Ho3d in homan/dataset/ho3dconstants.py. But core50 has object scale parameters, such as 0.08 in your colab demo. So how to set the scale parameter for Ho3d?
  3. How to obtain the final results of objects and hand pose?

Really nice work, thanks!

buaacyw commented 3 years ago

In https://github.com/hassony2/homan/blob/c421f1830460f931e75dc017e4e2d9f7b199562a/homan/datasets/ho3d.py#L200
scale is set to 1 for all YCB objects. But I have tried to set it to 1 in colab demo code, the result is much worse than 0.08

binghui-z commented 3 years ago

Thanks for your great work! The results are fascinating! And I have some questions.

  1. Is the relative distance between hand and object predicted? I want to let robots imitate object-lifting videos to lift objects. So I need the relative distance between hand and object.
  2. I haven't seen the object scale parameters for Ho3d in homan/dataset/ho3dconstants.py. But core50 has object scale parameters, such as 0.08 in your colab demo. So how to set the scale parameter for Ho3d?
  3. How to obtain the final results of objects and hand pose?

Really nice work, thanks!

hello ,does you meet

Thanks for your great work! The results are fascinating! And I have some questions.

  1. Is the relative distance between hand and object predicted? I want to let robots imitate object-lifting videos to lift objects. So I need the relative distance between hand and object.
  2. I haven't seen the object scale parameters for Ho3d in homan/dataset/ho3dconstants.py. But core50 has object scale parameters, such as 0.08 in your colab demo. So how to set the scale parameter for Ho3d?
  3. How to obtain the final results of objects and hand pose?

Really nice work, thanks!

hello , can you meet " ModuleNotFoundError "that "No module named 'detectron2.projects'" in folder "homan\homan\pointrend.py"? I have installed detectron2-0.2.1 , but I dont't find this module.

anilesec commented 3 years ago

@buaacyw Did you manage to run the demo notebook successfully? I am getting the error https://github.com/hassony2/homan/issues/3#issue-1028295491

Did you also face this error?

hassony2 commented 3 years ago

Hi !

Sorry for the late response, let me try to provide some answers:

  1. Is the relative distance between hand and object predicted? -> The relative distance can be computed using the computed vertex locations of hands and objects. Would that be satisfying for your use case ?
  2. for the ho3d dataset the scale of the object is assumed to be known, so we are using the real results. What do you mean when "the results are much worse in colab", do you mean qualitatively ?
  3. How to obtain the final results of objects and hand pose? -> I am not sure I understand the question. Do you mean quantitative results for the HO-3D dataset ?

Best !

Yana