search

NVlabs / ACID

ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation
https://b0ku1.github.io/acid/
Other
66 stars 6 forks source link

Running the model on 2 RGBD images #2

Open seann999 opened 2 years ago

seann999 commented 2 years ago

I am trying to run this on 2 images taken from a RealSense. Is there code or documentation I can look at to know how to input these into the model?

seann999 commented 2 years ago

I was able to somewhat understand some of the data from reading the preprocessing scripts, but I do not understand how to obtain sample_pts in a real setting

It seems to be extracted from sim, which for simulated data is extracted from the physics engine. How do you obtain this in a real setting? Is it even required? https://github.com/NVlabs/ACID/blob/c1ff2ad8c1398ff1a5e7901dfa1887ca573a436c/PlushSim/scripts/attic_scene.py#L226-L236