facebookresearch / iSDF

Real-time Neural Signed Distance Fields for Robot Perception
https://joeaortiz.github.io/iSDF/
MIT License
420 stars 53 forks source link

iSDF integration with Franka + realsense #8

Closed suddhu closed 2 years ago

suddhu commented 2 years ago

This runs similar to the live camera demo, but subscribes to Franka Panda inverse kinematics rather than ORB-SLAM. Additionally, this implementation has been tuned to work for tabletop scenes and is restricted to a defined workspace. I conducted tests live on the Franka Panda, and on the realsense_franka datasets from data/download_franka.sh. Also checked runs on the ReplicaCAD dataset and ORBSLAM live demo to ensure the changes did not break the main repo.

The easiest way to verify the implementation without access to a Franka is roslaunch isdf train_franka.launch live:=false inc:=true from the readme. If you have a Franka, you follow the readme instructions for running iSDF live.

Other smaller changes unrelated to the Franka:

Happy to make any changes!

mhmukadam commented 2 years ago

Should we merge this PR?

suddhu commented 2 years ago

It should be ready in the next couple of days, @joeaortiz and I briefly talked about this last week. Have to merge the changes from main (new visualizer) and test it out. After that, we can merge.

suddhu commented 2 years ago

@joeaortiz @mhmukadam integrated the Open3D viz. and ready to merge with main. Tested out on tabletop and ReplicaCAD datasets. Other small changes: