search

NVlabs / DREAM

DREAM: Deep Robot-to-Camera Extrinsics for Articulated Manipulators (ICRA 2020)
Other
145 stars 31 forks source link

How to create dataset of other type of robot using NDDS #10

Open hetolin opened 3 years ago

hetolin commented 3 years ago

Hi, It is really great work and useful in real robot applications. Would you share the details on how to use the augmented NDDS tools to make the datasets? It seems that the official provided NDDS tools cannot control the joints of the robot.

Or could you please share the processing script or UE4 project files that may be easier to use, which may accelerate the process of making datasets using our own robots?

TontonTremblay commented 3 years ago

We are currently switching out synthetic data pipeline to https://github.com/owl-project/NVISII, I would highly recommend you to look into it. We have examples with pybullet and exporting meta-data in the repo. I have been able to render robots as well using this tool and pybullet. Hopefully this helps.

hetolin commented 3 years ago

@TontonTremblay Hi, NVISII is really a great tool that can generate photorealistic images. But could you share the example/python script that you used (using this tool and pybullet) to render robots? It may be a little difficult for a new learner to complete the synthetic data pipeline in a short time.

tabula-rosa commented 3 years ago

Thanks for your kind remarks and question, @hetolin! I am sorry but at this time, we don't have plans for releasing the version of NDDS that was used to generate these datasets for DREAM that included robot joint control. Per @TontonTremblay, the current plan is to migrate synthetic data generation to NVISII.

TontonTremblay commented 3 years ago

It may be a little difficult for a new learner to complete the synthetic data pipeline in a short time.

I am sorry, at the moment I don't have a solution to be consumed quickly. But looking through the examples provided should help you out. Check 03 and latest one I added should give you a very good start.

hetolin commented 3 years ago

Thank you very much. I will take it a try