aidudezzz / deepbots

A wrapper framework for Reinforcement Learning in the Webots robot simulator using Python 3.
https://deepbots.readthedocs.io/
GNU General Public License v3.0
230 stars 49 forks source link

Question: how to get kinect camera information #88

Closed ZY-KK closed 2 years ago

ZY-KK commented 3 years ago

I try to combined a panda robot with a kinect camera. The figure is camera definition. I try to run script of the panda demo, even I attach the camera, the webots simulator did not show image. Could you please tell me how can I get image from kinect camera and show on webots simulator if I use deepbots framework.

Screenshot-20210402103028-287x504

image

eakirtas commented 3 years ago

Could you please share a sample code in order to test it?

ZY-KK commented 3 years ago

For example, I try to modify your demo of panda robot and attach a kinect camera, but I do not know how can I get the image from kinect camera. sorry that there is no such sample code, I would like to know if it has method or interface to get image(color and depth)

eakirtas commented 3 years ago

I will check it ASAP. Thank you!

tsampazk commented 3 years ago

@ZY-KK Hello, i am not able to test it right now, but i would suggest to first make sure that the camera is visible by checking the various options at the menu bar on top. Then try to move or resize the camera window because sometimes there are multiple windows open that overlap and hide one another! Those would be the first two steps i would do before trying any other more complicated solution.

However if you cannot resolve the issue i would suggest to ask the webots developers directly as they are more knowledgeable about issues like this. You can open an issue on their repository or post a question in their discord channel, which i think will be the best.

For getting images in code, there's a wealth of information in the webots documentation to get images from cameras.

ZY-KK commented 3 years ago

@tsampazk thanks for your reply. I'll try. Another question I would like to ask is that how can I know some internal method information, for example, I import RobotSupervisor from deepbots, but I don't know what function it has, so, where can I find detail documentation of deepbots?

eakirtas commented 3 years ago

I will recommend to take a look on the following tutorials:

As well as on the following Pull Request:

KelvinYang0320 commented 3 years ago

I have combined webots camera with deepbots in this deepbots-inverseRL. This is an incomplete project (just an example of camera with deepbots). I am still working on inverse RL part. Hope this helps:smiley: