No image or pointcloud with OrbbecAstraPro

[qooh]

Hello! First of all thanks a lot for your work!

I am using an OrbbecAstra Pro on ubuntu 14.04. x64 with of_v0.9.2 Qt Creator. I compiled the astra-sdk and copied the lib-.so files into the folders of the addon next to the equivalent .dylib files.

It seems that the example builds and runs properly, however there is no camera image, pointcloud or anything from the camera visible. There are no error messages and the ir-light of the camera is turning on when the example is runnig. Here's what the console says:

Starting /home/o/DEVEL/of_v0.9.2_linux64_release/apps/myApps/myOrbbecAstra/bin/myOrbbecAstra_debug... 2016-02-11 19:58:17,593 WARN [context] Hold on to yer butts 2016-02-11 19:58:17,593 INFO [context] configuration path: /home/o/DEVEL/of_v0.9.2_linux64_release/apps/myApps/myOrbbecAstra/bin/astra.toml 2016-02-11 19:58:17,593 INFO [context] log file path: astra.log 2016-02-11 19:58:17,593 INFO [context] plugin path: /home/o/DEVEL/of_v0.9.2_linux64_release/apps/myApps/myOrbbecAstra/bin/Plugins/ 2016-02-11 19:58:17,602 INFO [orbbec.ni.oni_adapter_plugin] Initializing OpenNI v2.3.0.15 2016-02-11 19:58:17,607 INFO [orbbec.ni.oni_adapter_plugin] device connected: 2bc5/0403@3/11 2016-02-11 19:58:17,608 INFO [astra.plugin_service] creating streamset: device/sensor0 23b4900 2016-02-11 19:58:17,608 INFO [orbbec.ni.device_streamset] opening device: 2bc5/0403@3/11 Warning: USB events thread - failed to set priority. This might cause loss of data... 2016-02-11 19:58:17,673 INFO [orbbec.ni.device_streamset] opened device: 2bc5/0403@3/11 2016-02-11 19:58:17,674 INFO [astra.plugins.Stream] creating a 2, 0 2016-02-11 19:58:17,674 INFO [astra.plugin_service] created stream -- handle 0x24cc4b0 type: 2 2016-02-11 19:58:17,674 INFO [orbbec.ni.devicestream] creating oni stream of type: 2 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] created oni stream of type: 2 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] stream type 2 supports modes: 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 201 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 205 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 15 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 15 pf: 201 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 15 pf: 205 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 201 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 205 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 201 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 205 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 15 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 15 pf: 201 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 15 pf: 205 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 202 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 201 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 205 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 720 fps: 30 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 720 fps: 30 pf: 202 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 960 fps: 30 pf: 200 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] - w: 1280 h: 960 fps: 30 pf: 202 2016-02-11 19:58:17,678 INFO [orbbec.ni.devicestream] bin swap: 320x240x3 len: 230400 2016-02-11 19:58:17,679 INFO [astra.plugin_service] creating bin -- handle: 252cc90 stream: 24cc4b0 type: 2 size: 230428 2016-02-11 19:58:17,679 INFO [astra.plugins.Stream] creating a 1, 0 2016-02-11 19:58:17,679 INFO [astra.plugin_service] created stream -- handle 0x252e640 type: 1 2016-02-11 19:58:17,679 INFO [orbbec.ni.devicestream] creating oni stream of type: 1 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] created oni stream of type: 1 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] stream type 1 supports modes: 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 100 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 101 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 100 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 101 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 100 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 101 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 100 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 101 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 160 h: 120 fps: 30 pf: 100 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] - w: 160 h: 120 fps: 30 pf: 101 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] bin swap: 320x240x2 len: 153600 2016-02-11 19:58:17,706 INFO [astra.plugin_service] creating bin -- handle: 2611c20 stream: 252e640 type: 1 size: 153628 2016-02-11 19:58:17,706 INFO [astra.plugins.Stream] creating a 3, 0 2016-02-11 19:58:17,706 INFO [astra.plugin_service] created stream -- handle 0x2682720 type: 3 2016-02-11 19:58:17,706 INFO [orbbec.ni.devicestream] creating oni stream of type: 3 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] created oni stream of type: 3 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] stream type 3 supports modes: 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 203 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 30 pf: 200 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 203 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 320 h: 240 fps: 60 pf: 200 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 203 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 640 h: 480 fps: 30 pf: 200 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 203 2016-02-11 19:58:17,707 INFO [orbbec.ni.devicestream] - w: 1280 h: 1024 fps: 30 pf: 200 2016-02-11 19:58:17,708 INFO [orbbec.ni.devicestream] bin swap: 320x240x2 len: 153600 2016-02-11 19:58:17,708 INFO [astra.plugin_service] creating bin -- handle: 26cb430 stream: 2682720 type: 3 size: 153628 2016-02-11 19:58:17,710 INFO [orbbec.ni.oni_adapter_plugin] Initialized OpenNI v2.3.0.15 2016-02-11 19:58:17,711 INFO [astra.plugins.xs.XSPlugin] Initializing XS plugin 2016-02-11 19:58:17,711 INFO [astra.plugins.xs.XSPlugin] creating point processor 2016-02-11 19:58:17,711 INFO [context] client opening streamset: device/sensor0 2016-02-11 19:58:17,711 INFO [astra.streamset] connecting to (1,0) on device/sensor0 2016-02-11 19:58:17,711 INFO [astra.plugins.Stream] adding connection 2016-02-11 19:58:17,711 INFO [astra.plugin_service] linking connection to bin -- stream: 252e640 type: 1 conn: 273e6f8 bin: 2611c20 2016-02-11 19:58:17,711 INFO [orbbec.ni.devicestream] turn on stream 1 2016-02-11 19:58:17,711 INFO [orbbec.ni.devicestream] starting oni stream of type: 1 2016-02-11 19:58:17,722 INFO [orbbec.ni.devicestream] started oni stream of type: 1 2016-02-11 19:58:17,722 INFO [orbbec.ni.device_streamset] adding stream type 1 to active streams 2016-02-11 19:58:17,722 INFO [context] client opening streamset: device/default 2016-02-11 19:58:17,722 INFO [streamset_catalog] default uri provided. 2016-02-11 19:58:17,723 INFO [astra.streamset] connecting to (1,0) on device/sensor0 2016-02-11 19:58:17,723 INFO [astra.plugins.Stream] adding connection 2016-02-11 19:58:17,723 INFO [astra.plugin_service] linking connection to bin -- stream: 252e640 type: 1 conn: 27ba838 bin: 2611c20 2016-02-11 19:58:17,723 INFO [orbbec.ni.depthstream] depth registration: enabled, successful: yes 2016-02-11 19:58:17,723 INFO [astra.streamset] connecting to (2,0) on device/sensor0 2016-02-11 19:58:17,724 INFO [astra.plugins.Stream] adding connection 2016-02-11 19:58:17,724 INFO [astra.plugin_service] linking connection to bin -- stream: 24cc4b0 type: 2 conn: 27bc238 bin: 252cc90 2016-02-11 19:58:17,724 INFO [orbbec.ni.devicestream] mode change requested: 640x480x3@30 pf:200 2016-02-11 19:58:17,724 INFO [orbbec.ni.devicestream] stream mode changed 2016-02-11 19:58:17,724 INFO [orbbec.ni.devicestream] turn on stream 2 2016-02-11 19:58:17,724 INFO [orbbec.ni.devicestream] starting oni stream of type: 2 2016-02-11 19:58:17,733 INFO [orbbec.ni.devicestream] started oni stream of type: 2 2016-02-11 19:58:17,733 INFO [orbbec.ni.device_streamset] adding stream type 2 to active streams 2016-02-11 19:58:17,733 INFO [orbbec.ni.devicestream] mode change requested: 640x480x2@30 pf:100 2016-02-11 19:58:18,730 INFO [orbbec.ni.devicestream] stream mode changed 2016-02-11 19:58:18,730 INFO [orbbec.ni.devicestream] turn on stream 1 2016-02-11 19:58:18,730 INFO [astra.streamset] connecting to (7,0) on device/sensor0

I also tried the addon on a friends macBookPro with the same reult: the example was compiling and running but there was no camera image etc. visible.

Is it because I'm using the Astra Pro Version? I read in the orbbec Forum that there are problems with the rgb-image (what I can confirm - the color sdk examples aren't working for me) but the depthImage should work.

Do you have any ideas?

[mattfelsen]

Hi @qooh. I do think it's the Astra Pro as you suspect. Can you try commenting out astra.initColorStream(); in the example and see if you get a depth image/point cloud? I think when you try to start the color stream, it messes up the depth stream.

[qooh]

Thanks @mattfelsen. I tried but had no success...

[qooh]

Hi @mattfelsen ! I tried again and it is working now;-) (except rgb image of course) thanks a lot!

[mattfelsen]

Glad to hear it! :+1: