opendatacam / opendatacam-mobile

OpenDataCam mobile app for android
https://play.google.com/store/apps/details?id=com.opendatacam
MIT License
12 stars 3 forks source link

3D Tracking with Android Cam API? #20

Open b-g opened 3 years ago

b-g commented 3 years ago

The recent post in #81 https://github.com/opendatacam/opendatacam/issues/81 of the main repo made me wonder whether there is an API on Android to get z-depth infos for pixels via the in-built cam? Maybe we could have some rough 3d "thing" in Android out of the box?

tdurand commented 3 years ago

There is an API : https://developers.google.com/ar/develop/java/depth/overview , that we would need to investigate.. I think it would affect performance quite a lot .. but yes definitely as a "opt-in" option .

b-g commented 3 years ago

would affect performance quite a lot

Not sure ... as if this all happens on dedicated chips outside of the normal CPU realm this might not be the case. From my back in day GPU OpenCV days it was sometimes counterintuitive what really affects performance a lot and what not.

Anyways was just an idea ... maybe we could the 3d tracking peeps to this once it is online/public and hope for PRs :)

tdurand commented 3 years ago

Not sure ... as if this all happens on dedicated chips outside of the normal CPU realm this might not be the case. From my back in day GPU OpenCV days it was sometimes counterintuitive what really affects performance a lot and what not.

yes true we never know before trying out 🙏 , I'm pessimistic sorry 😁

Anyways was just an idea ... maybe we could the 3d tracking peeps to this once it is online/public and hope for PRs :)

yep, good to have it on the backlog