search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.51k stars 5.15k forks source link

implement arcore with objectron #583

Closed cadrogui closed 4 years ago

cadrogui commented 4 years ago

is there a way to implement google arcore with the objectron sneakers to use the x,y,z coordiates in arcore anchor?, basically we need to put arbitrary 3d model in place of the rendered sneaker box

jiuqiant commented 4 years ago

You can build the mediapipe objectron aar and use the aar with arcore in Android Studio: https://github.com/google/mediapipe/issues/313#issuecomment-564156077. However, there is a gl context related issue to be soloved: https://github.com/google/mediapipe/issues/321

nakshathru commented 4 years ago

Any update on the GL context issue ?? Facing the same issue while integrating mediapipe with sceneform Can we expect an GLSurfaceview implementation of mediapipe instead of surfaceview in android ??

alter-sachin commented 4 years ago

bump

mgyong commented 4 years ago

@alter-sachin update to latest version of MP and see if this is an issue still

abiemann commented 3 years ago

You can build the mediapipe objectron aar and use the aar with arcore in Android Studio: #313 (comment). However, there is a gl context related issue to be soloved: #321

do you have a sample project to illustrate this setup? I've looked here https://github.com/jiuqiant?tab=repositories but found nothing that uses arCore. For now, I'm copying frames from the ArFragment and am trying to feed those to the MediaPipe, but I don't see anything useful in the FrameProcessor to set a bitmap.