cordova-rtc / cordova-plugin-iosrtc

Cordova iOS plugin exposing the WebRTC W3C API
MIT License
690 stars 338 forks source link

Implementing Mediapipe Pose on ionic IOs using iosRTC #728

Closed AliuDardan closed 3 years ago

AliuDardan commented 3 years ago

YOU MUST read first!

Please use Community Forum for general technical discussions and questions.

Note: If the checkboxes above are not checked (which you do after the issue is posted), the issue will be closed, removing this checkbox will result in automatic closed issue.

Versions affected

Description

Hello

I'm trying to implement the [MediaPipe Pose](https://google.github.io/mediapipe/solutions/pose.html) on Ionic and of course the iosRTC is working but the problem is that I can't access video tag because is empty.

Did someone try to implement on IOs the MediaPipe Pose?

Steps to reproduce

cordova.plugins.iosrtc.getUserMedia( {audio: true, video: true} ) .then((stream) => { video.srcObject = stream; new Promise((resolve) => { video.onloadedmetadata = () => { resolve(video); }; }); video.play(); return video; });

Expected results

Actual results

Screen Shot 2021-10-27 at 16 28 29

hthetiot commented 3 years ago

MediaPipe pose required MediaStream Capture or HTMLVideoElement capture that is not available with this plugin using the standard API.

Look at this reply where I explain how to get video to canvas working that is one step you going to need if you want to achieve Capture Video to Canvas using HTMLVideoElement.render.save method that iosRTC expose. https://github.com/cordova-rtc/cordova-plugin-iosrtc/discussions/721#discussioncomment-1522265

I'm closing this issue because we have not plan yet to implement captureStream on video tag. Feel free to comment more anyway and i will reply to you.