EricssonResearch / openwebrtc-examples

Examples apps showing how to use OpenWebRTC
BSD 2-Clause "Simplified" License
336 stars 209 forks source link

iOS How can I be in control of AVCaptureSession? #112

Open gastonmorixe opened 9 years ago

gastonmorixe commented 9 years ago

Hi Guys,

I need to implement this but also use each frame image data for other purposes. I need to integrate it with GPUImage.

How can I get full control of the video feed?

Right now I am using OpenTok implementation (which uses Google's) which allows me to take care of the video feed by my self. Here's an example how I could integrate OpenTok with GPUImage, I need something similar with yours WebRTC implementation. Is it possible? Thanks

https://github.com/JayTokBox/TokBoxGPUImage/blob/master/TokBoxGPUImage/TokBoxGPUImagePublisher.m

Thanks

superdump commented 9 years ago

I think we need to implement an efficient way to put in and get out uncompressed video frames that can be used with the platform however you like with good performance. Not yet supported but a feature we've had in mind for some time.

gastonmorixe commented 9 years ago

So this means that by using openwebrtc I can not use the camera for other purposes right?

Because it can only be one data video output at same time.

superdump commented 9 years ago

Currently, yes. But it should not take too much work to change that. It just needs the time to do it. Most of us are on holiday currently.

timov7 commented 8 years ago

Hi, I know this is an older thread but I am facing the same issue right now. I managed to get AVCaptureSession of an RTCAVFoundationVideoSource object and set it as the video recording AVCaptureSession (I would like to record video while live streaming is on). My problem is that when the RTCAVFoundationVideoSource object is being created the app is freezing for like 10 seconds. Could you give me an idea why this is happening, and how could I solve this issue? Thank you.

niorko commented 7 years ago

I would like to analyze/record the raw video and audio data and stream it with WebRTC. Could someone help me figure it out the way how to get raw data while streaming/recording?

@timov7 did you solve it?

Thanks