How to capture video from multiple cameras at the same time?

Apparence-io / CamerAwesome

📸 Embedding a camera experience within your own app shouldn't be that hard. A flutter plugin to integrate awesome Android / iOS camera experience.

https://ApparenceKit.dev

MIT License

950 stars 242 forks source link

How to capture video from multiple cameras at the same time? #131

Closed aytunch closed 1 year ago

aytunch commented 2 years ago

Proposal

Recently, I see many social apps which can capture and save video from both cameras at the same time. I can show my surroundings using the back camera and in a small PIP layout, I can show myself.

What needs to be done to accomplish this without losing fps and resolution?

Can we record with both cameras at the same time and use ffmpeg to combine 2 videos?
Can we use image streams from both cameras at the same time to overlay them on each other?

Are there any blockers for this functionality in Flutter?

@g-apparence are you going to continue implementing this awesome package btw? Google's camera package lacks a lot of features.

EDIT: here iOS native implementations on Multi Camera Capture (Gautier shared the Android link in the below comment): https://www.wwdcnotes.com/notes/wwdc19/249/

g-apparence commented 2 years ago

Thank you for this really nice idea. Didn't know some apps do that nowadays. Did you see that on Android devices ?

I don't think using ffmpeg is the best solution. Processing a live video seems a bit overengineering at first sight. I think you can simply use multiple texture. Thing is, I don't think this is doable on all devices. The new multi camera hardware seems to open many doors. https://developer.android.com/training/camera2/multiple-camera-streams-simultaneously

I'm searching some times to work on this. I hope summer will let me some time. I would love to investigate more on the cameraX implementation. (having a baby and a startup ain't letting much times...)

aytunch commented 2 years ago

I am glad that you find this use-case worthy There are similar issues on the camera package but it seems like Flutter engineers won't be implementing it anytime soon. https://github.com/flutter/flutter/issues/51928#issuecomment-1120289524 Can't wait for this exciting feature. I think this kind of capabilities will bring Flutter one step ahead. Also congratulations on the newborn :)

istornz commented 1 year ago

We released beta of multi camera feature with the v2. You can test it right now 👍

aytunch commented 1 year ago

Great news @istornz Is there an ETA on the Android implementation of this feature? You people are Awesome :)