search

arthenica / ffmpeg-kit

FFmpeg Kit for applications. Supports Android, Flutter, iOS, Linux, macOS, React Native and tvOS. Supersedes MobileFFmpeg, flutter_ffmpeg and react-native-ffmpeg.
https://arthenica.github.io/ffmpeg-kit
GNU Lesser General Public License v3.0
4.54k stars 605 forks source link

How to preview camera when using android_camera or avfoundation as input? #848

Closed iketiunn closed 12 months ago

iketiunn commented 1 year ago

I can take android_camera and avfoundation and then output them as a file or stream in React Native.

But how can I render a camera preview at the same time? Workaround I've tried so far:

  1. output as udp stream and load it with a video player

    -f tee -map 0:v "[f=mpegts]${LOCAL_UDP}"

    But the latency is unacceptable as a camera preview

  2. output as rtp stream and load it with a video player So far I can't get the vlc player(which supports loading from rtp stream) running with React Native due to shared lib conflict.

  3. output sdl2 Don't know if this going to work or not, since the package is disabled this option when build by default.

  4. open a camera at the same time Looks like you can only open one camera session at the same time, so the camera preview will be shutdown once the ffmpeg take the camera as input

Would love to know if I can simply take sdl2 as the output, or if there are other ways to achieve rendering the camera preview.

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 7 days.

github-actions[bot] commented 12 months ago

This issue was closed because it has been stalled for 7 days with no activity.

samanake commented 1 month ago

@iketiunn did you ever figure out the solution to this issue with avfoundation? My hunch is that you can use expo camera's recordAsync() function to record the frames locally to a cache and then use ffmpeg to point to the cache instead of avfoundation.

This should still be counted as "one session".

iketiunn commented 1 month ago

@iketiunn did you ever figure out the solution to this issue with avfoundation? My hunch is that you can use expo camera's recordAsync() function to record the frames locally to a cache and then use ffmpeg to point to the cache instead of avfoundation.

This should still be counted as "one session".

Thanks for the suggestion! I'm actually not working with ffmpeg at the moment, but I wish you the best of luck if you find the solution!