polarby / render

A package to render any native static and moving flutter widgets to exportable formats
https://pub.dev/packages/render
MIT License
49 stars 26 forks source link

RecordMotion: native platform recorder #4

Open polarby opened 1 year ago

polarby commented 1 year ago

With .recordMotion() users could take advantage of capturing widgets natively (including native views) and it could dramatically reduce capturing time from RepaintBoundary. This issue has been created to discuss the feasibility to record flutter programs natively in each platform. Adaption of this approach for capture motion for widgets that are present in the widget tree is also considerable.

The process of capturing could be archived by the following process:

  1. Capture full screen natively and write to a temporary file directory
  2. Capture the context of the render widget (size, position, transparency mask by capturing RepaintBoundary )
  3. Using flutters FFmpeg to crop the to-be-captured widget out of the screen recording (and apply a transparency mask).
  4. Convert cropped video to the expected file format

The following platform support needs to be checked.

Identify and Capture native widgets

If native rendering does not seem to make too much sense, in case no significant render time is reduced. It is considerable to take this method to directly identify native views and capture those individually, rather than through flutter render boundaries.

Definitive limitations:

Kaizodo commented 1 month ago

if we capture and crop entire screen that means we are limited with resolution of video with repaint boundry we can output a higher resolution output with crisp details