Upscale and StableDiffusion video pipelines use a large amount of RAM if the video resolution is large or it has a long duration.
At the moment video processing is buffered as we load all frames into RAM, this PR will introduce some methods to stream a video from disk frame by frame while writing each frame back to disk. This will reduce ram usage to a single input and output frame instead of full input + output video size.
Tasks:
[x] Video stream methods
[x] Upscale video stream
[x] Feature Extractor video stream
[x] StableDiffusion video stream
This should also enable live streaming via webcam in theory
UpscaleandStableDiffusionvideo pipelines use a large amount of RAM if the video resolution is large or it has a long duration.At the moment video processing is buffered as we load all frames into RAM, this PR will introduce some methods to stream a video from disk frame by frame while writing each frame back to disk. This will reduce ram usage to a single input and output frame instead of full input + output video size.
Tasks:
This should also enable live streaming via webcam in theory