MateuszSadowski / frame-rate-booster

Console application for increasing frame rate of a video sequcence by intermediate frame interpolation based on optical flow
MIT License
5 stars 1 forks source link

Frame Rate Booster

This is a tool for motion-compensated temporal upsampling of frame sequances in the form of videos. Frame interpolation is carried out with the use of optical flow. To obtain the optical flow for two consecutive frames, the Farneback method is used. An in-depth description of the project, methods and results can be found here.

Description

This tool was created in the scope of a project for the Digital Video Technology course at the Technical University of Denmark. This project is focused on the methods and techniques used to increase the frame rate of a video by creating new frames in between two consecutive images in a sequence. It is a relevant problem in many branches of the digital video technology field. For example, it can be used to transmit a sequence over a low bandwidth connection more effectively by first removing some frames from the video and then deconstructing them on the receiving end. It is also used in modern video editing software for slow-motion renders of videos that were shot with insufficient frame rate for that purpose. Yet another example can be old footage restoration.

In this project optical flow was calculated for each pair of consecutive frames. Optical flow is a field of 2D vectors that carry the information of how the pixels move between the frames. It was then used to interpolate the intermediate position of pixels along the motion vectors. The method was evaluated by first downsampling a sequance of images and then upsampling with the proposed method. Then the original and interpolated frames were compared using the Peak Signal-to-Noise Ratio (PSNR) metric. An in-depth description of the project, methods and results can be found here.

Comparison of the original (left) and interpolated (right) frames for the test sequances: Room comparison Hand comparison Guitar comparison

Getting Started

Dependencies

Installing

Executing program

Further work

Authors

Mateusz Sadowski mateusz.sadowski1@gmail.com linkedin.com/in/mateuszsadowski1/

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

Acknowledgments