Flow-guided Video Inpainting With Scene Template

This is the demo code for 'Flow-guided Video Inpainting With Scene Template (ICCV 2021)'. We propose a flow-based solution to video inpainting by introducing the scene template, a 2D representation of the scene based on a layered formulation. This reduces geometric distortions in flow-based inpainting, creating consistent and crisp inpaintings results.

Now a Matlab demo can be downloaded from Google Drive. The code is configured for Matlab + Ubuntu due to its dependency of SobolevFlow (Mex/C++ on Linux). You may also play around by using pre-computed flow as initialization, or disable SobolevFlow (which will significantly reduce performance). I am working on migrating the code into python + pytorch.

An evaluation toolbox can be downloaded to measuring temporal consistency of inpainted regions.

The Foreground Removal Data can be downloaded. One may also manipulate the masks with ground truth background videos to create more data.

Fun Stuff