search

ColasGael / Automatic-Video-Colorization

Automatic Video Colorization using Deep Neural Networks
15 stars 4 forks source link

Can you provide references? #2

Closed luowy1001 closed 5 years ago

luowy1001 commented 5 years ago

Thanks for your work! Which algorithm is used to complete the video coloring? @ColasGael

ColasGael commented 5 years ago

HI @luowy1001

Thanks for your interest, our work mostly extends a network used for image colorization to try to do color propagation.

The original paper is: Kamyar Nazeri, Eric Ng, and Mehran Ebrahimi. Image colorization using generative adversarial networks. In International Conference on Articulated Motion and Deformable Objects, pages 85–94. Springer, 2018

We added a new conditioning on the previous color frame to try to propagate colors from one frame to another.

You can see our report ("automatic-video-colorization.pdf") at the root for more details about the conditioning. It also explains (and shows) why this approach is bound to failing due to exponential error propagation.

Some recent papers on Video Colorization came up after the end of our project. The following repository is the code of one of the state-of-the-art algorithm: https://github.com/msracver/Deep-Exemplar-based-Colorization