richzhang / colorization

Automatic colorization using deep neural networks. "Colorful Image Colorization." In ECCV, 2016.
http://richzhang.github.io/colorization/
BSD 2-Clause "Simplified" License
3.34k stars 923 forks source link

Colorization on 1929 movie #15

Closed ttoinou closed 7 years ago

ttoinou commented 7 years ago

Hi

Thanks for this script ! I tried your colorization (v2 with class rebalancing) on some frames from Man With a Movie Camera (Vertov, 1929) here are the results : https://drive.google.com/open?id=0B5-1OeNPsecwdTZ4dS0wUUhIaUU

man with a movie camera the cinematic orchestra soundtrack dvdrip_scene19_7655 man with a movie camera the cinematic orchestra soundtrack dvdrip_scene19_7655

Thanks in advance ! Antoine.

richzhang commented 7 years ago

Our network is trained on modern photos, so there's a domain gap when applied to old movies. I think training your own network with old color movies is a great idea and can help bridge that gap. I would recommend starting from our network and fine-tuning on old movies.

Yes, temporal consistency would also make the results look nicer.

ttoinou commented 7 years ago

Thank you for your input, I'm first going to extract color frames from movies and documentaries. If I need ~500k iterations how many iter/images ? (not 1 I suppose)

ttoinou commented 7 years ago

I've extracted 12k frames from movies, now I need to create an LMDB file, do you think that tutorial would work http://deepdish.io/2015/04/28/creating-lmdb-in-python/ ? Sorry for the noob question

theColourSpace commented 7 years ago

Hi ttoinou,

I'm also trying to use this engine for colorization on some historical images. Would have any interest in collaborating on this?

ttoinou commented 7 years ago

Hi, yes of course ! There's also another software for colorization : https://github.com/gustavla/autocolorize But I didn't succeed in installing it (yet)

ttoinou commented 7 years ago

My email : tit_toinou@hotmail.com

ttoinou commented 7 years ago

If someone wants to process an entire folder he can use my script : https://github.com/ttoinou/colorization/blob/master/color.py