Video coloring system

[bropines]

There is a proposal to add a video coloring system. That is, the neural network together with the artist painted one frame together. Subsequent frames that have similar elements as in the past will be colored in the same way as in the last frame. Just in case, you can add markers that you can move and help the system

[bropines]

There is a proposal to add a video coloring system. That is, the neural network together with the artist painted one frame together. Subsequent frames that have similar elements as in the past will be colored in the same way as in the last frame. Just in case, you can add markers that you can move and help the system

I also wrote to you in the mail. I hope for an early answer. @lllyasviel

[78Alpha]

The current method outputs something like

https://user-images.githubusercontent.com/37676834/182510256-9357e38a-19e4-4c2b-8ea8-ab737a44d9f2.mp4

if interested

[bropines]

The current method outputs something like

out.mp4 if interested

how did you do that? automatically or by hand?

[78Alpha]

The current method outputs something like

out.mp4 if interested

how did you do that? automatically or by hand?

I made a batch generator out of the project and had it set to keep images in frame compatible name format.

Doing it by hand would take a couple hours.

I had the whole clip colored but that was just a small snippet to fit size constraints.

[bropines]

The current method outputs something like out.mp4 if interested

how did you do that? automatically or by hand?

I made a batch generator out of the project and had it set to keep images in frame compatible name format.

Doing it by hand would take a couple hours.

I had the whole clip colored but that was just a small snippet to fit size constraints.

you can throw off the code or upload it to your repository. I want to test it myself

[78Alpha]

The current method outputs something like out.mp4 if interested

how did you do that? automatically or by hand?

I made a batch generator out of the project and had it set to keep images in frame compatible name format.

Doing it by hand would take a couple hours.

I had the whole clip colored but that was just a small snippet to fit size constraints.

you can throw off the code or upload it to your repository. I want to test it myself

https://github.com/78Alpha/style2paints-Backup/tree/master/V4.5-mod

It doesn't use the web interface. I actually tried my best to strip it of that for something I plan to do later.

To find the options run the file like

python Home test.py -h

Should take an input folder, output folder and a picture to use for colors. Make sure none of the pictures are blank or it'll crash but the ones it did will still be in the game/room folder

Edit:

Adding extended video with blanks. Crimson Alpine by Resh

https://user-images.githubusercontent.com/37676834/183300342-5fd80fa5-2af2-4955-b410-1487bba81daf.mp4

[My12123]

I can’t. How do I fix this? The team I was driving

[78Alpha]

@My12123 Forgot I left the Mod page with the old non-functioning requirements.

pip install h5py==2.10.0
pip install protobuf==3.20.0

Will get you an h5py version that will load.

On top of this, I managed to get the old V4 working with the lighting system and all. Takes about 10x to 100x longer and apparently the old V4 had (has) a memory leak, so the old V4 can also a video system if someone wanted lighting. Even works with the refine image to make it look better beforehand. The V4 lighting doesn't work with the V4.5 but parts of V4.5 work on V4.

[My12123]

ERROR: No matching distribution found for protobuf==3.20.0 How do I fix this?

[78Alpha]

I suppose you could try 3.19.4

Seems you're running python 3.6, a bit different from my own setup but that one change should do it.

[My12123]

Can I run without the GPU?

[Ihateyoudattebayo]

no