search

Fannovel16 / ComfyUI-Frame-Interpolation

A custom node set for Video Frame Interpolation in ComfyUI.
MIT License
344 stars 33 forks source link

Do you see that as an interpolation node? #9

Closed ManuelMultiverse closed 9 months ago

ManuelMultiverse commented 9 months ago

https://openaccess.thecvf.com/content/ICCV2023/papers/Siyao_Deep_Geometrized_Cartoon_Line_Inbetweening_ICCV_2023_paper.pdf

Fannovel16 commented 9 months ago

Yes ofc 👍. But here is the problem. Their implementation doesn't have the script for automatically preprocessing raster lineart frames to "vector graphs", including vertex location and connection (original index is only used during training). That means it can only run on their dataset. Thus, it is currently impossible for me to make a Comfy node for it.

That being said, I know some details about vector graphs. It is just another way of saying "vectorization" (convert raster lineart images into svg, but you save the result in their json format). In the paper, they use https://github.com/MarkMoHR/virtual_sketching to vectorize frames. I don't have enough interest or time irl to implement the preprocessor. If you can make it, please share the script on https://github.com/lisiyao21/AnimeInbet/issues/7 and ping me there.

ManuelMultiverse commented 9 months ago

Okey, thanks! ill find a way to try to code that!