search

jliljebl / flowblade

Video Editor for Linux
GNU General Public License v3.0
2.61k stars 178 forks source link

Downloadable resources for Fluxity plugins #1155

Open vicentecarro opened 3 months ago

vicentecarro commented 3 months ago

Not an issue, just a question. Does Flowbalde have a plugin system? I've seen the code is in python (great), but I don't see anything about plugins. I'm thinking about including connections in Flowblade to comfyUI to generate AI content on demand and/or send already present media assets to comfyUI to be processed somehow and then returned back to Flowblade.

dvdlvr commented 3 months ago

Hi,There's currently no plugin system in Flowblade.I've looked at it in the past but can't even find the time to finish my current engagement (soon, though).It seems totally doable. There are 2 major paths that could be used, if I remember right.There are coding exemples on the internet for both.I hope someone (you?) can implement that 😊Regards,Steven Sent from my phone-------- Original message --------From: vicentecarro @.>Date: Wed, 27 Mar 2024, 15:53To: jliljebl/flowblade @.>Cc: Subscribed @.***>Subject: [jliljebl/flowblade] Plugins? (for AI) (Issue #1155) Not an issue, just a question. Does Flowbalde have a plugin system? I've seen the code is in python (great), but I don't see anything about plugins. I'm thinking about including connections in Flowblade to comfyUI to generate AI content on demand and/or send already present media assets to comfyUI to be processed somehow and then returned back to Flowblade.

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you are subscribed to this thread.Message ID: @.***>

jliljebl commented 3 months ago

There is the Fluxity Plugin API for creating Generators described here: http://jliljebl.github.io/flowblade/webhelp/fluxity.html

This is geared towards media creation by rendering and may or may not be suitable for your use case.

We also provide a simple development tool for creating Fluxity Plugins that can be accessed Tools -> Generator Script Editor from app menu.

If your use case is simply to connect to internet, download some assets and then create media using those, then that should be possible, but GUI will likely freeze occasionally because the init_script() isn't async in any way, but there is probably way to fix that. Actually I think that downloading stuff from internet should be in init_render() because that taking time can be made to not freeze GUI quite easily I think.

You can also propose extensions to Fluxity API to better suit your use case.

vicentecarro commented 3 months ago

@dvdlvr Thanks, but my time is very limited, it woudln't be wise to cmmit to do anything like finishing a plugin system. But @jliljebl that fluxity seems interesting. The a-synchronicity could be a pain. And I understand that there is not signal system that could be used to workaround this. But anyway, worse case scenario it could be done in pairs of scripts with launchers (of the AI generation) and receivers (of the resulting footage from some location). I'll give a look to that documentation. Thanks.

jliljebl commented 3 months ago

I think I'll give a go to do a plugin using downloadable resources, e.g. KDEnlive has something like this available. When we have the machinery working, adding new plugins using different resources will be trivial.