jbilcke-hf / clapper

Clapper.app, a video synthesizer and sequencer designed for the age of AI cinema
https://clapper.app
GNU General Public License v3.0
2.08k stars 194 forks source link

Select the best default driving video when using Live Portrait #79

Open jbilcke-hf opened 2 months ago

jbilcke-hf commented 2 months ago

Context

Currently we always have the same video for the Live Portrait workflow.

that is because this workflow is pretty new, and we are only getting started.

The global master plan is to both add more and better driving videos, and also custom user-defined videos (there is a ticket for that: #75)

Solution

I've started creating a system to automatically pick a driving video from a fixed set (the idea is to answer to common blocking scenarios)

But this is not finished (code is in findRealisticDrivingVideo())