search

R3gm / SoniTranslate

Synchronized Translation for Videos. Video dubbing
Apache License 2.0
464 stars 104 forks source link

AI Dubbing API #55

Open mvoodarla opened 3 months ago

mvoodarla commented 3 months ago

Thank you for building this project! I work at a company called Sieve and this is a part of what inspired us to build our Dubbing API. It's a bit different than this as it supports voice cloning, different voice engines, and higher quality translations using other closed-source solutions but it's an example of the bounds of what this tech can do today.

I'd love to contribute our learnings in some way to this project. I think the most challenge part of the problem is around how one handles audio speedups and slowdowns across languages. Different applications seem to want different tradeoffs in the "sync"-ness versus how drastic the speedup tends to be.

Curious if there are improvements in the queue on that vector for this project and if we can contribute in any way? Would also love feedback on what we've built as I think it's something the community would love!

levi-creator-max commented 1 month ago

Excuse me, can you put Source and Target Language Filipino, because it's not here.