code-anyway / freespeech

Other
3 stars 0 forks source link

ElevenLabs re-dubbing vs Caching #239

Open axelKeizoStahl opened 1 year ago

axelKeizoStahl commented 1 year ago

ElevenLabs dubbing has some hiccups or hallucinations that can be solved by simply re-dubbing as it is non-deterministic. Caching stops ElevenLabs from synthesizing dubs when the user re-submits.

If the input is exactly the same we would want to not use cache, re-synthesizing, and then we actually want to overwrite the cache. We need to add a flag in the synthesize function whether or not to use cache. We also should have a hash of the entire text in the cachedir and we must see if that filename exists to determine whether or not to pass the cache flag in the synthesize text function. We must also make sure to create the hash of the plain text and add it to cachedir after the creation of the caches and dub synthesis so we don't have ghost files because the dub synthesis stopped halfway through or something.

axelKeizoStahl commented 1 year ago

working on branch aks/redo-cache