search

CodingTrain / Bizarro-Devin

12 stars 4 forks source link

Add narration + a readable script #8

Closed supercrafter100 closed 5 months ago

supercrafter100 commented 5 months ago

This pull request features a script.js file which is (for now) used by the aI to both insert code and narrate what it's doing. The code it writes is the recursive fractal tree one. It uses the say package to use the windows/macos text to speech system for saying out loud what it's doing.

https://github.com/CodingTrain/Bizarro-Devin/assets/58982133/a4b129e1-4b6c-49cd-9da4-1c9bfaf7ea7a

This would close #4

shiffman commented 5 months ago

This is great! I'm going to merge this and work from it later (even if I might end up re-organizing). I hope to use a custom AI voice rather than the built-in OS TTS but I haven't researched this yet. I might even clone my voice with elevenlabs or something like that.

supercrafter100 commented 5 months ago

Does elevenlabs allow for local audio generation? Seeing as you ideally didn't want to rely on external apis?

shiffman commented 5 months ago

Does elevenlabs allow for local audio generation? Seeing as you ideally didn't want to rely on external apis?

Yes, I need to research what model I can use locally for a custom AI voice.