C-Nedelcu / talk-to-chatgpt

Talk to ChatGPT AI using your voice and listen to its answers through a voice
GNU Affero General Public License v3.0
1.97k stars 331 forks source link

Really appreciate your Chrome Extension #41

Closed 61t closed 1 year ago

61t commented 1 year ago

It's running smoothly. Thanks first.

I was wondering if you can add a new feature of supporting personal GCP/Azure API key to use more natural sounds.

One example is AwesomeTTS which is an Anki plugin to do exactly what I proposed. https://github.com/AwesomeTTS/awesometts-anki-addon

Maybe you can just "COPY" AwesomeTTS's business model and then charge a fee for people who don't want to manage CLOUD API but still want better natural sounds for ChatGPT.

Akis-M commented 1 year ago

This is exactly what I came here to say. We need more realistic voices to make the experience more immersive. The technology is already there. ElevenLabs etc... It's sad for such a great extension to hear voices from 1990 tech

C-Nedelcu commented 1 year ago

There is an issue with how most TTS APIs work and a reason why I can only get this to work properly under Chrome at the moment. In Chrome, you can basically push sentences to the TTS API stack, and the API will manage on its own. You can push several sentences at once, even while the current sentence is being spoken. The added sentences just pile up and are spoken one after the other.

From my trials with other APIs, they behave like this:

What's more, the scope of this addon is quite limited, it's basically an API experiment. It's in no way a long term professional product. I am happy to let anyone pick up the project and turn it into something greater, but I clearly lack the time and involvement to take this extension to the heights some users would want. The main issue being that with every update and iteration of ChatGPT, we come closer to an end. They will inevitably change the UI completely and the whole extension will become moot. And eventually, they will hopefully add proper TTS / STT functionality so that an extension like mine isn't needed.

These are the reasons why I am not currently considering adding external voices to the project. This project was basically to connect ChatGPT to the Chrome APIs (TTS/STT) and not much more. That being said I will gladly accept contributions to the projects, or forks, if anyone is willing to go down that road.

C-Nedelcu commented 1 year ago

Hello there,

I have added ElevenLabs API support in v2.6.0.

This version has not been submitted to the Chrome/edge stores yet, I think it would need some beta testing first. Would anyone please give it a try?

You have to install the new version manually, instructions are given on the project's home page.

I hope you enjoy it. I had fun testing it, the ElevenLabs voices are pretty great - even the default ones with a Free account.

C-Nedelcu commented 1 year ago

this has been live for a few days and seems to be working pretty great, so I'm going to close the issue :)