collabora / WhisperFusion

WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
1.45k stars 101 forks source link

Implemented ChatGPT LLM Backend #36

Open DamianB-BitFlipper opened 4 months ago

DamianB-BitFlipper commented 4 months ago

Instead of using Phi as the backend, which gave so-so responses, I substituted it with ChatGPT and it's own service class. I made it rhyme, which is fun twist.

image

It may be an interesting spin to this project.

evgeniishch commented 1 month ago

Hello! This is a very interesting feature, but I cannot figure out how to make it work, even on your branch. When I launch with docker, an error occurs saying it does not recognize --gpt argument. Seems like the main.py file file is not updated inside docker, but I could not figure out where the main.py is being copied to docker in the first place. The only thing being copied from local machine to docker are scripts inside scratch-space directory...

Could you please provide an instruction on launching with chatgpt backend?