search

ClemensGruber / climart-gptree

MIT License
2 stars 1 forks source link

For testing latency install and run other GPTree like software as "Chat Toolkit" #31

Closed ClemensGruber closed 6 months ago

ClemensGruber commented 6 months ago

For testing ChatGPT response time, install

Chat Toolkit https://github.com/danb27/chat-toolkit, they also use Whisper for STT, and for TTS pyttsx3 (https://pypi.org/project/pyttsx3/)

and test how quickly ChatGPT answers.

ClemensGruber commented 6 months ago

I have tested only the chat / "input text via keyboard" variant, no STT, no TTS. just the ChatGPT API call and it was very fast, not longer than 2 seconds rather less, what confirms the numbers from https://github.com/ClemensGruber/climart_gptree/issues/24#issuecomment-1950323929 so same conclusion:

We have 20 to 40 seconds waiting time with GPTree so it seems as a bigger problemm in our implementation!