Not responding to questions (Bugs/Latency Issues)

[ChakshuGautam]

• [ ] Quality of answers is fine. Do a series of tests with @Amruth-Vamshi to see the logs.
  • [x] First shot works fine
  • [ ] Follow up questions
• [ ] Latency High => T2S on the frontend (Prateek), Translation - switch to Azure.
  • [x] S2T - Bhashini
  • [x] T2S - Bhashini - latency OK
  • [x] Translation hi to en - Azure
  • [x] Translation en to hi - Azure
  • [ ] Summarization/Reasoning - GPT 3.5 - Slow (24s)
• [x] @ChakshuGautam Web Whisper (T2S, S2T) as backup (not needed)

[aashutosh-samagra]

.

[ChakshuGautam]

POCs for Streaming responses

• [x] Stream text from GPT to client through WebSocket
• [x] Stream audio to the client through WebSocket

Bugs

• [ ] Update ChatHistory by calling an API
• [ ] Parsing issues - Sentence function update - every punctuation mark;
  • [ ] 1. is not handled
  • [ ] ... not handled
  • [ ] Pause not getting handled?

[ChakshuGautam]

• [ ] Details on time taken

[aashutosh-samagra]

• [ ] Search for docs latency is slow - @ChakshuGautam

[ChakshuGautam]

@aashutosh-samagra to add examples.