EveripediaNetwork / issues

Issues repo
9 stars 0 forks source link

Improving the speed of Response of iqgpt #1901

Closed Softdev1 closed 8 months ago

Softdev1 commented 9 months ago

Description

The speed of response upon query is an important factor/concern that has been gotten as a feedback from customers regarding the iqgpt platform, we want a way to improve the speed of response on the system.

Yadheedhya06 commented 9 months ago

https://www.pinecone.io/learn/fast-retrieval-augmented-generation/ https://www.pinecone.io/learn/nemo-guardrails-intro/

@Tolu-Mals may these resources help for this task 🧠

kesar commented 8 months ago

this kind of worries me. I am feeling responses are getting slower. Even tg bot used to be way faster. We need to investigate this properly. Perhaps we can assign other dev while Tolu focuses in the thing of uploading knowledge

kesar commented 8 months ago

it could be a good task for @AshakaE as well since he can probably create a temporal sentry account and profile the application to see why its taking so long to respond.

it also takes a lot just when we load iqgpt.com and I have the feeling something is related to SSR. This app should takes less than 1s to load since it barely needs db access

Softdev1 commented 8 months ago

this kind of worries me. I am feeling responses are getting slower. Even tg bot used to be way faster. We need to investigate this properly. Perhaps we can assign other dev while Tolu focuses in the thing of uploading knowledge

I have moved @AshakaE to oversee this task properly while @Tolu-Mals focuses on other things, I am currently testing tolu issues and still having bug , so it is best I have move @AshakaE here fully