[BUDI-7036] Timeout error when calling Chat GPT API

[cnrodrig]

• [ x] I have searched budibase discussions and github issues to check if my issue already exists

• Cloud

  • Tenant ID: unoafp

Describe the bug We are trying to integrate chat gpt with Budibase using chatgpt api. When we use short prompts it works but for larger prompts sometimes we get a timeout (10000 ms) EDIT: We have checked and sometimes with short prompts (that in Postman the response time is almost 0) we got the same error.

I understand that there is a QUERY_THREAD_TIMEOUT variable on self hosted deployments, but we don't know what to do in the cloud

To Reproduce Steps to reproduce the behavior:

1. Go to Data -> GPT-API source --> Test Prompt con texto completo Endpint
2. Click on Send

3. "Sometimes" we get the error (depends on the response time)

   • OS: Windows 11
   • Browser Chrome
   • Version 113.0.5672.127

_BUDI-7036

[mike12345567]

Hi @cnrodrig - our Cloud platform has a max timeout of 10 seconds in the Cloud - this is not configurable. If you wish to have a longer timeout then self hosting can be utilised, with the QUERY_THREAD_TIMEOUT environment variable set.