If an httpx session is not passed in, the default timeout of the created session is currently 5 seconds, which is too short for long LLM requests. Make the default 120 seconds instead. User can pass in their own httpx session if they wish to set a custom timeout.
If an httpx session is not passed in, the default timeout of the created session is currently 5 seconds, which is too short for long LLM requests. Make the default 120 seconds instead. User can pass in their own httpx session if they wish to set a custom timeout.