Python requests (by default) has no timeout. This can cause WAS to hang indefinitely waiting for a REST response. Set a connect timeout of 1s which will speedily address connection failures for blatantly misconfigured REST endpoints. Also set final response timeout to 30 seconds which is still long but plenty of time for an LLM, etc to respond.
Python requests (by default) has no timeout. This can cause WAS to hang indefinitely waiting for a REST response. Set a connect timeout of 1s which will speedily address connection failures for blatantly misconfigured REST endpoints. Also set final response timeout to 30 seconds which is still long but plenty of time for an LLM, etc to respond.