search

tensorlakeai / indexify

A realtime serving engine for Data-Intensive Generative AI Applications
https://docs.tensorlake.ai
Apache License 2.0
919 stars 118 forks source link

Peer connection timeout #972

Open sadath-12 opened 1 month ago

sadath-12 commented 1 month ago

Executors timeout the connection when executing long running workflow . Given this happens only while using https

ockhamlabs commented 1 month ago

@sadath-12 Can you confirm https is needed because of use of ingress of adding auth to the APIs

sadath-12 commented 3 weeks ago

@ockhamlabs that's right .

I tried to increase timeout via ingress configuration by setting up fields 

nginx.ingress.kubernetes.io/proxy-read-timeout: "1800"
nginx.ingress.kubernetes.io/proxy-send-timeout: "1800"
nginx.ingress.kubernetes.io/proxy-connect-timeout: "180"
nginx.ingress.kubernetes.io/proxy-buffering: "off"

I was able to process the file in https server , wondering if this is the right approach for the problem

diptanu commented 1 week ago

We are tacking this internally, we will have a solution soon for this