tensorlakeai / indexify

A realtime serving engine for Data-Intensive Generative AI Applications
https://docs.tensorlake.ai
Apache License 2.0
931 stars 121 forks source link

Running until done should retry waiting when getting transient errors #1043

Open seriousben opened 1 week ago

seriousben commented 1 week ago

graph.run(block_until_done=True, ...) should not fail for transient errors.

Examples transient errors:

httpx.RemoteProtocolError: peer closed connection without sending complete message body (incomplete chunked read)