tensorlakeai / indexify

A realtime serving engine for Data-Intensive Generative AI Applications
https://docs.tensorlake.ai
Apache License 2.0
931 stars 121 forks source link

Improve task reporting for lower latency and support for larger files #1049

Open seriousben opened 1 week ago

seriousben commented 1 week ago

In order to support multiple gigabyte sized files and lots of different function outputs, we need to change how Task Reporting is done.

A temporary fix was introduced in https://github.com/tensorlakeai/indexify/pull/1048.

Approaches brought up so far: