search

wandb / weave

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
https://wandb.me/weave
Apache License 2.0
697 stars 62 forks source link

fix: Improve TableQuery performance by adding a streaming interface #2619

Closed tssweeney closed 2 weeks ago

tssweeney commented 3 weeks ago

In order to support larger datasets, we need to intrude a streaming interface similar to calls that allow us to stream results from the server as opposed to sending the entire payload over the wire at once. This follows the exact same pattern as the Calls Query [Stream] methods.

The existing table_query path uses the new table_query_stream path which ensure that all existing tests for table_query are also exercising the new path.

circle-job-mirror[bot] commented 3 weeks ago

Preview this PR with FeatureBee: https://beta.wandb.ai/?betaVersion=740533323d18d9ed0ad7eb50f82f974ffa64a22d