Closed tomusher closed 2 months ago
Adds LiteLLM as a supported (default) backend which gives us:
This change also:
AIStreamingResponse
This PR will be followed up with a PR to add async/streaming support to the VectorIndex methods.
VectorIndex
Adds LiteLLM as a supported (default) backend which gives us:
This change also:
AIStreamingResponse
for handling streams.This PR will be followed up with a PR to add async/streaming support to the
VectorIndex
methods.