wagtail / wagtail-vector-index

Store Wagtail pages & Django models as embeddings in vector databases
https://wagtail-vector-index.readthedocs.io/en/latest/
MIT License
15 stars 10 forks source link

Feature/add litellm chat streaming test #77

Closed tomusher closed 4 weeks ago

tomusher commented 1 month ago

In some cases, such as when passing a mock_response to completion, LiteLLM returns a generator rather than a CustomStreamWrapper.

This doesn't seem to break anything except for tests, so this just adds a test and a fix for it - likely only useful for future tests.

tomusher commented 1 month ago

Looks like this only works with LiteLLM 1.41.15, so tests will pass once #76 is merged