wagtail / wagtail-vector-index

Store Wagtail pages & Django models as embeddings in vector databases
https://wagtail-vector-index.readthedocs.io/en/latest/
MIT License
20 stars 13 forks source link

Add streaming support for 'query' calls #48

Closed tomusher closed 2 months ago

tomusher commented 8 months ago

When building a 'chat'-like interface, it can be a nicer experience for responses to stream in rather than waiting for it all to be ready.

Implement a way to stream these responses, e.g. using server-sent events.

This should be an optional feature as it will likely require additional infrastructure.

tomusher commented 8 months ago

In progress on #28

Morsey187 commented 8 months ago

In review, theres a few issues related to ASGI that still needs to be resloved for the related intranet work being used to test this, however, I've set aside some time each day address this.

tomusher commented 2 months ago

Reviving this as #86