Closed CollectiveUnicorn closed 1 month ago
It appears like our API and EmbeddingsModel was in a fail loop which was causing a single request to repeat multiple times. After #885 the core issue described by this issue might be mitigated.
That said, I believe this issue should stay open. #885 might make this less painful, but it is still a painful thing that we should address.
Confirming that this still seems to be an issue even after #885 has been merged into main unfortunately
Describe what should be investigated or refactored
When hitting the endpoint to create or update VectorStores/Assistants there is a blocking operation that occurs with the indexing service. The implementation needs to be updated so that the indexing is run as a background job so that the user is not blocked waiting for the indexing to finish before being able to use an assistant.
Additional context
FastAPI background tasks are one way to do this. Indexing status is required before this can be done, as otherwise the frontend will be unable to determine when indexing has completed.