truefoundry / cognita

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
https://cognita.truefoundry.com
Apache License 2.0
3.32k stars 274 forks source link

Run the indexer as a background job when running in local Cognita mode #319

Closed innoavator closed 2 months ago

innoavator commented 2 months ago

Currently when you create a collection locally, indexing is triggered automatically by frontend and it runs in the same process. As a result, collection creation blocks all other API calls Hence we would want indexing to start as a separate background process that does not block the collection creation.

Starting point is: