[Backend] Remove SyncFile and SyncActive

QuivrHQ / quivr

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

https://core.quivr.com

Other

36.47k stars 3.56k forks source link

[Backend] Remove SyncFile and SyncActive #3163

Closed linear[bot] closed 1 month ago

linear[bot] commented 1 month ago

Files from syncs should be treated like knowledge.
Coalesce Files from syncs added to knowledge in the Knowledge table
Determine when to add Files from Sync to knowledge table:
- KMS should call into Sync directly to list the files and get file properties
- Notion files are a special case ! We have to have them somewhere but retrieving all the pages is slow, we should stream the pages

linear[bot] commented 1 month ago

ENT-67 [Backend] Remove SyncFile and SyncActive