Closed emrgnt-cmplxty closed 6 days ago
[!IMPORTANT] Adds document summary generation to ingestion process and refactors search settings to SearchSettings. Behavior: Introduces document summary generation during ingestion in ingestion_service.py and ingestion_workflow.py. Adds augment_document_info() to generate summaries using LLM and store embeddings. Updates ingestion status to include AUGMENTING. Search Settings: Renames VectorSearchSettings and DocumentSearchSettings to SearchSettings across multiple files. Updates search methods to use SearchSettings in retrieval_service.py, retrieval_router.py, and vector_search_pipe.py. Database: Modifies PostgresDocumentHandler to include summary and summary_embedding fields. Adds full-text and semantic search capabilities in document.py. Configuration: Updates configuration files to include document summary settings. Adds default_summary.yaml for summary prompt configuration. Misc: Refactors search pipelines and pipes to accommodate new search settings. Updates API models and responses to reflect changes in document search results. This description was created by for 39c5faeed6c6eb3073f02f8e51288a7f02c17dd4. It will automatically update as commits are pushed.
[!IMPORTANT] Adds document summary generation to ingestion process and refactors search settings to SearchSettings.
SearchSettings
ingestion_service.py
ingestion_workflow.py
augment_document_info()
AUGMENTING
VectorSearchSettings
DocumentSearchSettings
retrieval_service.py
retrieval_router.py
vector_search_pipe.py
PostgresDocumentHandler
document.py
default_summary.yaml
This description was created by for 39c5faeed6c6eb3073f02f8e51288a7f02c17dd4. It will automatically update as commits are pushed.
The latest updates on your projects. Learn more about Vercel for Git ↗︎