Feature/tweak downgrade logic

[emrgnt-cmplxty]

[!IMPORTANT] Enhance document ingestion and search by updating database schema, refining ingestion logic, and improving search settings.

• Database Migrations:
  • Add summary and summary_embedding columns to document_info in 2fac23e4d91b_migrate_to_document_search.py.
  • Create vectors table in d342e632358a_migrate_to_asyncpg.py.
  • Add indices for full-text and vector search.
• Ingestion Logic:
  • Update ingest_file_ingress() in ingestion_service.py to handle missing summaries.
  • Add error handling for missing summary column in document.py.
• Search and Retrieval:
  • Modify searchDocuments() in r2rClient.ts to use vector_search_settings.
  • Add embedding() function in retrieval.py for generating embeddings.
• Miscellaneous:
  • Update version in package.json to 0.3.16.
  • Refactor file handling in ingestion.py to use ExitStack for file operations.

^{This description was created by for 51bf82ee1a1c864c88ef264255516dafea35aeda. It will automatically update as commits are pushed.}

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
yc_demo	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 12, 2024 8:50pm
yc-demo	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 12, 2024 8:50pm

1 Skipped Deployment

| Name | Status | Preview | Comments | Updated (UTC) | | :--- | :----- | :------ | :------- | :------ | | **recommendation_platform** | ⬜️ Ignored ([Inspect](https://vercel.com/my-team-88dd52c0/recommendation_platform/Dxz5ZDufZjFFMgv7nP3ZyBwMzRyY)) | | | Nov 12, 2024 8:50pm |