Chunk CRUD

[NolanTrem]

Introduces a number of improvements over chunk management.

---

[!IMPORTANT] Introduces CRUD operations for chunks, including new API endpoints, database updates, and integration tests.

• Behavior:
  • Adds CRUD operations for chunks, including ingestion, updating, and deletion.
  • New API endpoints in ingestion_router.py for ingest_chunks, update_chunk, and delete.
  • Integration tests added in runner_sdk.py for chunk operations.
• Database:
  • Updates PostgresVectorHandler in vector.py to support chunk retrieval and updates.
  • Adds get_chunk() and modifies get_document_chunks() to order by chunk_order.
• Services:
  • Implements update_chunk_ingress() in ingestion_service.py for updating chunk content and metadata.
  • Adds parse_update_chunk_input() in IngestionServiceAdapter.
• Orchestration:
  • Adds workflows for chunk operations in ingestion_workflow.py and simple/ingestion_workflow.py.
• SDK:
  • Adds updateChunk() method in r2rClient.ts and update_chunks() in ingestion.py for chunk updates.
• Misc:
  • Updates action.yml to include tests for chunk operations.

^{This description was created by for 578971a3d97099b9c3a280caa3bdcf7fb6515e84. It will automatically update as commits are pushed.}

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
yc_demo	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 24, 2024 11:48pm
yc-demo	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 24, 2024 11:48pm

1 Skipped Deployment

| Name | Status | Preview | Comments | Updated (UTC) | | :--- | :----- | :------ | :------- | :------ | | **recommendation_platform** | ⬜️ Ignored ([Inspect](https://vercel.com/my-team-88dd52c0/recommendation_platform/H38RxtFS6XoD19GCzXyX1Vvzy1xt)) | | | Oct 24, 2024 11:48pm |