Sweep: Add Support for Turbopuffer

[sweep-ai[bot]]

PR Feedback: 👎

Description

This pull request introduces support for Turbopuffer, a new database integration, into our project. It includes updates to dependencies, the addition of Turbopuffer as a recognized database in our naming conventions, and the implementation of export and import functionalities specific to Turbopuffer's data handling.

Summary

• Added turbopuffer[fast] to requirements.txt to include the necessary library for Turbopuffer operations.
• Updated src/vdf_io/names.py to include TURBOPUFFER in the DBNames class, acknowledging it as a supported database.
• Created src/vdf_io/turbopuffer.py which contains the logic for exporting to and importing from Turbopuffer databases. This includes:
  • Argument parsing for Turbopuffer-specific parameters.
  • Export functionality that iterates through indexes and yields documents.
  • Import functionality that batches documents for insertion into Turbopuffer.
• Enhanced src/vdf_io/util.py with a method create_turbopuffer_index_class to dynamically create Python classes based on Turbopuffer index schemas, and updated the standardize_metric function to support Turbopuffer's distance metrics.

Fixes #81.

---

🎉 Latest improvements to Sweep:

• New dashboard launched for real-time tracking of Sweep issues, covering all stages from search to coding.
• Integration of OpenAI's latest Assistant API for more efficient and reliable code planning and editing, improving speed by 3x.
• Use the GitHub issues extension for creating Sweep issues directly from your editor.

---

💡 To get Sweep to edit this pull request, you can:

• Comment below, and Sweep can edit the entire PR
• Comment on a file, Sweep will only modify the commented file
• Edit the original issue to get Sweep to recreate the PR from scratch

This is an automated message generated by Sweep AI.

[sweep-ai[bot]]

Rollback Files For Sweep

• [ ] Rollback changes to requirements.txt
• [ ] Rollback changes to src/vdf_io/names.py
• [ ] Rollback changes to src/vdf_io/turbopuffer.py
• [ ] Rollback changes to src/vdf_io/util.py

This is an automated message generated by Sweep AI.