oasysai / oasysdb

Hybrid vector database with flexible SQL storage engine & multi-index support.
https://docs.oasysdb.com/
Apache License 2.0
357 stars 12 forks source link

fix: large dirty io buffers with flush #84

Closed edwinkys closed 6 months ago

edwinkys commented 6 months ago

Purpose

This PR tries to solve the issue mention in issue #79 and discussion #77 where the database size on disk is overly large due repeated saving the collection causing all of the IO buffers to pile up.

Approach

This PR adds flush and async_flush method to the database struct.

Testing

Added 2 new tests for both Python and Rust test suites to test the flushes functionalities.

Chore checklist