juji-io / datalevin

A simple, fast and versatile Datalog database
https://github.com/juji-io/datalevin
Eclipse Public License 1.0
1.13k stars 63 forks source link

Store spills in DBI #189

Closed huahaiy closed 1 year ago

huahaiy commented 1 year ago

Instead of storing each spill in a file, which may exhaust file descriptors, store each in a DBI, and move onto next LMDB file when this one used up all its DBIs.

huahaiy commented 1 year ago

May not be a good idea, as there is only a single writer.