tspurway / hustle

A column oriented, embarrassingly distributed relational event database.
Other
240 stars 36 forks source link

Can't insert data with a huge number of partitions #26

Closed ncloudioj closed 10 years ago

ncloudioj commented 10 years ago

insert function failed when the input dataset has a large number of partitions (say, 1000+). It has something to do with the lmdb's lock table.

Since lmdb's readers and writers never show up together, turning on MDB_NOLOCK could fix this.