Who's using LMDB for Java?

krisskross commented 8 years ago

Add comments on use case and good/bad experience as a user, open source project or company. Description of hardware, operating system, JVM spec, gotchas, opinions and other valuable information are welcome.

krisskross commented 8 years ago

No incident in one year of production use on virtualized Ubuntu precise Linux 3.13.0 running Java 8 and 7.

Use cases:

1) Queue for storing incoming traffic in protobuf format. A periodic job drains the queue and stores the data in HBase. 2) Immutable HBase query cache proxy for numeric id to string name lookup. 3) Immutable HBase query cache proxy for historical time series data.

Experience:

Excellent read and write performance using copy buffers (i.e not zero copy).
Sporadic MDB_BAD_RSLOT: Invalid reuse of reader locktable slot exceptions was fixed by setting Constants.NOTLS option on Env.open.
Development environment on Linux (debian, ubuntu) and OSX (Mountain Lion, Mavericks, Yosemite) works well.
The official LMDB documentation is excellent and very precise. Read it. Many times.
The Java API maps pretty well to the native LMDB C API. So it's necessary to understand the native API in order to troubleshoot the cause of a SIGSEGV (happens in some corner case violations) that otherwise may seem like bug.

mauricioscastro commented 8 years ago

starting to use it here. so far, so GREAT!, as soon as I have more info and data about the results in terms of performance, practicality, etc I will add them here. for the moment, thanks so much for this.

krisskross commented 8 years ago

RxLMDB is an open source project that provide a RxJava API to lmdbjni.

krisskross commented 8 years ago

Moving to Wiki.

deephacks / lmdbjni

Who's using LMDB for Java? #39