datacrypt-project / hitchhiker-tree

Functional, persistent, off-heap, high performance data structure
Eclipse Public License 1.0
1.19k stars 64 forks source link

Support for FoundationDB #34

Open cddr opened 6 years ago

cddr commented 6 years ago

Anyone wanna see this thing run on foundationdb?

It's a bit of a bear to build the language bindings at the moment so I doubt we'd want that complexity in here. I wonder if the core messaging would be useful as it's own as a library.

whilo commented 6 years ago

@cddr What is your idea about porting it? One way to do it would be to implement the konserve protocols (disclaimer: I am the main author of konserve.). I am wondering atm. what kind of high-throughput index datastructures one could use for datahike besides the hh-tree. Ideally we would like to have an index datastructure that can keep up with kafka style streams, e.g. to make our logs queryable. Eventual consistency would be fine there and since we only add stuff we are persistent anyway. (That is a bit naive, but I think this could provide a useful datalog experience beyond datomic).