martinsumner / leveled

A pure Erlang Key/Value store - based on a LSM-tree, optimised for HEAD requests
Apache License 2.0
355 stars 32 forks source link

Adjust defaults to reflect higher vnode counts #360

Closed martinsumner closed 2 years ago

martinsumner commented 2 years ago

The default settings for the penciller_cache_size and cache_size were unscientific estimates of what would be helpful. The defaults do now lead to these processes carrying very large memory footprints.

Volume testing Riak recently, it was found that:

It would seem to be better to adjust defaults to reflect the fact there may be more penciller processes per node in the future.

martinsumner commented 2 years ago

Volume testing of https://github.com/basho/riak_kv/issues/1801 shows that higher vnode counts per node should be the default - as the main downside (2i query performance) has been addressed.

martinsumner commented 2 years ago

https://github.com/martinsumner/leveled/pull/367