Tune the rocksdb configuration

[MaksymZavershynskyi]

Currenly our rocksdb configuration is copied from Parity. We need to make sure it is actually correctly configured for our usage. There are two groups of parameters:

• Parameters that depend on the type of the file system and OS we are running on: set_use_fsync, set_bytes_per_sync, etc;
• Parameters that depend on the type of the load we create on rocksdb, these are buffer&cache sizes, max number of opened files, sharding settings etc. These can be tuned by running https://github.com/nearprotocol/nearcore/tree/master/runtime/runtime-params-estimator and observing the cost of reading/writing into storage.

We also need to educate ourselves on what are the different types of compactions are offered by rocksdb and decide which one should we use.

[ailisp]

Some resources: rocksdb turning guide: https://github.com/facebook/rocksdb/wiki/Setup-Options-and-Basic-Tuning https://github.com/facebook/rocksdb/wiki/RocksDB-Tuning-Guide

Parity check disk is hd/ssd and set compaction params differently: https://github.com/paritytech/parity-common/blob/92ec1826884281820ebbbfc428e6c0fbdcccb9bf/kvdb-rocksdb/src/lib.rs#L110

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity in the last 2 months. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity in the last 2 months. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.