Add write amp rate limiter

[v01dstar]

This PR are following PRs combined:

• 3dc1b55d5ae28a4872dcbcb64c8731fec4c0e392
• 458bbd7f3d0ebc1887e05044c65e86fd9bebb6df
• ccf52153aee2f12df5a05cfd7c354fcfc9de202f
• f9aacb309221f027f90153c0524cfb6b1963eded
• 4751586b756fc449ea9ffd090844f4bfdff38655
• 8d6414ef21432e5f330c504891e6a85784459bcb
• db59a3f7aeb142823b410ad8e7beacaf3bf259af
• c0953b3c0ae24b9764149b3c364d1650c5850781
• 938c016175e84406888dfbf30c93844e9b124a3b

The WriteAmpBasedRateLimiter automatically adjusts rate limiting by predicting I/O trends using heuristic methods based on the write amplification factor. e.g. a high write throughput with HIGH priority (flush) implies, highly likely, there will be LOW priority write throughput soon, because RocksDB needs to compact the L0 files to lower levels, it is better to provision in advance. Compared to the default rate limiter, it reduces the likelihood of triggering write stalls and helps prevent I/O jitter.

Comments:

• Env::IOPriority has more options now, LOW, MID, HIGH, USER instead of just LOW and HIGH, write amplification rate limiter's tuning logic may need to adjust to this change.

[v01dstar]

/run-all-test

[purelind]

/run-all-tests

[purelind]

/run-all-tests

[v01dstar]

/run-all-tests

[v01dstar]

/run-all-tests

[v01dstar]

@hbisheng

[ti-chi-bot[bot]]

@LykxSassinator: adding LGTM is restricted to approvers and reviewers in OWNERS files.

In response to [this](https://github.com/tikv/rocksdb/pull/368#pullrequestreview-2321051558): >overall LGTM Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.

[ti-chi-bot[bot]]

@SpadeA-Tang: adding LGTM is restricted to approvers and reviewers in OWNERS files.

In response to [this](https://github.com/tikv/rocksdb/pull/368#pullrequestreview-2323908008): > Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.

[wuhuizuo]

wait for merging of #376.

[wuhuizuo]

/lgtm

refresh

[ti-chi-bot[bot]]

@wuhuizuo: adding LGTM is restricted to approvers and reviewers in OWNERS files.

In response to [this](https://github.com/tikv/rocksdb/pull/368#issuecomment-2370459178): >/lgtm > >refresh Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.

[ti-chi-bot[bot]]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: LykxSassinator, SpadeA-Tang, wuhuizuo

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/tikv/rocksdb/blob/8.10.tikv/OWNERS)~~ [LykxSassinator,SpadeA-Tang] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment

[ti-chi-bot[bot]]

[LGTM Timeline notifier]

Timeline:

• 2024-09-24 13:05:32.608226997 +0000 UTC m=+1571202.348650935: :heavy_multiplication_x::repeat: reset by ti-chi-bot.

[ti-chi-bot[bot]]

New changes are detected. LGTM label has been removed.

[v01dstar]

Merge https://github.com/tikv/rocksdb/pull/381 with this for future cherry-pick.