longhorn / longhorn

Cloud-Native distributed storage built on and for Kubernetes
https://longhorn.io
Apache License 2.0
6.17k stars 604 forks source link

[IMPROVEMENT] Investigate the impacts of SPDK settings such as hugepage, transport configuration and so on #5777

Open derekbit opened 1 year ago

derekbit commented 1 year ago

Is your improvement request related to a feature? Please describe (👍 if you like this request)

Although SPDK has numerous settings, Longhorn currently relies on the default options. To enhance our comprehension of SPDK intricacies, optimize performance, and balance tradeoffs, we need to identify the consequences of these settings and offer options to configure them as required.

Describe the solution you'd like

A clear and concise description of what you want to happen.

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've considered.

Additional context

Add any other context or screenshots about the feature request here.

l-mb commented 1 year ago

One issue with SPDK is that its polling mode will occupy one core at least (as far as I understand), which may be problematic for low-power edge setups.

See https://www.snia.org/educational-library/spdk-schedulers-%E2%80%93-saving-cpu-cores-polled-mode-storage-application-2021 and we may want/need to investigate tunables from this approach?