[Feature] use io_uring for file io?

apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

https://doris.apache.org

Apache License 2.0

12.27k stars 3.2k forks source link

[Feature] use io_uring for file io? #7001

Open power1628 opened 2 years ago

power1628 commented 2 years ago

Search before asking

[X] I had searched in the issues and found no similar issues.

Description

Currently, Doris is using a buffered io interface to read/write files. Any plan try to leverage Linux io_uring feature to optimize file io?

Use case

No response

Related issues

No response

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

morningman commented 2 years ago

You mean io_uring? Looks like it needs a higher linux kernal version(5.0+)?

power1628 commented 2 years ago

@morningman yes, io_uring(sorry for typo) and higher linux kernel version. There's one PR from rocksdb community, using io_uring to improve performance. https://github.com/facebook/rocksdb/pull/5881

morningman commented 2 years ago

@morningman yes, io_uring(sorry for typo) and higher linux kernel version. There's one PR from rocksdb community, using io_uring to improve performance. facebook/rocksdb#5881

Thank, but at present, the kernel version in most of our environments has not reached 5.0, so this work may need to be completed later.