search

tanelpoder / blog-comments

Comment repo for tanelpoder.com blog
3 stars 0 forks source link

Video: High Performance Block I/O on Linux | Tanel Poder Consulting #33

Open utterances-bot opened 1 year ago

utterances-bot commented 1 year ago

Video: High Performance Block I/O on Linux | Tanel Poder Consulting

Here’s the High Performance Block IO on Linux hacking session video. It’s based on my recent article about achieving 11M IOPS & 66 GB/s IO on a single ThreadRipper workstation. Enjoy! Towards the end of this video, I also explain how I got up to 11.5M IOPS without having to keep CPUs 100% busy, with batched I/O submission and completion checks I reduced the CPU usage pretty noticeably. Also, with properly configuring I/O polling queues in the Linux kernel, I got close to 10M IOPS by using just 10 CPUs (leaving almost 70% of CPU time idle). - Linux, Oracle, SQL performance tuning and troubleshooting - consulting & training.

https://tanelpoder.com/posts/high-performance-block-io-on-linux/

hetzbh commented 1 year ago

Great article and great video! Thanks! BTW, you mentioned that you'll do some benchmark with filesystems in the post. I have looked at your other posts and didn't find anything. Did you write it?

tanelpoder commented 1 year ago

Thanks! I haven't gotten to writing up any results unfortunately. Here's one article though that shows one effect of how journaled filesystems can get in the way of concurrent I/O at high IOPS:

https://tanelpoder.com/posts/high-system-load-low-cpu-utilization-on-linux/