elastic / elasticsearch

Free and Open, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.53k stars 24.61k forks source link

Improve concurrency of reads on Windows #82184

Open DaveCTurner opened 2 years ago

DaveCTurner commented 2 years ago

In this forum post I noticed that the JDK seems to serialize access to NIO-based files when running on Windows. In particular, the system in question had lots of concurrent fetch phases all waiting to obtain the same lock. I think there were other problems with this system too, without which this might not have been observable, but I'm raising an issue anyway to question whether we are doing the right thing on Windows or whether we can improve our access pattern (e.g. lean more heavily towards mmap) in this environment.

elasticmachine commented 2 years ago

Pinging @elastic/es-search (Team:Search)

devopsmystic commented 2 years ago

Hi all, we changed from Azul Zulu JDK8 to the bundled JDK15, issue still persists. Requesting for your support, as we are facing this in a Production env.

Regards, Madhu

DaveCTurner commented 2 years ago

This isn't the right place to seek production support @madhu-liferay; I'm not surprised that this affects newer JDKs although I'm grateful that you've confirmed this.

elasticsearchmachine commented 2 months ago

Pinging @elastic/es-search-foundations (Team:Search Foundations)