codelibs / elasticsearch-cluster-runner

Elasticsearch Cluster Launcher on One JVM Instance
Other
66 stars 17 forks source link

close > clean on Windows 10 leave cluster log files behind #46

Open bunchrt opened 2 years ago

bunchrt commented 2 years ago

I see we're doing the right calls: runner.close(); runner.clean();

so, I have to go in and occasionally blow out a ton of dead es-cluster dirs. clearly, something is holding the logs open.

versions this is observed: 7.8.0, 7.16.3.

thoughts?

...the logs of the test instance shown below.

[2022-02-17T14:41:57,077][INFO ][o.e.n.Node ] stopping ... [2022-02-17T14:41:57,241][INFO ][o.e.n.Node ] stopped [2022-02-17T14:41:57,244][INFO ][o.e.n.Node ] closing ... [2022-02-17T14:41:57,569][INFO ][o.e.n.Node ] closed [2022-02-17T14:41:57,573][INFO ][stdout ] Closed all nodes. [2022-02-17T14:42:50,913][INFO ][stdout ] C:\Users\me\AppData\Local\Temp\es-cluster5011564220758749820\node_1\logs\my_1645126760359.log: The process cannot access the file because it is being used by another process. [2022-02-17T14:42:50,916][INFO ][stdout ] Retring to delete it. [2022-02-17T14:42:51,933][INFO ][stdout ] C:\Users\me\AppData\Local\Temp\es-cluster5011564220758749820\node_1\logs\my_1645126760359.log: The process cannot access the file because it is being used by another process. [2022-02-17T14:42:51,937][INFO ][stdout ] Retring to delete it. [2022-02-17T14:42:52,958][INFO ][stdout ] C:\Users\me\AppData\Local\Temp\es-cluster5011564220758749820\node_1\logs\my_1645126760359.log: The process cannot access the file because it is being used by another process. [2022-02-17T14:42:52,961][INFO ][stdout ] Retring to delete it. [2022-02-17T14:42:53,975][INFO ][stdout ] Failed to delete C:\Users\me\AppData\Local\Temp\es-cluster5011564220758749820 in this process.

before and after:

me@___ MINGW64 ~/AppData/local/temp $ find es-*/ -type f es-cluster5011564220758749820/node_1/config/elasticsearch.yml es-cluster5011564220758749820/node_1/config/log4j2.properties es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/0/index/segments_2 es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/0/index/write.lock es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/0/translog/translog-2.tlog es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/0/translog/translog.ckp es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/0/_state/retention-leases-1.st es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/0/_state/state-0.st es-cluster5011564220758749820/node_1/data/nodes/0/indices/vqKweT4FQKmDAqZy5WEmow/_state/state-1.st es-cluster5011564220758749820/node_1/data/nodes/0/node.lock es-cluster5011564220758749820/node_1/data/nodes/0/_state/manifest-0.st es-cluster5011564220758749820/node_1/data/nodes/0/_state/node-0.st es-cluster5011564220758749820/node_1/data/nodes/0/_state/segments_a es-cluster5011564220758749820/node_1/data/nodes/0/_state/write.lock es-cluster5011564220758749820/node_1/data/nodes/0/_state/_5.cfe es-cluster5011564220758749820/node_1/data/nodes/0/_state/_5.cfs es-cluster5011564220758749820/node_1/data/nodes/0/_state/_5.si es-cluster5011564220758749820/node_1/data/nodes/0/_state/_7.cfe es-cluster5011564220758749820/node_1/data/nodes/0/_state/_7.cfs es-cluster5011564220758749820/node_1/data/nodes/0/_state/_7.si es-cluster5011564220758749820/node_1/logs/my_1645126760359.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_deprecation.json es-cluster5011564220758749820/node_1/logs/my_1645126760359_deprecation.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_indexing_slowlog.json es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_indexing_slowlog.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_search_slowlog.json es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_search_slowlog.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_server.json

me@___ MINGW64 ~/AppData/local/temp $ find es-*/ -type f es-cluster5011564220758749820/node_1/logs/my_1645126760359.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_deprecation.json es-cluster5011564220758749820/node_1/logs/my_1645126760359_deprecation.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_indexing_slowlog.json es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_indexing_slowlog.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_search_slowlog.json es-cluster5011564220758749820/node_1/logs/my_1645126760359_index_search_slowlog.log es-cluster5011564220758749820/node_1/logs/my_1645126760359_server.json

marevol commented 2 years ago

Thank you for the info. It'll be fixed in the next release.