when using a high core count cpu (32 in my case) the default values for process-threads (30) causes out of memory errors which stalls processing at some point
log should show some threads reporting "java.lang.OutOfMemoryError: Java heap space"
progress will stall before completion (assuming its waiting for the crashed threads)
Expected behavior
process eventually finishes
Screenshots and other files
CLI output seems a bit garbled but here's the relevant segment:
Exception in thread "processPool-thread-13" java.lang.OutOfMemoryError: Java heap space
at java.base/java.io.BufferedInputStream.<init>(Unknown Source)
at java.base/java.io.BufferedInputStream.<init>(Unknown Source)
at net.querz.mcaselector.io.mca.Chunk.load(Chunk.java:47)
at net.querz.mcaselector.io.mca.MCAFile.load(MCAFile.java:252)
at net.querz.mcaselector.io.mca.Region.loadRegion(Region.java:111)
at net.querz.mcaselector.io.mca.Region.loadRegion(Region.java:32)
at net.querz.mcaselector.io.job.ChunkFilterDeleter$MCADeleteFilterProcessJob.execute(ChunkFilterDeleter.java:78)
at net.querz.mcaselector.io.job.ProcessDataJob.run(ProcessDataJob.java:73)
at net.querz.mcaselector.io.JobHandler$WrapperJob.run(JobHandler.java:237)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
Exception in thread "processPool-thread-5" [03:01:05.112] failed to load any data from java.lang.OutOfMemoryError: Java heap space
r.-15.9.mca
88.56% r.-15.9.mca
[03:01:05.427] failed to load any data from Exception in thread "processPool-thread-32" r.-15.10.mcajava.lang.OutOfMemoryError: Java heap space
88.86% r.-15.10.mca
when using a high core count cpu (32 in my case) the default values for process-threads (30) causes out of memory errors which stalls processing at some point
To Reproduce Steps to reproduce the behavior:
Expected behavior process eventually finishes
Screenshots and other files CLI output seems a bit garbled but here's the relevant segment:
note: its not always at the same file