search

specify / specify6

Source Code for Specify 6, Biological Collections Management Platform
https://specifysoftware.org
GNU General Public License v2.0
14 stars 6 forks source link

Improve the JVM memory configuration for Specify6 applications. #1084

Open timo11 opened 2 years ago

timo11 commented 2 years ago

The memory size arguments for the install4j launchers need to be modified.

maxpatiiuk commented 2 years ago

SpWizard refuses to open on a VM with 2gb of ram

Screen Shot 2021-10-06 at 3 02 38 PM

maxpatiiuk commented 2 years ago

4GB (4096 MB) worked fine. @timo11 would there be any point in reducing that -Xmin limit from 4GB down to something like 1 or 2? Or would that have some negative impact?

maxpatiiuk commented 2 years ago

I was able to upload the entire Tracheophyta through the wizard (~450k rows, from kingdom down to subspecies) Took around 20 minutes and 11GB of RAM (it was stable at 11gb though most of the taxon upload process. went down to 7gb after that) Though, I think I can make the file 25% smaller by removing redundant rows, which, hopefully, would reduce the memory consumption a little bit

Screen Shot 2021-10-07 at 1 08 26 PM Screen Shot 2021-10-07 at 1 06 36 PM Screen Shot 2021-10-07 at 1 13 42 PM Screen Shot 2021-10-07 at 1 14 15 PM
maxpatiiuk commented 2 years ago

Tried this on a 8GB RAM VM It crashed as soon as it got to Taxon Tree building stage

Memory usage rose to 7GB quickly, then grew slightly more slowly, and then the wizard just crashed

Last few log entries:

22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Division  Division  30
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Phylum  Phylum  30
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Subdivision  Subdivision  40
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Class  Class  60
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Subclass  Subclass  70
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Superorder  Superorder  90
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Order  Order  100
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Suborder  Suborder  110
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Family  Family  140
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Genus  Genus  180
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Species  Species  220
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - Subspecies  Subspecies  230
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - variety  variety  240
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - subvariety  subvariety  250
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - forma  forma  260
22:24:01 DEBUG specify.utilapps.BuildSampleDatabase:1456 - subforma  subforma  270
22:24:02 DEBUG specify.utilapps.BuildSampleDatabase:983 -  taxonWasBuilt true
22:24:02 DEBUG specify.utilapps.BuildSampleDatabase:1026 -  preLoadTaxon [true]
22:24:02 DEBUG specify.utilapps.BuildSampleDatabase:1027 -  fileName     [col2021_tracheophyta.xlsx]
Killed