Closed folterj closed 3 years ago
Hey @folterj, is the upgrade working properly with a smaller graph? From the description and a quick search about the error, it sounds like it could be a memory issue.
Could you check how much memory is Neo4j using right before that error is thrown? Also, does it help increasing the dbms.memory.heap.max_size
value in your neo4j.conf
file?
Thank you Angelo @nglgzz!
It appears this is now solved.
Things we tested:
Memory:
Using neo4j, Docker, and our own Java core code, optimising memory allocation gets quite complex, so we're relying on neo4j's auto configuration, which has worked better than trying to manually configure it. On a desktop with 16GB RAM, the idle spun up usage is about 2GB.
However it seems that neo4j Desktop (in contrast to neo4j server) automatically sets low limits by default: dbms.memory.heap.max_size=1G dbms.memory.heap.initial_size=512m dbms.memory.pagecache.size=512m
Whereas allowing neo4j to auto-configure - which is what we want and were expecting - sets: dbms.memory.heap.max_size 4278190080 bytes (4.3GB) dbms.memory.heap.initial_size 268435456 bytes (0.2GB) dbms.memory.pagecache.size 6416367616 bytes (6.4GB)
Some unresolved mysteries:
Thank you again for your help, I will post this on the neo4j community site as well.
Happy to hear it's solved!
For your first two questions, it's best to ask in the neo4j/neo4j repository. I'm not well versed on the DBMS internals, but my guesses would be:
For the last question, those are the default values to reduce the memory footprint of Neo4j Desktop. These should cover most development cases, but of course, you're welcome to change them if they don't work for you.
Using neo4j Desktop on Windows 10 64-bit, unable to upgrade from version 4.0.4 to version 4.1.0 or 4.1.1.
This applies to upgrading an exiting db from 4.0.x to 4.1.x, or loading a dump file or importing from cypher directly into blank 4.1.x. The same content runs fine in neo4j 4.1.1 enterprise server. The only condition we found that caused the issue, was a number of nodes of 2m / 4m labels [edited]. Also happy to provide log files etc. The neo4j log files don't appear to show relevant information, but the large Windows log file shows (part of a) stack trace, beyond the below extract.
Java exception error:
Small extract from mentioned Java log file:
Related information: https://community.neo4j.com/t/upgrade-fails-from-enterprise-4-0-4-to-4-1-0/20899/2