jexp / batch-import

generic csv file neo4j batch importer
https://neo4j.com/docs/operations-manual/current/tools/import/
385 stars 157 forks source link

Cannot connect to graphdb created by batch-import tool in Windows OS #110

Open sjeremic opened 9 years ago

sjeremic commented 9 years ago

Hi, I used the batch-import tool to import data from csv files into graph.db . The import process completed without issues however when I attempt to switch the database created by the tool to local Neo4j server, the server fails to connect to database with following error message: Detected incorrectly shut down database, performing recovery.. At this time, I have no idea what is causing server to not accept the new database since there are no logs that are created during import process that would help me to understand if something went wrong during the import process. Questions: 1) Does the batch-import tool have capabilities to log events during importing process? if yes, how do I go about that? 2) How can I test the graph.db that was created by the tool to ensure that it is in valid state?

Additionally, the server is enterprise version and is running without issues when it is using another graph.db. Looking forward to your response. Thanks.

Snezana

jexp commented 9 years ago

Did you wait for the batch-inserter to finish?

The message from the server indicates that it performs recovery but not that it can't start.

Can you share graph.db/messages.log ?

sjeremic commented 9 years ago

I did wait on batch-inserter to finish - is there any particular indication that I suppose to acknowledge? I can share the messages.log – not sure where to attach it? Thanks.

Snezana

sjeremic commented 9 years ago

Messages.log: 2014-11-25 16:43:59.094+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b) 2014-11-25 16:43:59.131+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.134+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db.names hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.143+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.315+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b) 2014-11-25 16:43:59.340+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.353+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db.names hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.425+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.491+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b) 2014-11-25 16:43:59.492+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.494+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b) 2014-11-25 16:43:59.495+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.497+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.strings] brickCount=0 brickSize=209664b mappedMem=209715200b (storeSize=128b) 2014-11-25 16:43:59.498+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.index.keys] brickCount=0 brickSize=15694b mappedMem=15728640b (storeSize=38b) 2014-11-25 16:43:59.500+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.index] brickCount=0 brickSize=157284b mappedMem=15728640b (storeSize=0b) 2014-11-25 16:43:59.501+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.arrays] brickCount=0 brickSize=0b mappedMem=0b (storeSize=128b) 2014-11-25 16:43:59.514+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db] brickCount=0 brickSize=10737408b mappedMem=1073741824b (storeSize=0b) 2014-11-25 16:43:59.546+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshipstore.db] brickCount=0 brickSize=5242875b mappedMem=524288000b (storeSize=0b) 2014-11-25 16:43:59.547+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.nodestore.db.labels] brickCount=0 brickSize=0b mappedMem=0b (storeSize=68b) 2014-11-25 16:43:59.555+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.nodestore.db] brickCount=0 brickSize=1048572b mappedMem=104857600b (storeSize=0b) 2014-11-25 16:43:59.556+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.schemastore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=64b) 2014-11-25 16:43:59.559+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.605+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db.names hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.618+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.641+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db.names hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.658+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.686+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.strings hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.720+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.index.keys hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.745+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.index hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.775+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.arrays hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.797+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.812+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.relationshipstore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.835+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.nodestore.db.labels hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.858+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.nodestore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.873+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore.schemastore.db hit=0 miss=0 switches=0 ooe=0 2014-11-25 16:43:59.883+0000 INFO [org.neo4j]: C:\Snezana\NEO4j\Data\graph.db\neostore hit=0 miss=8 switches=0 ooe=0 2014-11-25 16:43:59.901+0000 INFO [org.neo4j]: Thread[main,5,main] Starting BatchInserter(EmbeddedBatchInserter[C:\Snezana\NEO4j\Data\graph.db]) 2014-11-25 16:43:59.904+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b) 2014-11-25 16:43:59.906+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshiptypestore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.908+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db.names] brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b) 2014-11-25 16:43:59.909+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.labeltokenstore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=0b) 2014-11-25 16:43:59.911+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.strings] brickCount=0 brickSize=209664b mappedMem=209715200b (storeSize=128b) 2014-11-25 16:43:59.913+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.index.keys] brickCount=0 brickSize=15694b mappedMem=15728640b (storeSize=38b) 2014-11-25 16:43:59.915+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.index] brickCount=0 brickSize=157284b mappedMem=15728640b (storeSize=0b) 2014-11-25 16:43:59.917+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db.arrays] brickCount=0 brickSize=0b mappedMem=0b (storeSize=128b) 2014-11-25 16:43:59.918+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.propertystore.db] brickCount=0 brickSize=10737408b mappedMem=1073741824b (storeSize=0b) 2014-11-25 16:43:59.920+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.relationshipstore.db] brickCount=0 brickSize=5242875b mappedMem=524288000b (storeSize=0b) 2014-11-25 16:43:59.922+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.nodestore.db.labels] brickCount=0 brickSize=0b mappedMem=0b (storeSize=68b) 2014-11-25 16:43:59.924+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.nodestore.db] brickCount=0 brickSize=1048572b mappedMem=104857600b (storeSize=0b) 2014-11-25 16:43:59.925+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore.schemastore.db] brickCount=0 brickSize=0b mappedMem=0b (storeSize=64b) 2014-11-25 16:43:59.928+0000 INFO [org.neo4j]: [C:\Snezana\NEO4j\Data\graph.db\neostore] brickCount=0 brickSize=0b mappedMem=0b (storeSize=63b) 2014-11-25 16:44:00.727+