Open alyons2008 opened 11 years ago
Gazetteer is not building correctly. The entire directory is only 6.33GB. I get a series of errors when I build the Gazetteer (shown in image) but it's still telling me that the build is successful. After I got these errors, I set these system variables:
Variable name: _JAVA_OPTIONS Variable value: -Xmx512M
and tried the build again. However, I let Gazetteer build for 22 hours and it never complete so I killed it..
Deleted _JAVA_OPTIONS and ran again to no avail.
Does anyone have a solution for this?
We'll pop in some stronger recommendations in the Gaz documentation:
-Xmx2g // or 3g are optimal RAM settings. Only 512m of RAM will prevent this from finishing.
Gazetteer/README.txt documents what you need to do. adapt your Gazetteer/build.properties file (copy of build.local.properties)
Also, You should build the Gazetteer on a decent server -- win or linux. 16 GB RAM and a free 500 GB. As you repeat this process raw data downloads , intermediary data files and final solr_home may consume 20 GB for a single build.... Then you want to zip it up and send it to someone, so that takes another 2 GB.
cheers, m
When I look at the output it only says headers. There is nothing actually pulled from the input file.