search

geodocker / geodocker-accumulo-geomesa

A container for running accumulo with geomesa iterators installed
Apache License 2.0
3 stars 7 forks source link

Unable to ingest GDELT data #19

Open jawsthegame opened 7 years ago

jawsthegame commented 7 years ago

Following the instructions at http://www.geomesa.org/documentation/tutorials/geodocker-geomesa-spark-on-aws.html, I am hitting an error when attempting to ingest the public GDELT data:

$ docker exec accumulo-master geomesa ingest -c geomesa.gdelt -C gdelt -f gdelt -s gdelt -u root -p secret $FILES

Using GEOMESA_HOME = /opt/geomesa/tools
Creating schema gdelt
Running ingestion in distributed mode
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/lib/input/FileInputFormat
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:760)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    at org.locationtech.geomesa.tools.accumulo.ingest.ConverterIngestJob.<init>(ConverterIngest.scala:79)
    at org.locationtech.geomesa.tools.accumulo.ingest.ConverterIngest.runDistributedJob(ConverterIngest.scala:62)
    at org.locationtech.geomesa.tools.accumulo.ingest.AbstractIngest.runDistributed(AbstractIngest.scala:176)
    at org.locationtech.geomesa.tools.accumulo.ingest.AbstractIngest.run(AbstractIngest.scala:89)
    at org.locationtech.geomesa.tools.accumulo.commands.IngestCommand.execute(IngestCommand.scala:64)
    at org.locationtech.geomesa.tools.common.Runner$class.main(Runner.scala:26)
    at org.locationtech.geomesa.tools.accumulo.AccumuloRunner$.main(AccumuloRunner.scala:16)
    at org.locationtech.geomesa.tools.accumulo.AccumuloRunner.main(AccumuloRunner.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.lib.input.FileInputFormat
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 32 more

Anyone run into this before?