search

thinkaurelius / titan

Distributed Graph Database
http://titandb.io
Apache License 2.0
5.25k stars 1.01k forks source link

Titan 0.5.2 snapshot doesn't work on Hadoop 2 #844

Closed philmes closed 9 years ago

philmes commented 9 years ago

Attempting to test out #807 using a snapshot build of Titan 0.5.2 (commit SHA 34002ea0af81bd8723d390a694ac763e0cda9c53) results in the following exception when running a simple Hadoop job from the gremlin console:

    at com.thinkaurelius.titan.hadoop.formats.cassandra.TitanCassandraRecordReader.close(TitanCassandraRecordReader.java:75)
    at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.close(MapTask.java:500)
    at org.apache.hadoop.mapred.MapTask.closeQuietly(MapTask.java:1975)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:773)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
2014-11-24 11:08:12,318 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.IllegalArgumentException: Could not instantiate implementation: com.thinkaurelius.titan.hadoop.formats.util.input.current.TitanHadoopSetupImpl
    at com.thinkaurelius.titan.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:55)
    at com.thinkaurelius.titan.hadoop.formats.util.TitanInputFormat.getGraphSetup(TitanInputFormat.java:49)
    at com.thinkaurelius.titan.hadoop.formats.cassandra.TitanCassandraRecordReader.initialize(TitanCassandraRecordReader.java:44)
    at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1554)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at com.thinkaurelius.titan.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:44)
    ... 10 more
Caused by: java.lang.NoSuchMethodError: com.google.common.collect.Maps.immutableEnumMap(Ljava/util/Map;)Lcom/google/common/collect/ImmutableMap;
    at com.thinkaurelius.titan.diskstorage.Backend.<clinit>(Backend.java:552)
    at com.thinkaurelius.titan.graphdb.configuration.GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1258)
    at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:91)
    at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:81)
    at com.thinkaurelius.titan.hadoop.formats.util.input.current.TitanHadoopSetupImpl.<init>(TitanHadoopSetupImpl.java:39)
    ... 15 more

This is evidently a Guava compatibility issue, but Interesting this only explodes when I run it against a remote Hadoop cluster. Running locally works.

philmes commented 9 years ago

This is the classpath for the remote execution:

hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jbcrypt-0.3m.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/antlr-runtime-3.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/dom4j-1.6.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-client-1.9.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jets3t-0.6.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/httpmime-4.3.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-common-0.98.8-hadoop2-tests.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/gremlin-java-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-annotations-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-sslengine-6.1.26.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/spatial4j-0.4.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-codecs-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/snaptree-0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/kryo-2.22.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/concurrentlinkedhashmap-lru-1.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-test-framework-grizzly2-1.9.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/concurrent-1.3.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/noggit-0.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jamon-runtime-2.3.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/common-1.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/joni-2.1.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/thrift-server-0.3.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/msgpack-0.6.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-daemon-1.0.13.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-beanutils-1.7.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-berkeleyje-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-es-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-annotation-3.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/pfl-tf-tools-1.0.0-b001.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/htrace-core-2.04.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/blueprints-core-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-deploy-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-lang-2.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/zookeeper-3.4.6.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-beanutils-core-1.7.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/astyanax-recipes-1.56.48.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-core-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryalgebra-model-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/validation-api-1.0.0.GA.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/ivy-2.3.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-lucene-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-sail-nativerdf-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/antlr-3.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/netty-3.2.7.Final.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-guice-1.9.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-codec-1.7.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-jvm-3.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/groovy-shaded-asm-1.8.9.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/elasticsearch-hadoop-mr-2.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/linked-data-sail-1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-yarn-common-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/ripple-flow-rdf-1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-trig-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-sail-inferencer-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/guava-15.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-analyzers-common-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jboss-logging-3.1.2.GA.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/rexster-console-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/httpcore-4.2.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-mapreduce-client-jobclient-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-util-6.1.26.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-util-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-core-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-http-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-cassandra-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-framework-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/slf4j-api-1.7.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/guice-servlet-3.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/javassist-3.18.0-GA.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-turtle-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/wstx-asl-3.2.7.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jaxb-impl-2.2.3-1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-core-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hppc-0.6.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/je-5.0.73.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jamm-0.2.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-api-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/asm-commons-4.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-json-3.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-query-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/xml-apis-1.0.b2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/semargl-rdfa-0.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/protobuf-java-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jsch-0.1.42.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-servlets-3.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/reporter-config-2.1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/log4j-1.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-queryparser-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-core-2.2.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/pfl-basic-1.0.0-b001.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-portunif-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jaxb-api-2.2.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/rexster-core-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-misc-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-client-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-core-asl-1.9.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/solr-core-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-jmx-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/httpclient-4.2.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-webapp-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-http-servlet-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/paranamer-2.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-grouping-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jasper-compiler-5.5.23.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-rexster-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/solr-solrj-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/javax.servlet-3.0.0.v201112011016.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-6.1.26.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-server-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/stax-api-1.0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-databind-2.2.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-yarn-api-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-n3-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryresultio-api-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/org.restlet-2.1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-security-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-server-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/rexster-server-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/cassandra-thrift-2.0.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-rdfjson-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryalgebra-evaluation-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/org.apache.servicemix.bundles.commons-csv-1.0-r706900_3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/pipes-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-servlet-1.17.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-highlighter-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-healthchecks-3.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/management-api-3.0.0-b012.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-fileupload-1.2.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/javax.servlet-api-3.0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/cassandra-all-2.0.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-el-1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-core-3.0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/javax.json-1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/oncrpc-1.0.7.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/pfl-tf-1.0.0-b001.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hibernate-validator-4.3.0.Final.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jsr305-1.3.9.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/ripple-flow-1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/servlet-api-2.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/oro-2.0.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-xml-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-mapreduce-client-shuffle-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/netty-3.6.6.Final.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-ntriples-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-test-framework-core-1.9.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-math-2.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/gmbal-3.2.0-b003.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-suggest-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-http-client-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/ant-1.8.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-hadoop-compat-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jasper-runtime-5.5.23.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-grizzly2-1.18.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-hbase-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-jaxrs-1.9.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-jersey-3.0.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-hadoop2-compat-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-nquads-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-common-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/snappy-java-1.0.5-M3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-configuration-1.6.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-sail-api-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jettison-1.3.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-core-2.1.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/httpclient-cache-4.2.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-repository-sparql-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-join-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/high-scale-lib-1.1.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/reflections-0.9.9-RC1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/guice-3.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-client-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-datatypes-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-rdfxml-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-prefix-tree-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/gmetric4j-1.0.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-sail-memory-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-digester-1.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jsonld-java-0.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-net-1.4.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jsp-api-2.1-6.1.14.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-xc-1.9.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-analyzers-kuromoji-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/randomizedtesting-runner-2.0.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/ant-launcher-1.8.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jline-1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/xz-1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/colt-1.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hbase-protocol-0.98.8-hadoop2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jcodings-1.0.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/org.restlet.ext.servlet-2.1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/aopalliance-1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/blueprints-sail-graph-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-languages-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-compress-1.4.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/astyanax-thrift-1.56.48.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/json-20090211.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/gremlin-groovy-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryparser-sparql-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-http-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/libthrift-0.9.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-lang3-3.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jts-1.13.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryparser-serql-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jsonld-java-sesame-0.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-yarn-client-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/compress-lzf-0.8.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-cli-1.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-memory-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-trix-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/activation-1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/joda-time-1.6.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-annotations-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-server-1.18.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-mapreduce-client-core-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-collections-3.2.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-repository-api-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/snakeyaml-1.11.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/semargl-core-0.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/uuid-3.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/xmlenc-0.52.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/semargl-sesame-0.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-http-protocol-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/semargl-rdf-0.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/pfl-basic-tools-1.0.0-b001.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-rcm-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/repository-sail-1.8.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/avro-1.7.4.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-util-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/javax.inject-1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-spatial-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/super-csv-2.1.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jsp-2.1-6.1.14.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lz4-1.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-ganglia-3.0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-mapper-asl-1.9.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-json-1.18.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryparser-api-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-queries-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-solr-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-annotations-2.2.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/slf4j-log4j12-1.7.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/stax-api-1.0-2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jansi-1.5.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-servlet-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/metrics-graphite-3.0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jersey-core-1.18.2.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-queryresultio-sparqlxml-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/frames-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-hdfs-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/antlr-2.7.7.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/junit-benchmarks-0.7.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/servlet-api-2.5-6.1.14.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-io-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/elasticsearch-1.2.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/json-simple-1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-model-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-analyzers-phonetic-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/astyanax-core-1.56.48.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/sesame-rio-binary-2.7.10.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/rexster-protocol-2.5.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-sandbox-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-httpclient-3.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-mapreduce-client-common-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/asm-4.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-mapreduce-client-app-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jna-3.2.7.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/titan-hadoop-0.5.2-SNAPSHOT.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/astyanax-cassandra-1.56.48.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/disruptor-3.0.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/findbugs-annotations-1.3.9-1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jetty-continuation-8.1.10.v20130312.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/grizzly-http-server-2.2.16.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-io-2.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/lucene-expressions-4.8.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/ripple-base-1.1.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-yarn-server-common-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-pool-1.6.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/jackson-datatype-json-org-2.2.3.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/pfl-asm-1.0.0-b001.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/hadoop-common-2.2.0.jar
hdfs://preference-graph-1:8020/user/pmessenger/titanlib/commons-logging-1.1.1.jar
philmes commented 9 years ago

Some more rummaging suggests that this issue is because Hadoop itself depends on Guava. The suggestion is (surprise!) to shade the Guava dependency: https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/d5_HqUSvVl4

dalaro commented 9 years ago

Thanks for reporting this. I was able to reproduce it on a 2.2.0 pseudo-distributed cluster by running g.V().map out of a Cassandra graph.

The cause is a2149cec1d2d9b52b1bad596ef8cb1accdd2f3db, which introduced that immutableEnumMap call. I changed that to an ImmutableMaps.copyOf call (6205f7fa29b9faacd785285112c972b59deda13d). This particular NoSuchMethodError is no longer thrown and the map completes.

This is just a fix for this specific instance of the problem. The underlying problem of code brittleness related to Hadoop forcing Guava 11 is still there. I opened a separate issue to consider fixes for the general problem to prevent this class of errors from recurring: #845.