search

thinkaurelius / titan

Distributed Graph Database
http://titandb.io
Apache License 2.0
5.25k stars 1.01k forks source link

Titan.sh 5.0 not starting (Timeout) #790

Closed kivo360 closed 9 years ago

kivo360 commented 9 years ago

I'm trying to start titan.sh 5.0 on my Ubuntu 14.10 machine and it keeps giving me the response:

Forking Cassandra...
Running `nodetool statusthrift`............................... timeout exceeded (60 seconds)
See /home/kevin/Programming/TitanGraph/Version 5.0/titan-0.5.0-hadoop2/bin/../log/cassandra.log for Cassandra log output.

Any ideas on what's going on?

mbroecheler commented 9 years ago

What does the log say?

matthewbelisle-wf commented 9 years ago

Same problem here, with Titan 0.5.1 and a default install of Debian 7.7. Unfortunately there are no log files at all.

# ./bin/titan.sh start
Forking Cassandra...
Running `nodetool statusthrift`............................ timeout exceeded (60 seconds)
See /opt/titan/bin/../log/cassandra.log for Cassandra log output.
# ls log/
#
dalaro commented 9 years ago

What does titan.sh -v start say?

p-lewis commented 9 years ago

Hi, I'm seeing the same thing with titan 0.5.2. My output is below:

vagrant@vagrant-ubuntu-trusty-64:/vagrant/vendor/titan-0.5.2-hadoop2/bin$ ./titan.sh clean
Are you sure you want to delete all stored data and logs? [y/N] y
Deleted data in /vagrant/vendor/titan-0.5.2-hadoop2/db
Deleted logs in /vagrant/vendor/titan-0.5.2-hadoop2/log
vagrant@vagrant-ubuntu-trusty-64:/vagrant/vendor/titan-0.5.2-hadoop2/bin$ java -version
java version "1.8.0_25"
Java(TM) SE Runtime Environment (build 1.8.0_25-b17)
Java HotSpot(TM) 64-Bit Server VM (build 25.25-b02, mixed mode)
vagrant@vagrant-ubuntu-trusty-64:/vagrant/vendor/titan-0.5.2-hadoop2/bin$ sudo ./titan.sh -v start
Forking Cassandra...
Running `nodetool statusthrift`. INFO 05:04:51,152 Logging initialized
 INFO 05:04:51,419 Loading settings from file:/vagrant/vendor/titan-0.5.2-hadoop2/conf/cassandra.yaml
 INFO 05:04:52,800 Data files directories: [db/cassandra/data]
 INFO 05:04:52,802 Commit log directory: db/cassandra/commitlog
 INFO 05:04:52,803 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
 INFO 05:04:52,804 disk_failure_policy is stop
 INFO 05:04:52,805 commit_failure_policy is stop
 INFO 05:04:52,817 Global memtable threshold is enabled at 247MB
 INFO 05:04:53,075 Not using multi-threaded compaction
 INFO 05:04:53,612 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_25
 INFO 05:04:53,613 Heap size: 1038090240/1038090240
 INFO 05:04:53,615 Code Cache Non-heap memory: init = 2555904(2496K) used = 3727552(3640K) committed = 3801088(3712K) max = 251658240(245760K)
 INFO 05:04:53,616 Metaspace Non-heap memory: init = 0(0K) used = 14656672(14313K) committed = 14942208(14592K) max = -1(-1K)
 INFO 05:04:53,617 Compressed Class Space Non-heap memory: init = 0(0K) used = 1773824(1732K) committed = 1835008(1792K) max = 1073741824(1048576K)
 INFO 05:04:53,618 Par Eden Space Heap memory: init = 83886080(81920K) used = 83886080(81920K) committed = 83886080(81920K) max = 83886080(81920K)
 INFO 05:04:53,619 Par Survivor Space Heap memory: init = 10485760(10240K) used = 6802496(6643K) committed = 10485760(10240K) max = 10485760(10240K)
 INFO 05:04:53,640 CMS Old Gen Heap memory: init = 943718400(921600K) used = 0(0K) committed = 943718400(921600K) max = 943718400(921600K)
 INFO 05:04:53,645 Classpath: /vagrant/vendor/titan-0.5.2-hadoop2/conf:/vagrant/vendor/titan-0.5.2-hadoop2/build/classes/main:/vagrant/vendor/titan-0.5.2-hadoop2/build/classes/thrift:/vagrant/vendor/titan-0.5.2-hadoop2/lib/activation-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ant-1.8.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ant-launcher-1.8.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/antlr-2.7.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/antlr-3.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/antlr-runtime-3.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/aopalliance-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/asm-4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/asm-commons-4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-cassandra-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-core-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-recipes-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-thrift-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/avro-1.7.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/blueprints-core-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/blueprints-sail-graph-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/cassandra-all-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/cassandra-thrift-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/colt-1.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/common-1.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-beanutils-1.7.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-beanutils-core-1.7.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-cli-1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-codec-1.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-collections-3.2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-compress-1.4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-configuration-1.6.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-daemon-1.0.13.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-digester-1.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-el-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-fileupload-1.2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-httpclient-3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-io-2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-lang-2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-lang3-3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-logging-1.1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-math-2.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-net-1.4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-pool-1.6.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/compress-lzf-0.8.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/concurrent-1.3.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/concurrentlinkedhashmap-lru-1.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/disruptor-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/dom4j-1.6.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/elasticsearch-1.2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/elasticsearch-hadoop-mr-2.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/findbugs-annotations-1.3.9-1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/frames-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gmbal-3.2.0-b003.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gmetric4j-1.0.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gremlin-groovy-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gremlin-java-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-core-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-framework-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-http-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-http-server-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-http-servlet-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-portunif-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-rcm-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/groovy-shaded-asm-1.8.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/guava-15.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/guice-3.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/guice-servlet-3.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-annotations-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-auth-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-client-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-hdfs-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-app-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-core-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-jobclient-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-shuffle-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-api-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-client-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-server-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-annotations-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-client-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-common-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-common-0.98.8-hadoop2-tests.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-hadoop2-compat-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-hadoop-compat-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-prefix-tree-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-protocol-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-server-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hibernate-validator-4.3.0.Final.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/high-scale-lib-1.1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hppc-0.6.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/htrace-core-2.04.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpclient-4.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpclient-cache-4.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpcore-4.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpmime-4.3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ivy-2.3.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-annotations-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-core-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-core-asl-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-databind-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-datatype-json-org-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-jaxrs-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-mapper-asl-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-xc-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jamm-0.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jamon-runtime-2.3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jansi-1.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jasper-compiler-5.5.23.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jasper-runtime-5.5.23.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javassist-3.18.0-GA.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.inject-1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.json-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.servlet-3.0.0.v201112011016.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.servlet-api-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jaxb-api-2.2.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jaxb-impl-2.2.3-1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jbcrypt-0.3m.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jboss-logging-3.1.2.GA.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jcodings-1.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/je-5.0.73.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-client-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-core-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-grizzly2-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-guice-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-json-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-server-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-servlet-1.17.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-test-framework-core-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-test-framework-grizzly2-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jets3t-0.6.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jettison-1.3.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-6.1.26.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-continuation-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-deploy-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-http-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-io-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-jmx-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-security-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-server-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-servlet-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-sslengine-6.1.26.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-util-6.1.26.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-util-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-webapp-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-xml-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jline-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jna-3.2.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/joda-time-1.6.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/joni-2.1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsch-0.1.42.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/json-20090211.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsonld-java-0.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsonld-java-sesame-0.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/json-simple-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsp-2.1-6.1.14.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsp-api-2.1-6.1.14.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsr305-1.3.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jts-1.13.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/junit-benchmarks-0.7.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/kryo-2.22.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/libthrift-0.9.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/linked-data-sail-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/log4j-1.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-analyzers-common-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-analyzers-kuromoji-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-analyzers-phonetic-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-codecs-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-core-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-expressions-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-grouping-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-highlighter-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-join-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-memory-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-misc-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-queries-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-queryparser-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-sandbox-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-spatial-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-suggest-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lz4-1.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/management-api-3.0.0-b012.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-annotation-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-core-2.1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-core-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-ganglia-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-graphite-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-healthchecks-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-jersey-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-json-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-jvm-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-servlets-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/msgpack-0.6.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/netty-3.2.7.Final.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/netty-3.6.6.Final.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/noggit-0.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/oncrpc-1.0.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/org.apache.servicemix.bundles.commons-csv-1.0-r706900_3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/org.restlet-2.1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/org.restlet.ext.servlet-2.1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/oro-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/paranamer-2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-asm-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-basic-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-basic-tools-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-tf-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-tf-tools-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pipes-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/protobuf-java-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/randomizedtesting-runner-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/reflections-0.9.9-RC1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/reporter-config-2.1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/repository-sail-1.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-console-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-core-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-protocol-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-server-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ripple-base-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ripple-flow-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ripple-flow-rdf-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-core-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-rdf-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-rdfa-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-sesame-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/servlet-api-2.5-6.1.14.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/servlet-api-2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-http-client-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-http-protocol-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-model-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-query-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryalgebra-evaluation-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryalgebra-model-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryparser-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryparser-serql-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryparser-sparql-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryresultio-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryresultio-sparqlxml-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-repository-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-repository-sparql-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-binary-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-datatypes-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-languages-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-n3-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-nquads-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-ntriples-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-rdfjson-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-rdfxml-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-trig-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-trix-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-turtle-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-inferencer-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-memory-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-nativerdf-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-util-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/slf4j-api-1.7.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/slf4j-log4j12-1.7.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/snakeyaml-1.11.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/snappy-java-1.0.5-M3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/snaptree-0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/solr-core-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/solr-solrj-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/spatial4j-0.4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/stax-api-1.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/stax-api-1.0-2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/super-csv-2.1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/thrift-server-0.3.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-berkeleyje-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-cassandra-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-core-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-es-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-hadoop-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-hbase-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-lucene-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-rexster-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-solr-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/uuid-3.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/validation-api-1.0.0.GA.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/wstx-asl-3.2.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/xml-apis-1.0.b2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/xmlenc-0.52.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/xz-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/zookeeper-3.4.6.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jamm-0.2.5.jar
 INFO 05:04:54,676 JNA mlockall successful
ERROR 05:04:54,695 Directory db/cassandra/data doesn't exist
.ERROR 05:04:54,710 Directory db/cassandra/commitlog doesn't exist
ERROR 05:04:54,716 Directory db/cassandra/saved_caches doesn't exist
 INFO 05:04:54,732 Initializing key cache with capacity of 49 MBs.
 INFO 05:04:54,763 Scheduling key cache save to each 14400 seconds (going to save all keys).
 INFO 05:04:54,769 Initializing row cache with capacity of 0 MBs
 INFO 05:04:54,856 Scheduling row cache save to each 0 seconds (going to save all keys).
 INFO 05:04:56,240 Initializing system.sstable_activity
 INFO 05:04:56,407 Initializing system.hints
 INFO 05:04:56,429 Initializing system.NodeIdInfo
 INFO 05:04:56,461 Initializing system.compaction_history
 INFO 05:04:56,483 Initializing system.peers
 INFO 05:04:56,509 Initializing system.schema_columnfamilies
 INFO 05:04:56,540 Initializing system.IndexInfo
 INFO 05:04:56,560 Initializing system.local
 INFO 05:04:56,581 Initializing system.schema_triggers
 INFO 05:04:56,609 Initializing system.schema_columns
 INFO 05:04:56,627 Initializing system.batchlog
 INFO 05:04:56,650 Initializing system.peer_events
 INFO 05:04:56,664 Initializing system.paxos
 INFO 05:04:56,700 Initializing system.compactions_in_progress
 INFO 05:04:56,718 Initializing system.range_xfers
 INFO 05:04:56,735 Initializing system.schema_keyspaces
............ timeout exceeded (60 seconds)
See /vagrant/vendor/titan-0.5.2-hadoop2/bin/../log/cassandra.log for Cassandra log output.
vagrant@vagrant-ubuntu-trusty-64:/vagrant/vendor/titan-0.5.2-hadoop2/bin$ ./titan.sh status
Titan + Rexster (com.tinkerpop.rexster.Application) does not appear in the java process table
Cassandra (org.apache.cassandra.service.CassandraDaemon) does not appear in the java process table
Elasticsearch (org.elasticsearch.bootstrap.Elasticsearch) does not appear in the java process table

I've got a vagrant virtualbox setup I can push somewhere if that would be helpful in debugging.

dalaro commented 9 years ago

@p-lewis this might be separate from @matthewbelisle-wf issue -- can't tell quite yet.

After running sudo ./titan.sh -v start and getting the timeout you pasted, what does sudo bin/nodetool statusthrift print? Is it any different from what bin/nodetool statusthrift (i.e. same command but without sudo) prints under the same conditions?

titan.sh forks Cassandra, then goes into a loop where it sleeps and runs bin/nodetool statusthrift until it either prints running or until the timeout is exceeded.

p-lewis commented 9 years ago

After receiving the "timeout exceeded" message (as before):

titan-0.5.2-hadoop2$ sudo bin/nodetool statusthrift
not running
titan-0.5.2-hadoop2$ bin/nodetool statusthrift
not running
titan-0.5.2-hadoop2$
dalaro commented 9 years ago

I think that means nodetool successfully connected on Cassandra's JMX port (tcp/7199), but Cassandra hadn't finished starting up and opening its Thrift listen socket (or something like that). The startup log you pasted for Cassandra also seems to end very abruptly... after all those "Initializing" lines, Cassandra should print something like this:

 INFO 11:58:51,879 Couldn't detect any schema definitions in local storage.
 INFO 11:58:51,880 To create keyspaces and column families, see 'help create' in cqlsh.
 INFO 11:58:51,912 Enqueuing flush of Memtable-local@1125995845(160/1600 serialized/live bytes, 5 ops)
...

In what you pasted, Cassandra appears to just go quiet after the "Initializing lines" instead of proceeding with the rest of the startup code. I think Cassandra is getting stuck during startup for some reason. bin/cassandra -f will run just the Cassandra daemon, if you want to try it without titan.sh.

What happens when you download the official apache-cassandra-2.0.8.tar.gz distro, extract it, and run bin/cassandra -f from its root? If that works fine, then it would suggest something is broken in Titan's scripts or environment variable tweaks.

p-lewis commented 9 years ago

With the official apache-cassandra-2.0.8.tar.gz, it seems to work as expected.

apache-cassandra-2.0.8$ sudo ./bin/cassandra -f
 INFO 15:30:28,950 Logging initialized
 INFO 15:30:29,034 Loading settings from file:/vagrant/vendor/apache-cassandra-2.0.8/conf/cassandra.yaml
 INFO 15:30:29,632 Data files directories: [/var/lib/cassandra/data]
 INFO 15:30:29,634 Commit log directory: /var/lib/cassandra/commitlog
 INFO 15:30:29,634 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
 INFO 15:30:29,635 disk_failure_policy is stop
 INFO 15:30:29,636 commit_failure_policy is stop
 INFO 15:30:29,649 Global memtable threshold is enabled at 247MB
 INFO 15:30:29,845 Not using multi-threaded compaction
 INFO 15:30:30,229 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_25
 INFO 15:30:30,229 Heap size: 1038090240/1038090240
 INFO 15:30:30,230 Code Cache Non-heap memory: init = 2555904(2496K) used = 3305344(3227K) committed = 3342336(3264K) max = 251658240(245760K)
 INFO 15:30:30,230 Metaspace Non-heap memory: init = 0(0K) used = 14186400(13853K) committed = 14417920(14080K) max = -1(-1K)
 INFO 15:30:30,231 Compressed Class Space Non-heap memory: init = 0(0K) used = 1719840(1679K) committed = 1835008(1792K) max = 1073741824(1048576K)
 INFO 15:30:30,232 Par Eden Space Heap memory: init = 83886080(81920K) used = 52269600(51044K) committed = 83886080(81920K) max = 83886080(81920K)
 INFO 15:30:30,232 Par Survivor Space Heap memory: init = 10485760(10240K) used = 0(0K) committed = 10485760(10240K) max = 10485760(10240K)
 INFO 15:30:30,233 CMS Old Gen Heap memory: init = 943718400(921600K) used = 0(0K) committed = 943718400(921600K) max = 943718400(921600K)
 INFO 15:30:30,234 Classpath: ./bin/../conf:./bin/../build/classes/main:./bin/../build/classes/thrift:./bin/../lib/antlr-3.2.jar:./bin/../lib/apache-cassandra-2.0.8.jar:./bin/../lib/apache-cassandra-clientutil-2.0.8.jar:./bin/../lib/apache-cassandra-thrift-2.0.8.jar:./bin/../lib/commons-cli-1.1.jar:./bin/../lib/commons-codec-1.2.jar:./bin/../lib/commons-lang3-3.1.jar:./bin/../lib/compress-lzf-0.8.4.jar:./bin/../lib/concurrentlinkedhashmap-lru-1.3.jar:./bin/../lib/disruptor-3.0.1.jar:./bin/../lib/guava-15.0.jar:./bin/../lib/high-scale-lib-1.1.2.jar:./bin/../lib/jackson-core-asl-1.9.2.jar:./bin/../lib/jackson-mapper-asl-1.9.2.jar:./bin/../lib/jamm-0.2.5.jar:./bin/../lib/jbcrypt-0.3m.jar:./bin/../lib/jline-1.0.jar:./bin/../lib/json-simple-1.1.jar:./bin/../lib/libthrift-0.9.1.jar:./bin/../lib/log4j-1.2.16.jar:./bin/../lib/lz4-1.2.0.jar:./bin/../lib/metrics-core-2.2.0.jar:./bin/../lib/netty-3.6.6.Final.jar:./bin/../lib/reporter-config-2.1.0.jar:./bin/../lib/servlet-api-2.5-20081211.jar:./bin/../lib/slf4j-api-1.7.2.jar:./bin/../lib/slf4j-log4j12-1.7.2.jar:./bin/../lib/snakeyaml-1.11.jar:./bin/../lib/snappy-java-1.0.5.jar:./bin/../lib/snaptree-0.1.jar:./bin/../lib/super-csv-2.1.0.jar:./bin/../lib/thrift-server-internal-only-0.3.3.jar:./bin/../lib/jamm-0.2.5.jar
 INFO 15:30:30,237 JNA not found. Native methods will be disabled.
ERROR 15:30:30,253 Directory /var/lib/cassandra/data doesn't exist
ERROR 15:30:30,260 Directory /var/lib/cassandra/commitlog doesn't exist
ERROR 15:30:30,261 Directory /var/lib/cassandra/saved_caches doesn't exist
 INFO 15:30:30,269 Initializing key cache with capacity of 49 MBs.
 INFO 15:30:30,286 Scheduling key cache save to each 14400 seconds (going to save all keys).
 INFO 15:30:30,288 Initializing row cache with capacity of 0 MBs
 INFO 15:30:30,301 Scheduling row cache save to each 0 seconds (going to save all keys).
 INFO 15:30:30,418 Initializing system.sstable_activity
 INFO 15:30:30,458 Initializing system.hints
 INFO 15:30:30,465 Initializing system.NodeIdInfo
 INFO 15:30:30,478 Initializing system.compaction_history
 INFO 15:30:30,482 Initializing system.peers
 INFO 15:30:30,494 Initializing system.schema_columnfamilies
 INFO 15:30:30,503 Initializing system.IndexInfo
 INFO 15:30:30,507 Initializing system.local
 INFO 15:30:30,511 Initializing system.schema_triggers
 INFO 15:30:30,521 Initializing system.schema_columns
 INFO 15:30:30,526 Initializing system.batchlog
 INFO 15:30:30,545 Initializing system.peer_events
 INFO 15:30:30,546 Initializing system.paxos
 INFO 15:30:30,551 Initializing system.compactions_in_progress
 INFO 15:30:30,556 Initializing system.range_xfers
 INFO 15:30:30,571 Initializing system.schema_keyspaces
 INFO 15:30:30,947 Couldn't detect any schema definitions in local storage.
 INFO 15:30:30,949 To create keyspaces and column families, see 'help create' in cqlsh.
 INFO 15:30:31,018 Enqueuing flush of Memtable-local@566113173(149/1490 serialized/live bytes, 5 ops)
 INFO 15:30:31,050 Writing Memtable-local@566113173(149/1490 serialized/live bytes, 5 ops)
 INFO 15:30:31,129 Completed flushing /var/lib/cassandra/data/system/local/system-local-jb-1-Data.db (177 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=399)
 INFO 15:30:31,156 No commitlog files found; skipping replay
 INFO 15:30:31,485 Cassandra version: 2.0.8
 INFO 15:30:31,486 Thrift API version: 19.39.0
 INFO 15:30:31,491 CQL supported versions: 2.0.0,3.1.6 (default: 3.1.6)
 INFO 15:30:31,493 CFS(Keyspace='system', ColumnFamily='schema_columnfamilies') liveRatio is 6.377611306328919 (just-counted was 2.7552226126578367).  calculation took 30ms for 400 cells
 INFO 15:30:31,520 CFS(Keyspace='system', ColumnFamily='schema_columns') liveRatio is 6.394767070835992 (just-counted was 2.7895341416719845).  calculation took 26ms for 770 cells
 INFO 15:30:31,565 Loading persisted ring state
 WARN 15:30:31,793 No host ID found, created 6115c21c-12a2-4ec9-b9ad-0efbf823b691 (Note: This should happen exactly once per node).
 INFO 15:30:31,811 Starting up server gossip
 INFO 15:30:31,814 Enqueuing flush of Memtable-local@1581078471(320/3200 serialized/live bytes, 12 ops)
 INFO 15:30:31,815 Writing Memtable-local@1581078471(320/3200 serialized/live bytes, 12 ops)
 INFO 15:30:31,821 Completed flushing /var/lib/cassandra/data/system/local/system-local-jb-2-Data.db (303 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=82610)
 INFO 15:30:31,874 Starting Messaging Service on port 7000
 INFO 15:30:31,896 This node will not auto bootstrap because it is configured to be a seed node.
 INFO 15:30:31,906 Generated random tokens. tokens are [-1237635629649050290, 7919694976773529972, -1009297990083630165, 792637939550029162, -3025067747870150058, 7737788110803799957, -7109691001440881478, 9188617819267578614, 8728489856243378837, -5013467821283875726, -3169646248581808579, -1683762341728292174, 1937079023996640975, 1790747597010940300, 6688468902742600435, -5766697465953507744, 1973322573329857467, 5501933512790300340, -300474285613475817, -4715180147928651607, -5082807475992197357, 1273451215305561005, 4563534763759248336, -4643314002524677162, 755157747049884158, -2562605667191897986, -4512905862340961022, 5271551930633573870, -2019246082570852889, 3827913760459946338, 1565748232071974500, -1988912790919731325, -1308572423647675815, -5478935714455278082, -3151452787671170022, -5161367435178301610, 739164383171063699, -3550845646226953668, -5928007365904890357, -6491781979265831032, 4031955155163140543, 6799149683582751245, -6222256636536645978, 8289390744017841152, -992789106853345055, 4074173318504816947, 2305250913740234578, -1855305041963482606, -4640757428205106357, -8439470050331605176, 5724578400252926280, -340002861815827242, 4384830407385926203, -3258996517213396976, -4696583124088545604, -7274560607970348862, 3047992532982263219, -6367509573739291201, 2515941296598989486, -2381368513652505602, 6942083092311873897, -5721845187453502452, -7017663454311397164, -5006764183896489414, -2655250047744114223, 6360516442438781779, 1222710326866470651, 7725859806349330627, 776746489801952682, 3155474632906919938, -1817393997165607525, -7233307197916061554, -2733949713336017545, 5302080805511209357, 5466063856646443602, -5859994388507440855, 6712815176691855862, 5600937060786694198, 1318707446215419884, -8128010812855234158, 3461301033584453926, -495110732370825625, -7179791770919517563, 3774192943927419436, -7695072493124338252, -1905165905879999678, 2757435196603643110, 8668530766958326579, 2888049325635605856, 2222328632184099299, -2828459136511045127, 1080368522022803603, 787665444979277318, 6171612215304534332, 3154926617040436074, -6933138660367802288, -2867914934718872051, 770075992774937461, 1830365498620775944, -7135329865228578595, -7082282363955034675, 3457289978474480558, -3619303873170475465, 7716945116761864363, 9053807318289919787, -1485292040182141860, -7682143773277779177, -1370423250028794503, 2732570337533980515, 2258565162834339913, -7580971568780706564, 7156009934725491431, 2229751265433363307, -201791654223922389, 283408550145313813, -286783457593491058, -6018036616360139849, -7652965540106000174, -5855042618685394469, -5976791097420598659, 8962611038371097061, -5630736212665984474, -2553971583134539037, 3282358622513347315, 8963423993744408189, -5781724183455642485, -5616412436229536197, 5081574863469914534, 2715517707596950820, 1379890470156224581, -4992764229949896778, 6294467697511427325, 4691691855710117947, -3143908776869855927, 7441896095426036114, 8552513541817352503, 4990546977924538461, 4005624502150651548, -7282219506185175700, 4563018958535173914, -466495411541829160, 4050832391044006775, 3660889894430147943, 2406315778496102826, 395818880891547561, 1628614476509630932, -1788266029175174482, 3492197568418667351, -5682124672205419973, -5529604364633643571, 2213031372551646823, 1973829922417192749, 5514571879562141166, -2167466002427737240, -4160473303058710707, -195226179552252325, -7563239567752072324, 4499926931161500648, 7166814296061230604, 3489578733128264664, 1610625877968952501, 4818907857675888877, -3326392706443083619, -4233929892759224548, -7767230035295320736, -7064262609431212828, -2313972447025158153, -8365258863125960452, -2051639206078386269, -5618403425304882867, -6445159109151104996, -5290988005099767168, -7077207264552046229, 7278793580867967844, 21707741149065755, 4057505484345282108, 8716828969489965611, -8840661427037130073, 8585934105521932641, 407582227649882308, 7362371308099484430, 433343855024252668, -9154562179370918969, -4133379462378570819, -5916728593136259142, -5077301049154099710, 5842243894984689263, 1218055973586954950, 4270615576926492386, -2950539243075140892, -2551936266481770384, 1239775549693960117, -7047435690322525894, 1621411366944263051, -7902388558673688206, -8534916518768107166, 9054329871638076386, 46721947983481410, 600411585780973426, -4086963455096030637, 7811869064158592868, -4949446281367661515, -322926134782862346, 5634552158270977738, -1488555468437226693, 6245729606036566568, 846857114482781697, 509310538738023030, -4349466723397909921, -272002580576650740, -6915311118918364367, -2055707853924812640, 3266609497534874289, -8665998655021511319, -5964587159630796951, 3048714710821910590, 3838009990820794980, 7034520987848487953, -1770678042852495541, 4950613782781754056, 879375494243470417, -3553475388481133429, -5748823734293522480, 613035257029280609, -3099911938364565758, 9082893935714696335, -2683558910426567123, 1240423418562797708, -3472434825880501458, 8769917908726116129, 923173008346136904, -7298367088220373370, 5129396903989999587, 6436948794619948282, -4550494584962869070, 6599975504136112852, 4263128182435119235, 1731833478072443424, -8682107493063840444, -192624479767486996, 4213156258680265521, 5211855944270433897, 2330412260496981299, 5056271985586664440, 2944976236407149171, -3679363214078886772, -4029690276871065163, 7361600828508047940, 6483769433964491524, 8192843988235887757, 3109183494790964667, -1512309546207260311, 4605596775503923543, 699327549701673826, -4704101247576641757, 2070050978603542461]
 INFO 15:30:31,925 Create new Keyspace: system_traces, rep strategy:SimpleStrategy{org.apache.cassandra.config.CFMetaData@20ca951f[cfId=c5e99f16-8677-3914-b17e-960613512345,ksName=system_traces,cfName=sessions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.ColumnToCollectionType(706172616d6574657273:org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type))),comment=traced sessions,readRepairChance=0.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,column_metadata={java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=73657373696f6e5f6964, validator=org.apache.cassandra.db.marshal.UUIDType, type=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=11 cap=11]=ColumnDefinition{name=636f6f7264696e61746f72, validator=org.apache.cassandra.db.marshal.InetAddressType, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=7 cap=7]=ColumnDefinition{name=72657175657374, validator=org.apache.cassandra.db.marshal.UTF8Type, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=737461727465645f6174, validator=org.apache.cassandra.db.marshal.TimestampType, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=706172616d6574657273, validator=org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type), type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=6475726174696f6e, validator=org.apache.cassandra.db.marshal.Int32Type, type=REGULAR, componentIndex=0, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtable_flush_period_in_ms=3600000,caching=KEYS_ONLY,defaultTimeToLive=0,speculative_retry=99.0PERCENTILE,indexInterval=128,populateIoCacheOnFlush=false,droppedColumns={},triggers={}], org.apache.cassandra.config.CFMetaData@51133c06[cfId=8826e8e9-e16a-3728-8753-3bc1fc713c25,ksName=system_traces,cfName=events,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.TimeUUIDType,org.apache.cassandra.db.marshal.UTF8Type),comment=,readRepairChance=0.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,column_metadata={java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=6163746976697479, validator=org.apache.cassandra.db.marshal.UTF8Type, type=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=746872656164, validator=org.apache.cassandra.db.marshal.UTF8Type, type=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=73657373696f6e5f6964, validator=org.apache.cassandra.db.marshal.UUIDType, type=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=6576656e745f6964, validator=org.apache.cassandra.db.marshal.TimeUUIDType, type=CLUSTERING_KEY, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=736f75726365, validator=org.apache.cassandra.db.marshal.InetAddressType, type=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=14 cap=14]=ColumnDefinition{name=736f757263655f656c6170736564, validator=org.apache.cassandra.db.marshal.Int32Type, type=REGULAR, componentIndex=1, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtable_flush_period_in_ms=3600000,caching=KEYS_ONLY,defaultTimeToLive=0,speculative_retry=99.0PERCENTILE,indexInterval=128,populateIoCacheOnFlush=false,droppedColumns={},triggers={}]}, strategy_options: {replication_factor=2}, durable_writes: true
 INFO 15:30:32,068 Enqueuing flush of Memtable-schema_keyspaces@138191858(251/2510 serialized/live bytes, 7 ops)
 INFO 15:30:32,074 Writing Memtable-schema_keyspaces@138191858(251/2510 serialized/live bytes, 7 ops)
 INFO 15:30:32,081 Completed flushing /var/lib/cassandra/data/system/schema_keyspaces/system-schema_keyspaces-jb-1-Data.db (216 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=91345)
 INFO 15:30:32,082 Enqueuing flush of Memtable-schema_columnfamilies@1295924369(28865/184089 serialized/live bytes, 451 ops)
 INFO 15:30:32,083 Writing Memtable-schema_columnfamilies@1295924369(28865/184089 serialized/live bytes, 451 ops)
 INFO 15:30:32,113 Completed flushing /var/lib/cassandra/data/system/schema_columnfamilies/system-schema_columnfamilies-jb-1-Data.db (5718 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=91345)
 INFO 15:30:32,114 Enqueuing flush of Memtable-schema_columns@1771732332(51396/328665 serialized/live bytes, 855 ops)
 INFO 15:30:32,115 Writing Memtable-schema_columns@1771732332(51396/328665 serialized/live bytes, 855 ops)
 INFO 15:30:32,163 Completed flushing /var/lib/cassandra/data/system/schema_columns/system-schema_columns-jb-1-Data.db (10179 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=91345)
 INFO 15:30:32,255 Loading org.apache.cassandra.config.CFMetaData@c161baa[cfId=c5e99f16-8677-3914-b17e-960613512345,ksName=system_traces,cfName=sessions,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.ColumnToCollectionType(706172616d6574657273:org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type))),comment=traced sessions,readRepairChance=0.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,column_metadata={java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=73657373696f6e5f6964, validator=org.apache.cassandra.db.marshal.UUIDType, type=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=11 cap=11]=ColumnDefinition{name=636f6f7264696e61746f72, validator=org.apache.cassandra.db.marshal.InetAddressType, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=7 cap=7]=ColumnDefinition{name=72657175657374, validator=org.apache.cassandra.db.marshal.UTF8Type, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=737461727465645f6174, validator=org.apache.cassandra.db.marshal.TimestampType, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=6475726174696f6e, validator=org.apache.cassandra.db.marshal.Int32Type, type=REGULAR, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=706172616d6574657273, validator=org.apache.cassandra.db.marshal.MapType(org.apache.cassandra.db.marshal.UTF8Type,org.apache.cassandra.db.marshal.UTF8Type), type=REGULAR, componentIndex=0, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtable_flush_period_in_ms=3600000,caching=KEYS_ONLY,defaultTimeToLive=0,speculative_retry=99.0PERCENTILE,indexInterval=128,populateIoCacheOnFlush=false,droppedColumns={},triggers={}]
 INFO 15:30:32,258 Initializing system_traces.sessions
 INFO 15:30:32,260 Loading org.apache.cassandra.config.CFMetaData@59502ff4[cfId=8826e8e9-e16a-3728-8753-3bc1fc713c25,ksName=system_traces,cfName=events,cfType=Standard,comparator=org.apache.cassandra.db.marshal.CompositeType(org.apache.cassandra.db.marshal.TimeUUIDType,org.apache.cassandra.db.marshal.UTF8Type),comment=,readRepairChance=0.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=0,defaultValidator=org.apache.cassandra.db.marshal.BytesType,keyValidator=org.apache.cassandra.db.marshal.UUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,column_metadata={java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=6163746976697479, validator=org.apache.cassandra.db.marshal.UTF8Type, type=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]=ColumnDefinition{name=73657373696f6e5f6964, validator=org.apache.cassandra.db.marshal.UUIDType, type=PARTITION_KEY, componentIndex=null, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=746872656164, validator=org.apache.cassandra.db.marshal.UTF8Type, type=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=8 cap=8]=ColumnDefinition{name=6576656e745f6964, validator=org.apache.cassandra.db.marshal.TimeUUIDType, type=CLUSTERING_KEY, componentIndex=0, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=6 cap=6]=ColumnDefinition{name=736f75726365, validator=org.apache.cassandra.db.marshal.InetAddressType, type=REGULAR, componentIndex=1, indexName=null, indexType=null}, java.nio.HeapByteBuffer[pos=0 lim=14 cap=14]=ColumnDefinition{name=736f757263655f656c6170736564, validator=org.apache.cassandra.db.marshal.Int32Type, type=REGULAR, componentIndex=1, indexName=null, indexType=null}},compactionStrategyClass=class org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.LZ4Compressor},bloomFilterFpChance=0.01,memtable_flush_period_in_ms=3600000,caching=KEYS_ONLY,defaultTimeToLive=0,speculative_retry=99.0PERCENTILE,indexInterval=128,populateIoCacheOnFlush=false,droppedColumns={},triggers={}]
 INFO 15:30:32,272 Initializing system_traces.events
 INFO 15:30:32,299 CFS(Keyspace='system', ColumnFamily='local') liveRatio is 51.38461538461539 (just-counted was 51.38461538461539).  calculation took 0ms for 2 cells
 INFO 15:30:32,300 Enqueuing flush of Memtable-local@1951963537(84/4316 serialized/live bytes, 6 ops)
 INFO 15:30:32,301 Writing Memtable-local@1951963537(84/4316 serialized/live bytes, 6 ops)
 INFO 15:30:32,321 Completed flushing /var/lib/cassandra/data/system/local/system-local-jb-3-Data.db (115 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=91604)
 INFO 15:30:32,381 CFS(Keyspace='system', ColumnFamily='local') liveRatio is 27.451974557269025 (just-counted was 3.519333729922665).  calculation took 0ms for 257 cells
 INFO 15:30:32,382 Enqueuing flush of Memtable-local@1370283822(10086/276880 serialized/live bytes, 259 ops)
 INFO 15:30:32,382 Writing Memtable-local@1370283822(10086/276880 serialized/live bytes, 259 ops)
 INFO 15:30:32,432 Completed flushing /var/lib/cassandra/data/system/local/system-local-jb-4-Data.db (5290 bytes) for commitlog position ReplayPosition(segmentId=1418830230910, position=103591)
 INFO 15:30:32,470 Compacting [SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-jb-3-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-jb-4-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-jb-2-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/local/system-local-jb-1-Data.db')]
 INFO 15:30:32,513 Node localhost/127.0.0.1 state jump to normal
 INFO 15:30:32,667 Compacted 4 sstables to [/var/lib/cassandra/data/system/local/system-local-jb-5,].  5,885 bytes to 5,724 (~97% of original) in 167ms = 0.032688MB/s.  4 total partitions merged to 1.  Partition merge counts were {4:1, }
 INFO 15:30:32,753 Starting listening for CQL clients on localhost/127.0.0.1:9042...
 INFO 15:30:32,826 Using TFramedTransport with a max frame size of 15728640 bytes.
 INFO 15:30:32,832 Binding thrift service to localhost/127.0.0.1:9160
 INFO 15:30:32,846 Using synchronous/threadpool thrift server on localhost : 9160
 INFO 15:30:32,847 Listening for thrift clients...

Running bin/cassandra -f from the titan distro gives different results.

titan-0.5.2-hadoop2$ sudo bin/cassandra -f
 INFO 15:34:39,312 Logging initialized
 INFO 15:34:39,386 Loading settings from file:/vagrant/vendor/titan-0.5.2-hadoop2/conf/cassandra.yaml
 INFO 15:34:39,938 Data files directories: [db/cassandra/data]
 INFO 15:34:39,939 Commit log directory: db/cassandra/commitlog
 INFO 15:34:39,940 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
 INFO 15:34:39,940 disk_failure_policy is stop
 INFO 15:34:39,941 commit_failure_policy is stop
 INFO 15:34:39,952 Global memtable threshold is enabled at 247MB
 INFO 15:34:40,163 Not using multi-threaded compaction
 INFO 15:34:40,598 JVM vendor/version: Java HotSpot(TM) 64-Bit Server VM/1.8.0_25
 INFO 15:34:40,599 Heap size: 1038090240/1038090240
 INFO 15:34:40,600 Code Cache Non-heap memory: init = 2555904(2496K) used = 3653120(3567K) committed = 3670016(3584K) max = 251658240(245760K)
 INFO 15:34:40,600 Metaspace Non-heap memory: init = 0(0K) used = 14245272(13911K) committed = 14680064(14336K) max = -1(-1K)
 INFO 15:34:40,601 Compressed Class Space Non-heap memory: init = 0(0K) used = 1716216(1675K) committed = 1835008(1792K) max = 1073741824(1048576K)
 INFO 15:34:40,605 Par Eden Space Heap memory: init = 83886080(81920K) used = 83886080(81920K) committed = 83886080(81920K) max = 83886080(81920K)
 INFO 15:34:40,605 Par Survivor Space Heap memory: init = 10485760(10240K) used = 7486088(7310K) committed = 10485760(10240K) max = 10485760(10240K)
 INFO 15:34:40,607 CMS Old Gen Heap memory: init = 943718400(921600K) used = 0(0K) committed = 943718400(921600K) max = 943718400(921600K)
 INFO 15:34:40,608 Classpath: /vagrant/vendor/titan-0.5.2-hadoop2/conf:/vagrant/vendor/titan-0.5.2-hadoop2/build/classes/main:/vagrant/vendor/titan-0.5.2-hadoop2/build/classes/thrift:/vagrant/vendor/titan-0.5.2-hadoop2/lib/activation-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ant-1.8.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ant-launcher-1.8.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/antlr-2.7.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/antlr-3.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/antlr-runtime-3.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/aopalliance-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/asm-4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/asm-commons-4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-cassandra-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-core-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-recipes-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/astyanax-thrift-1.56.48.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/avro-1.7.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/blueprints-core-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/blueprints-sail-graph-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/cassandra-all-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/cassandra-thrift-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/colt-1.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/common-1.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-beanutils-1.7.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-beanutils-core-1.7.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-cli-1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-codec-1.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-collections-3.2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-compress-1.4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-configuration-1.6.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-daemon-1.0.13.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-digester-1.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-el-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-fileupload-1.2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-httpclient-3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-io-2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-lang-2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-lang3-3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-logging-1.1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-math-2.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-net-1.4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/commons-pool-1.6.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/compress-lzf-0.8.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/concurrent-1.3.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/concurrentlinkedhashmap-lru-1.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/disruptor-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/dom4j-1.6.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/elasticsearch-1.2.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/elasticsearch-hadoop-mr-2.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/findbugs-annotations-1.3.9-1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/frames-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gmbal-3.2.0-b003.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gmetric4j-1.0.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gremlin-groovy-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/gremlin-java-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-core-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-framework-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-http-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-http-server-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-http-servlet-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-portunif-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/grizzly-rcm-2.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/groovy-shaded-asm-1.8.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/guava-15.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/guice-3.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/guice-servlet-3.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-annotations-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-auth-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-client-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-hdfs-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-app-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-core-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-jobclient-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-mapreduce-client-shuffle-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-api-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-client-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hadoop-yarn-server-common-2.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-annotations-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-client-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-common-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-common-0.98.8-hadoop2-tests.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-hadoop2-compat-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-hadoop-compat-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-prefix-tree-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-protocol-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hbase-server-0.98.8-hadoop2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hibernate-validator-4.3.0.Final.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/high-scale-lib-1.1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/hppc-0.6.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/htrace-core-2.04.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpclient-4.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpclient-cache-4.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpcore-4.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/httpmime-4.3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ivy-2.3.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-annotations-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-core-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-core-asl-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-databind-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-datatype-json-org-2.2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-jaxrs-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-mapper-asl-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jackson-xc-1.9.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jamm-0.2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jamon-runtime-2.3.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jansi-1.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jasper-compiler-5.5.23.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jasper-runtime-5.5.23.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javassist-3.18.0-GA.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.inject-1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.json-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.servlet-3.0.0.v201112011016.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/javax.servlet-api-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jaxb-api-2.2.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jaxb-impl-2.2.3-1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jbcrypt-0.3m.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jboss-logging-3.1.2.GA.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jcodings-1.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/je-5.0.73.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-client-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-core-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-grizzly2-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-guice-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-json-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-server-1.18.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-servlet-1.17.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-test-framework-core-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jersey-test-framework-grizzly2-1.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jets3t-0.6.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jettison-1.3.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-6.1.26.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-continuation-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-deploy-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-http-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-io-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-jmx-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-security-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-server-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-servlet-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-sslengine-6.1.26.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-util-6.1.26.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-util-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-webapp-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jetty-xml-8.1.10.v20130312.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jline-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jna-3.2.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/joda-time-1.6.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/joni-2.1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsch-0.1.42.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/json-20090211.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsonld-java-0.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsonld-java-sesame-0.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/json-simple-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsp-2.1-6.1.14.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsp-api-2.1-6.1.14.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jsr305-1.3.9.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jts-1.13.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/junit-benchmarks-0.7.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/kryo-2.22.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/libthrift-0.9.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/linked-data-sail-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/log4j-1.2.16.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-analyzers-common-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-analyzers-kuromoji-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-analyzers-phonetic-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-codecs-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-core-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-expressions-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-grouping-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-highlighter-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-join-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-memory-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-misc-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-queries-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-queryparser-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-sandbox-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-spatial-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lucene-suggest-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/lz4-1.2.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/management-api-3.0.0-b012.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-annotation-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-core-2.1.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-core-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-ganglia-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-graphite-3.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-healthchecks-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-jersey-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-json-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-jvm-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/metrics-servlets-3.0.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/msgpack-0.6.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/netty-3.2.7.Final.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/netty-3.6.6.Final.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/noggit-0.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/oncrpc-1.0.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/org.apache.servicemix.bundles.commons-csv-1.0-r706900_3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/org.restlet-2.1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/org.restlet.ext.servlet-2.1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/oro-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/paranamer-2.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-asm-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-basic-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-basic-tools-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-tf-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pfl-tf-tools-1.0.0-b001.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/pipes-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/protobuf-java-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/randomizedtesting-runner-2.0.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/reflections-0.9.9-RC1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/reporter-config-2.1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/repository-sail-1.8.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-console-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-core-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-protocol-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/rexster-server-2.5.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ripple-base-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ripple-flow-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/ripple-flow-rdf-1.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-core-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-rdf-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-rdfa-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/semargl-sesame-0.4.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/servlet-api-2.5-6.1.14.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/servlet-api-2.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-http-client-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-http-protocol-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-model-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-query-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryalgebra-evaluation-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryalgebra-model-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryparser-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryparser-serql-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryparser-sparql-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryresultio-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-queryresultio-sparqlxml-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-repository-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-repository-sparql-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-binary-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-datatypes-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-languages-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-n3-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-nquads-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-ntriples-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-rdfjson-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-rdfxml-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-trig-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-trix-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-rio-turtle-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-api-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-inferencer-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-memory-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-sail-nativerdf-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/sesame-util-2.7.10.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/slf4j-api-1.7.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/slf4j-log4j12-1.7.5.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/snakeyaml-1.11.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/snappy-java-1.0.5-M3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/snaptree-0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/solr-core-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/solr-solrj-4.8.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/spatial4j-0.4.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/stax-api-1.0.1.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/stax-api-1.0-2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/super-csv-2.1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/thrift-server-0.3.3.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-berkeleyje-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-cassandra-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-core-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-es-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-hadoop-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-hbase-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-lucene-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-rexster-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/titan-solr-0.5.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/uuid-3.2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/validation-api-1.0.0.GA.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/wstx-asl-3.2.7.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/xml-apis-1.0.b2.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/xmlenc-0.52.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/xz-1.0.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/zookeeper-3.4.6.jar:/vagrant/vendor/titan-0.5.2-hadoop2/lib/jamm-0.2.5.jar
 INFO 15:34:40,774 JNA mlockall successful
 INFO 15:34:40,805 Initializing key cache with capacity of 49 MBs.
 INFO 15:34:40,821 Scheduling key cache save to each 14400 seconds (going to save all keys).
 INFO 15:34:40,822 Initializing row cache with capacity of 0 MBs
 INFO 15:34:40,834 Scheduling row cache save to each 0 seconds (going to save all keys).
 INFO 15:34:41,430 Initializing system.sstable_activity
 INFO 15:34:41,473 Initializing system.hints
 INFO 15:34:41,482 Initializing system.NodeIdInfo
 INFO 15:34:41,489 Initializing system.compaction_history
 INFO 15:34:41,495 Initializing system.peers
 INFO 15:34:41,510 Initializing system.schema_columnfamilies
 INFO 15:34:41,520 Initializing system.IndexInfo
 INFO 15:34:41,536 Initializing system.local
 INFO 15:34:41,546 Initializing system.schema_triggers
 INFO 15:34:41,560 Initializing system.schema_columns
 INFO 15:34:41,566 Initializing system.batchlog
 INFO 15:34:41,572 Initializing system.peer_events
 INFO 15:34:41,577 Initializing system.paxos
 INFO 15:34:41,597 Initializing system.compactions_in_progress
 INFO 15:34:41,641 Initializing system.range_xfers
 INFO 15:34:41,660 Initializing system.schema_keyspaces

And then it stops.

dalaro commented 9 years ago

I had a 14.04 vagrant VM lying on disk from past work. I just started it up and unpacked 0.5.2-h2; bin/cassandra -f worked as expected. Same on my Debian 7 box. I must be missing some critical piece of configuration or version information about the environments where it fails.

Can you push your Vagrant box?

p-lewis commented 9 years ago

Here's my vagrant setup:

https://github.com/p-lewis/testvm-2014dec

Digging in a bit, I think I figured out what's going on. I had kept my titan directory in the 'shared' directory of the VM, shared between the host and VM. When I move titan out of the shared area to a directory fully in the VM's filesystem, titan.sh starts up fine and works normally.

Starting the upstream cassandra instance didn't see the same issue, as it looks for data in /var/lib/cassandra, which is local to the VM.

dalaro commented 9 years ago

Thanks for the follow-up. I think you're right about the Vagrant vboxsf shared data filesystem.

I started a new Ubuntu 14.04 VM with /vagrant_data mounted and running vboxsf. I unpacked titan-0.5.2-hadoop2.zip and apache-cassandra-2.0.8-bin.tar.gz inside /vagrant_data. I edited apache-cassandra-2.0.8/conf/{cassandra.yaml,log4j-server.properties} to write within the /vagrant_data mointpoint. I then ran bin/cassandra -f on both installs in turn. Both Cassandras -- the one packed with Titan and the Apache distro -- did the same hang-after-Initializing routine.

Since this happens with both the Apache distro and the Titan's copy of Cassandra, I think this is an issue between Cassandra and vboxsf. Have you found any discussions about this elsewhere? I searched a bit but couldn't find obviously related issues or threads. I have VBox 4.1 but guest additions 4.3.18. Maybe it only happens on certain host/guest version combinations?

After Cassandra hangs, the CPUs quiesce, and the stack traces on Cassandra appear be the same across a handful of dumps... seems like it has just failed to allocate a commitlog segment, but on the other hand, the COMMIT-LOG-ALLOCATOR trace seems very strange to me:

"Attach Listener" daemon prio=10 tid=0x00007faf8c002800 nid=0x1c96 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"COMMIT-LOG-ALLOCATOR" prio=10 tid=0x00007fafb05be800 nid=0x1c77 in Object.wait() [0x00007fafa9711000]
   java.lang.Thread.State: RUNNABLE
        at org.apache.cassandra.db.commitlog.CommitLogAllocator$1.runMayThrow(CommitLogAllocator.java:116)
        at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
        at java.lang.Thread.run(Thread.java:745)

"commitlog_archiver:1" daemon prio=10 tid=0x00007fafb05b8000 nid=0x1c76 waiting on condition [0x00007fafa9752000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000c03fefe8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"MemoryMeter:1" daemon prio=10 tid=0x00007fafb05a2800 nid=0x1c75 waiting on condition [0x00007fafa9793000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000bfc01238> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"MemtablePostFlusher:1" daemon prio=10 tid=0x00007fafb0545800 nid=0x1c73 waiting on condition [0x00007fafa9815000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000bf5df568> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"OptionalTasks:1" daemon prio=10 tid=0x00007fafb053d000 nid=0x1c72 waiting on condition [0x00007fafa9856000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000be165040> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"Background_Reporter:1" daemon prio=10 tid=0x00007fafb0465000 nid=0x1c71 waiting on condition [0x00007fafa9aa0000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000be6e7b70> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"EXPIRING-MAP-REAPER:1" daemon prio=10 tid=0x00007fafb045d000 nid=0x1c70 waiting on condition [0x00007fafa9ae1000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000be64b4f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"ScheduledTasks:1" daemon prio=10 tid=0x00007fafb0459800 nid=0x1c6f waiting on condition [0x00007fafa9b22000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000be164bd0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"metrics-meter-tick-thread-2" daemon prio=10 tid=0x00007fafb0458000 nid=0x1c6e waiting on condition [0x00007fafa9b63000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000be6000e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"metrics-meter-tick-thread-1" daemon prio=10 tid=0x00007fafb0452000 nid=0x1c6d waiting on condition [0x00007fafa9ba4000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000be6000e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1085)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

"FileWatchdog" daemon prio=10 tid=0x00007fafb02b1800 nid=0x1c6c waiting on condition [0x00007fafa9be5000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:104)

"RMI TCP Accept-0" daemon prio=10 tid=0x00007fafb0269000 nid=0x1c6a runnable [0x00007fafa9d27000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
        at java.net.ServerSocket.implAccept(ServerSocket.java:530)
        at java.net.ServerSocket.accept(ServerSocket.java:498)
        at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:388)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:360)
        at java.lang.Thread.run(Thread.java:745)

"RMI TCP Accept-7199" daemon prio=10 tid=0x00007fafb0255000 nid=0x1c69 runnable [0x00007fafa9d68000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
        at java.net.ServerSocket.implAccept(ServerSocket.java:530)
        at java.net.ServerSocket.accept(ServerSocket.java:498)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:388)
        at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:360)
        at java.lang.Thread.run(Thread.java:745)

"Service Thread" daemon prio=10 tid=0x00007fafb0174800 nid=0x1c68 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" daemon prio=10 tid=0x00007fafb0172000 nid=0x1c67 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" daemon prio=10 tid=0x00007fafb0167000 nid=0x1c66 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" daemon prio=10 tid=0x00007fafb00e7800 nid=0x1c65 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007fafb00e6000 nid=0x1c64 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" daemon prio=10 tid=0x00007fafb00c6800 nid=0x1c63 in Object.wait() [0x00007fafb42a9000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000bc405608> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
        - locked <0x00000000bc405608> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler" daemon prio=10 tid=0x00007fafb00c4800 nid=0x1c62 in Object.wait() [0x00007fafb42ea000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000bc405190> (a java.lang.ref.Reference$Lock)
        at java.lang.Object.wait(Object.java:503)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
        - locked <0x00000000bc405190> (a java.lang.ref.Reference$Lock)

"main" prio=10 tid=0x00007fafb000c000 nid=0x1c5f waiting on condition [0x00007fafb9269000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000c0422148> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.cassandra.db.commitlog.CommitLogAllocator.fetchSegment(CommitLogAllocator.java:137)
        at org.apache.cassandra.db.commitlog.CommitLog.activateNextSegment(CommitLog.java:299)
        at org.apache.cassandra.db.commitlog.CommitLog.<init>(CommitLog.java:73)
        at org.apache.cassandra.db.commitlog.CommitLog.<clinit>(CommitLog.java:53)
        at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:354)
        at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:333)
        at org.apache.cassandra.db.RowMutation.apply(RowMutation.java:211)
        at org.apache.cassandra.cql3.statements.ModificationStatement.executeInternal(ModificationStatement.java:680)
        at org.apache.cassandra.cql3.QueryProcessor.processInternal(QueryProcessor.java:208)
        at org.apache.cassandra.db.SystemKeyspace.checkHealth(SystemKeyspace.java:558)
        at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:261)
        at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:496)
        at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:585)

"VM Thread" prio=10 tid=0x00007fafb00c0800 nid=0x1c61 runnable 

"Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007fafb0036800 nid=0x1c60 runnable 
"VM Periodic Task Thread" prio=10 tid=0x00007fafb026a800 nid=0x1c6b waiting on condition 

JNI global references: 161
dalaro commented 9 years ago

@kivo360 please feel free to create a new issue or reopen this one. The root cause behind your original report is still unclear. We may have just hijacked the issue to debug a separate root cause with an identical symptom.