search

aredee / accumulo-mesos

Apache License 2.0
17 stars 2 forks source link

start framework #9

Open tsaridas opened 8 years ago

tsaridas commented 8 years ago

Hey,

I'm trying to start framework and I get the following error 

bash start_framework.sh
2016-07-27 09:35:06 INFO  Main:68 - Connecting to Mesos state
2016-07-27 09:35:06,075:3874(0x7fc637099700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
2016-07-27 09:35:06,076:3874(0x7fc637099700):ZOO_INFO@log_env@716: Client environment:host.name=master
2016-07-27 09:35:06,076:3874(0x7fc637099700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
2016-07-27 09:35:06,077:3874(0x7fc637099700):ZOO_INFO@log_env@724: Client environment:os.arch=3.16.0-4-amd64
2016-07-27 09:35:06,078:3874(0x7fc637099700):ZOO_INFO@log_env@725: Client environment:os.version=#1 SMP Debian 3.16.7-ckt11-1+deb8u3 (2015-08-04)
2016-07-27 09:35:06,078:3874(0x7fc637099700):ZOO_INFO@log_env@733: Client environment:user.name=vagrant
2016-07-27 09:35:06,079:3874(0x7fc637099700):ZOO_INFO@log_env@741: Client environment:user.home=/root
2016-07-27 09:35:06,079:3874(0x7fc637099700):ZOO_INFO@log_env@753: Client environment:user.dir=/vagrant/dev
2016-07-27 09:35:06,080:3874(0x7fc637099700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=172.16.0.100:2181 sessionTimeout=3000 watcher=0x7fc664f18cd0 sessionId=0 sessionPasswd=<null> context=0x7fc62c0036f0 flags=0
2016-07-27 09:35:06,080:3874(0x7fc632890700):ZOO_INFO@check_events@1703: initiated connection to server [172.16.0.100:2181]
2016-07-27 09:35:06,087:3874(0x7fc632890700):ZOO_INFO@check_events@1750: session establishment complete on server [172.16.0.100:2181], sessionId=0x1562b95c4d80022, negotiated timeout=4000
2016-07-27 09:35:06 INFO  Main:76 - frameworks ? {accumulo-mesos-test-4=c3d5bfc7-caad-4c08-8497-9bf7a16f1877}
2016-07-27 09:35:06 INFO  Main:119 - Starting mesos-accumumlo framework version 0.2.0-SNAPSHOT
2016-07-27 09:35:06 INFO  Main:135 - Preconditions check: Framework{bindAddress=0.0.0.0, httpPort=18120, dockerImage=null, id=null, mesosMaster=172.16.0.100:5050, name=accumulo-mesos-test-1, tarballUri=null, zkServers=172.16.0.100:2181, cluster=}
2016-07-27 09:35:06 ERROR Main:122 - Unhandled exception encountered, exiting:
java.lang.IllegalStateException
    at com.google.common.base.Preconditions.checkState(Preconditions.java:158)
    at aredee.mesos.frameworks.accumulo.framework.Main.run(Main.java:137)
    at aredee.mesos.frameworks.accumulo.framework.Main.main(Main.java:120)
2016-07-27 09:35:06 INFO  Main:125 - Exiting Accumulo Framework with status: -1

any help would be appreciated.

Thanks

bgulla commented 8 years ago

Hey Andreas, Can you tell us a little more about your environment? Bare metal, Vagrant?

On Wed, Jul 27, 2016 at 5:35 AM, Andreas Tsaridas notifications@github.com wrote:

Hey,

I'm trying to start framework and I get the following error

bash start_framework.sh 2016-07-27 09:35:06 INFO Main:68 - Connecting to Mesos state 2016-07-27 09:35:06,075:3874(0x7fc637099700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5 2016-07-27 09:35:06,076:3874(0x7fc637099700):ZOO_INFO@log_env@716: Client environment:host.name=master 2016-07-27 09:35:06,076:3874(0x7fc637099700):ZOO_INFO@log_env@723: Client environment:os.name=Linux 2016-07-27 09:35:06,077:3874(0x7fc637099700):ZOO_INFO@log_env@724: Client environment:os.arch=3.16.0-4-amd64 2016-07-27 09:35:06,078:3874(0x7fc637099700):ZOO_INFO@log_env@725: Client environment:os.version=#1 SMP Debian 3.16.7-ckt11-1+deb8u3 (2015-08-04) 2016-07-27 09:35:06,078:3874(0x7fc637099700):ZOO_INFO@log_env@733: Client environment:user.name=vagrant 2016-07-27 09:35:06,079:3874(0x7fc637099700):ZOO_INFO@log_env@741: Client environment:user.home=/root 2016-07-27 09:35:06,079:3874(0x7fc637099700):ZOO_INFO@log_env@753: Client environment:user.dir=/vagrant/dev 2016-07-27 09:35:06,080:3874(0x7fc637099700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=172.16.0.100:2181 sessionTimeout=3000 watcher=0x7fc664f18cd0 sessionId=0 sessionPasswd= context=0x7fc62c0036f0 flags=0 2016-07-27 09:35:06,080:3874(0x7fc632890700):ZOO_INFO@check_events@1703: initiated connection to server [172.16.0.100:2181] 2016-07-27 09:35:06,087:3874(0x7fc632890700):ZOO_INFO@check_events@1750: session establishment complete on server [172.16.0.100:2181], sessionId=0x1562b95c4d80022, negotiated timeout=4000 2016-07-27 09:35:06 INFO Main:76 - frameworks ? {accumulo-mesos-test-4=c3d5bfc7-caad-4c08-8497-9bf7a16f1877} 2016-07-27 09:35:06 INFO Main:119 - Starting mesos-accumumlo framework version 0.2.0-SNAPSHOT 2016-07-27 09:35:06 INFO Main:135 - Preconditions check: Framework{bindAddress=0.0.0.0, httpPort=18120, dockerImage=null, id=null, mesosMaster=172.16.0.100:5050, name=accumulo-mesos-test-1, tarballUri=null, zkServers=172.16.0.100:2181, cluster=} 2016-07-27 09:35:06 ERROR Main:122 - Unhandled exception encountered, exiting: java.lang.IllegalStateException at com.google.common.base.Preconditions.checkState(Preconditions.java:158) at aredee.mesos.frameworks.accumulo.framework.Main.run(Main.java:137) at aredee.mesos.frameworks.accumulo.framework.Main.main(Main.java:120) 2016-07-27 09:35:06 INFO Main:125 - Exiting Accumulo Framework with status: -1

any help would be appreciated.

Thanks

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/aredee/accumulo-mesos/issues/9, or mute the thread https://github.com/notifications/unsubscribe-auth/ACkoM5wPKYCjQcjShGULyxIZg1_TY4EQks5qZyZfgaJpZM4JWAdu .

Brandon

klucar commented 8 years ago

Looks like you don't have an Accumulo cluster configuration. Usually this means you haven't gone through the Accumulo unit process before trying to start the framework.

tsaridas commented 8 years ago

@bgulla its a vagrant env which is provided in this repo

looks like its looking for ID and doesn't like it being null.

I'm using the default configuration files but changed the accumulo version to 1.7.2 and java to 1.8

I managed to make it run but its still complaining about not being able to start master in mesos.

Still looking into the issue. Some more documentation would be really appreciated.

tsaridas commented 8 years ago

mesos stdout

I0728 11:01:42.226362 3901957 fetcher.cpp:424] Fetcher Info: {"cache_directory":"\/tmp\/mesos\/fetch\/slaves\/79532170-9966-41c0-b3c9-a024bcf08e58-S0\/root","items":[{"action":"BYPASS_CACHE","uri":{"executable":false,"extract":true,"value":"hdfs:\/\/10.32.0.11:8020\/dist\/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz"}},{"action":"BYPASS_CACHE","uri":{"executable":false,"extract":true,"value":"hdfs:\/\/10.32.0.11:8020\/dist\/accumulo-1.7.2-bin.tar.gz"}},{"action":"BYPASS_CACHE","uri":{"executable":false,"extract":false,"value":"hdfs:\/\/10.32.0.11:8020\/dist\/libaccumulo.so"}}],"sandbox_directory":"\/tmp\/mesos\/slaves\/79532170-9966-41c0-b3c9-a024bcf08e58-S0\/frameworks\/accumulo-mesos-test-0\/executors\/accumuloExecutor-master-67\/runs\/069e6c5f-6d58-4fb4-8612-5ebd24efed7a","user":"root"}
I0728 11:01:42.228251 3901957 fetcher.cpp:379] Fetching URI 'hdfs://10.32.0.11:8020/dist/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz'
I0728 11:01:42.228263 3901957 fetcher.cpp:250] Fetching directly into the sandbox directory
I0728 11:01:42.228279 3901957 fetcher.cpp:187] Fetching URI 'hdfs://10.32.0.11:8020/dist/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz'
I0728 11:01:42.491940 3901957 fetcher.cpp:109] Downloading resource with Hadoop client from 'hdfs://10.32.0.11:8020/dist/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz' to '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz'
I0728 11:01:44.400290 3901957 fetcher.cpp:84] Extracting with command: tar -C '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a' -xf '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz'
I0728 11:01:44.572418 3901957 fetcher.cpp:92] Extracted '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz' into '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a'
I0728 11:01:44.572466 3901957 fetcher.cpp:456] Fetched 'hdfs://10.32.0.11:8020/dist/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz' to '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz'
I0728 11:01:44.572475 3901957 fetcher.cpp:379] Fetching URI 'hdfs://10.32.0.11:8020/dist/accumulo-1.7.2-bin.tar.gz'
I0728 11:01:44.572481 3901957 fetcher.cpp:250] Fetching directly into the sandbox directory
I0728 11:01:44.572504 3901957 fetcher.cpp:187] Fetching URI 'hdfs://10.32.0.11:8020/dist/accumulo-1.7.2-bin.tar.gz'
I0728 11:01:44.842818 3901957 fetcher.cpp:109] Downloading resource with Hadoop client from 'hdfs://10.32.0.11:8020/dist/accumulo-1.7.2-bin.tar.gz' to '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-1.7.2-bin.tar.gz'
I0728 11:01:46.809190 3901957 fetcher.cpp:84] Extracting with command: tar -C '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a' -xf '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-1.7.2-bin.tar.gz'
I0728 11:01:47.000782 3901957 fetcher.cpp:92] Extracted '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-1.7.2-bin.tar.gz' into '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a'
I0728 11:01:47.000829 3901957 fetcher.cpp:456] Fetched 'hdfs://10.32.0.11:8020/dist/accumulo-1.7.2-bin.tar.gz' to '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/accumulo-1.7.2-bin.tar.gz'
I0728 11:01:47.000838 3901957 fetcher.cpp:379] Fetching URI 'hdfs://10.32.0.11:8020/dist/libaccumulo.so'
I0728 11:01:47.000844 3901957 fetcher.cpp:250] Fetching directly into the sandbox directory
I0728 11:01:47.000865 3901957 fetcher.cpp:187] Fetching URI 'hdfs://10.32.0.11:8020/dist/libaccumulo.so'
I0728 11:01:47.274653 3901957 fetcher.cpp:109] Downloading resource with Hadoop client from 'hdfs://10.32.0.11:8020/dist/libaccumulo.so' to '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/libaccumulo.so'
I0728 11:01:49.116344 3901957 fetcher.cpp:456] Fetched 'hdfs://10.32.0.11:8020/dist/libaccumulo.so' to '/tmp/mesos/slaves/79532170-9966-41c0-b3c9-a024bcf08e58-S0/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-master-67/runs/069e6c5f-6d58-4fb4-8612-5ebd24efed7a/libaccumulo.so'
Makefile:45: *** "JAVA_HOME does not point to a JDK. Exiting...".  Stop.
I0728 11:01:49.535854 3902251 exec.cpp:143] Version: 0.28.2
I0728 11:01:49.540205 3902272 exec.cpp:217] Executor registered on slave 79532170-9966-41c0-b3c9-a024bcf08e58-S0
[Fatal Error] :1:1: Premature end of file.
java.lang.RuntimeException: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 1; Premature end of file.
    at aredee.mesos.frameworks.accumulo.initialize.AccumuloSiteXml.initXml(AccumuloSiteXml.java:278)
    at aredee.mesos.frameworks.accumulo.initialize.AccumuloSiteXml.initializeFromExecutor(AccumuloSiteXml.java:115)
    at aredee.mesos.frameworks.accumulo.executor.AccumuloStartExecutor.launchTask(AccumuloStartExecutor.java:131)
Caused by: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 1; Premature end of file.
    at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:257)
    at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:339)
    at aredee.mesos.frameworks.accumulo.initialize.AccumuloSiteXml.initXml(AccumuloSiteXml.java:270)
    ... 2 more
Exception in thread "Thread-1" I0728 11:01:49.761251 3902272 exec.cpp:425] Deactivating the executor libprocess

mesos stderr 

Make failed!
UPSTART_INSTANCE=
MESOS_EXECUTOR_ID=accumuloExecutor-tserver-111
LOGS=/var/log/mesos
MESOS_CHECKPOINT=1
SHLVL=0
ACCUMULO_HOME=/tmp/mesos/slaves/91518512-06a0-49c3-9c63-225f6aaa9690-S11/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-tserver-111/runs/f41b419f-3a63-4b28-b201-bc5729503531/accumulo-1.7.2
ZK=zk://10.32.0.10:2181/mesos
HADOOP_PREFIX=/usr/local/tl/hadoop
MESOS_EXECUTOR_SHUTDOWN_GRACE_PERIOD=5secs
MESOS_SUBSCRIPTION_BACKOFF_MAX=2secs
UPSTART_JOB=mesos-slave
LIBPROCESS_PORT=0
MESOS_PORT=5051
MESOS_HADOOP_HOME=/usr/local/tl/hadoop
TERM=linux
ACCUMULO_LOG_DIR=/tmp/mesos/slaves/91518512-06a0-49c3-9c63-225f6aaa9690-S11/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-tserver-111/runs/f41b419f-3a63-4b28-b201-bc5729503531/accumulo-1.7.2/logs
CLUSTER=10.32.0.10
MESOS_WORK_DIR=/tmp/mesos
MESOS_AGENT_ENDPOINT=10.32.0.11:5051
PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin
MESOS_CONTAINERIZERS=docker,mesos
MESOS_SANDBOX=/tmp/mesos/slaves/91518512-06a0-49c3-9c63-225f6aaa9690-S11/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-tserver-111/runs/f41b419f-3a63-4b28-b201-bc5729503531
MESOS_RECOVERY_TIMEOUT=15mins
MESOS_HOSTNAME=10.32.0.1
MESOS_EXECUTOR_REGISTRATION_TIMEOUT=5mins
MESOS_FRAMEWORK_ID=accumulo-mesos-test-0
MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos-0.28.2.so
ZOOKEEPER_HOME=/etc/zookeeper
MESOS_DIRECTORY=/tmp/mesos/slaves/91518512-06a0-49c3-9c63-225f6aaa9690-S11/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-tserver-111/runs/f41b419f-3a63-4b28-b201-bc5729503531
MESOS_NATIVE_LIBRARY=/usr/lib/libmesos-0.28.2.so
MESOS_SLAVE_ID=91518512-06a0-49c3-9c63-225f6aaa9690-S11
LC_ALL=en_US.UTF-8
MESOS_MASTER=zk://10.32.0.10:2181/mesos
PWD=/ux2/tmp/mesos/slaves/91518512-06a0-49c3-9c63-225f6aaa9690-S11/frameworks/accumulo-mesos-test-0/executors/accumuloExecutor-tserver-111/runs/f41b419f-3a63-4b28-b201-bc5729503531
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre
IP=10.32.0.11
MESOS_SLAVE_PID=slave(1)@10.32.0.11:5051
ULIMIT=-n 100000
LIBPROCESS_IP=10.32.0.11
MESOS_RESOURCES=ports:[80-31000];

executor log

[28/07/16 11:02:56:056 CEST] INFO Thread-0 aredee.mesos.frameworks.accumulo.executor.AccumuloStartExecutor - Executor Registered: accumuloExecutor-tserver-111
[28/07/16 11:02:56:056 CEST] INFO Thread-1 aredee.mesos.frameworks.accumulo.executor.AccumuloStartExecutor - Launch TaskInfo name: "tserver"
task_id {
  value: "tserver::785f2445-84da-4c7c-9029-41558625bf3c"
}
slave_id {
  value: "91518512-06a0-49c3-9c63-225f6aaa9690-S11"
}
resources {
  name: "cpus"
  type: SCALAR
  scalar {
    value: 6.3
  }
  role: "*"
}
resources {
  name: "mem"
  type: SCALAR
  scalar {
    value: 29671.0
  }
  role: "*"
}
executor {
  executor_id {
    value: "accumuloExecutor-tserver-111"
  }
  command {
    uris {
      value: "hdfs://10.32.0.11:8020/dist/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz"
      executable: false
      extract: true
    }
    uris {
      value: "hdfs://10.32.0.11:8020/dist/accumulo-1.7.2-bin.tar.gz"
      executable: false
      extract: true
    }
    uris {
      value: "hdfs://10.32.0.11:8020/dist/libaccumulo.so"
      executable: false
      extract: false
    }
    value: "export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.2;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=tserver -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar"
  }
  framework_id {
    value: "accumulo-mesos-test-0"
  }
  name: "accumuloExecutor-tserver-111"
}
data: "{\"name\":\"BasicTserver\",\"description\":\"Basic Tserver setup\",\"type\":\"tserver\",\"mem\":1024,\"cpus\":1.0,\"launcher\":null,\"user\":\"\",\"siteXml\":\"\",\"serverKeywordArgs\":[],\"useNativeMaps\":true}"

[28/07/16 11:02:56:056 CEST] INFO Thread-1 aredee.mesos.frameworks.accumulo.executor.AccumuloStartExecutor - Launch Task Requested: 
[28/07/16 11:02:56:056 CEST] ERROR Thread-1 aredee.mesos.frameworks.accumulo.initialize.AccumuloSiteXml - Reconstituting XML from String: 
[28/07/16 11:02:56:056 CEST] ERROR Thread-1 aredee.mesos.frameworks.accumulo.initialize.AccumuloSiteXml - Error reconsituting XML from String: 
[28/07/16 11:02:56:056 CEST] INFO main aredee.mesos.frameworks.accumulo.executor.Main - Executor Driver stopped, with value DRIVER_ABORTED
[28/07/16 11:02:56:056 CEST] INFO main aredee.mesos.frameworks.accumulo.executor.Main - Exiting executor process

I don't really understand why I get

Makefile:45: *\ "JAVA_HOME does not point to a JDK. Exiting...". Stop.

what is this running exactly ?

also I see in the framework logs 

Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.2;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=tserver -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar

JAVA_HOME seems wrong but thats not the systems default. Where do you get this variable from ?

tsaridas commented 8 years ago

after changing some code and debugging I'm stuck at 

[29/07/16 02:05:37:037 CEST] ERROR monitor org.apache.accumulo.start.Main - Thread 'monitor' died.
java.lang.RuntimeException: Accumulo not initialized, there is no instance id at file:/accumulo/instance_id
    at org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:66)
    at org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:51)
    at org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:137)
    at org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:121)
    at org.apache.accumulo.server.conf.ServerConfigurationFactory.<init>(ServerConfigurationFactory.java:108)
    at org.apache.accumulo.monitor.Monitor.main(Monitor.java:430)
    at org.apache.accumulo.monitor.MonitorExecutable.execute(MonitorExecutable.java:33)
    at org.apache.accumulo.start.Main$1.run(Main.java:120)
    at java.lang.Thread.run(Thread.java:745)

As you can imagine I'm trying to run from hdfs.

klucar commented 8 years ago

you have to first run the framework with the -i option to initialize a new accumulo instance. This is equivalent to running the accumulo init script in standard accumulo. That will create an instance and put it in HDFS/Zookeeper. After that, run the framework without the -i and it will attach to the instance.

On Fri, Jul 29, 2016 at 8:07 AM, Andreas Tsaridas notifications@github.com wrote:

after changing some code and debugging I'm stuck at

[29/07/16 02:05:37:037 CEST] ERROR monitor org.apache.accumulo.start.Main - Thread 'monitor' died. java.lang.RuntimeException: Accumulo not initialized, there is no instance id at file:/accumulo/instance_id at org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:66) at org.apache.accumulo.core.zookeeper.ZooUtil.getInstanceIDFromHdfs(ZooUtil.java:51) at org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:137) at org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:121) at org.apache.accumulo.server.conf.ServerConfigurationFactory.(ServerConfigurationFactory.java:108) at org.apache.accumulo.monitor.Monitor.main(Monitor.java:430) at org.apache.accumulo.monitor.MonitorExecutable.execute(MonitorExecutable.java:33) at org.apache.accumulo.start.Main$1.run(Main.java:120) at java.lang.Thread.run(Thread.java:745)

As you can imagine I'm trying to run from hdfs.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/aredee/accumulo-mesos/issues/9#issuecomment-236164015, or mute the thread https://github.com/notifications/unsubscribe-auth/AAmkIF8v_fEu_e4EG_EYngINR6KflyE2ks5qaez9gaJpZM4JWAdu .

tsaridas commented 8 years ago

@klucar I already did that

zk: localhost:2181(CONNECTED) 1] ls /accumulo/instances
[TEST_10092015_3]
hdfs dfs -ls /accumulo-mesos/
Found 1 items
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3
hdfs@host:~$ hdfs dfs -ls -R /accumulo-mesos/
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/instance_id
-rw-rw-r--   3 hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/instance_id/8707ba14-7808-4c6d-bebe-05256cc9ba13
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/!0
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/!0/default_tablet
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/!0/table_info
-rw-rw-r--   3 hdfs hadoop        307 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/!0/table_info/0_1.rf
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/+r
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/+r/root_tablet
-rw-rw-r--   3 hdfs hadoop        437 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/+r/root_tablet/00000_00000.rf
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/+rep
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/tables/+rep/default_tablet
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/version
drwxrwxr-x   - hdfs hadoop          0 2016-07-29 12:13 /accumulo-mesos/TEST_10092015_3/version/7
klucar commented 8 years ago

can you post the command you ran to init and the one you're using to launch? The site.xml is stored in zk (if I remember correctly) so if it can't find that you'll get an error. Or if you re-launched zk and wiped it, you'll have to re-init accumulo.

tsaridas commented 8 years ago 
java -jar accumulo-mesos-framework-0.2.0-SNAPSHOT-jar-with-dependencies.jar -i -fc config/framework.json -cc config/cluster.json
2016-07-29 14:12:19 INFO  CommandLineHandler:82 - Reading Framework Configuration from: /mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT/config/framework.json
2016-07-29 14:12:19 INFO  CommandLineHandler:116 - Loading cluster configuration /mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT/config/cluster.json
2016-07-29 14:12:19 INFO  Main:68 - Connecting to Mesos state
2016-07-29 14:12:19,352:24190(0x7efd43fff700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
2016-07-29 14:12:19,352:24190(0x7efd43fff700):ZOO_INFO@log_env@716: Client environment:host.name=hostname-ofserver
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-71-generic
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@log_env@725: Client environment:os.version=#114-Ubuntu SMP Tue Dec 1 02:34:22 UTC 2015
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@log_env@733: Client environment:user.name=atsarida
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@log_env@741: Client environment:user.home=/var/lib/accumulo
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@log_env@753: Client environment:user.dir=/mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT
2016-07-29 14:12:19,353:24190(0x7efd43fff700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=10.32.0.10:2181 sessionTimeout=3000 watcher=0x7efd5715d750 sessionId=0 sessionPasswd=<null> context=0x7efd24000d60 flags=0
2016-07-29 14:12:19,353:24190(0x7efd3ddeb700):ZOO_INFO@check_events@1703: initiated connection to server [10.32.0.10:2181]
2016-07-29 14:12:19,354:24190(0x7efd3ddeb700):ZOO_INFO@check_events@1750: session establishment complete on server [10.32.0.10:2181], sessionId=0x154e29a04700159, negotiated timeout=4000
2016-07-29 14:12:19 ERROR FrameworkStateHelper:140 - Key not found via Execution Exception : registered_frameworks
2016-07-29 14:12:19 INFO  Main:76 - frameworks ? {}
2016-07-29 14:12:19 INFO  Main:89 - Initializing Accumulo Instance: TEST_10092015_3
2016-07-29 14:12:19 INFO  AccumuloInitializer:43 - Writing accumulo-site.xml
XML is : <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration/>2016-07-29 14:12:19 ERROR AccumuloSiteXml:268 - Reconstituting XML from String: <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration/>
2016-07-29 14:12:19 INFO  AccumuloInitializer:78 - ACCUMULO HOME? /usr/local/tl/accumulo
2016-07-29 14:12:19 INFO  AccumuloInitializer:84 - Writing accumulo-site.xml to /usr/local/tl/accumulo/conf/accumulo-site.xml
2016-07-29 14:12:19 WARN  AccumuloProcessFactory:102 - Found empty or null value for process environment variable: LD_LIBRARY_PATH
2016-07-29 14:12:19 WARN  AccumuloProcessFactory:102 - Found empty or null value for process environment variable: DYLD_LIBRARY_PATH
2016-07-29 14:12:19 INFO  AccumuloProcessFactory:161 - Creating classpath: /usr/local/tl/accumulo/conf:/usr/local/tl/hadoop:/mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-framework-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:12:19 INFO  AccumuloProcessFactory:50 - exec: accumulo command: [/usr/local/tl/accumulo/bin/accumulo, init, --instance-name, TEST_10092015_3, --password, secret, --clear-instance-name]
2016-07-29 14:12:21 ERROR Main:95 - Accumulo failed to initialize instance: TEST_10092015_3
2016-07-29 14:12:21 ERROR Main:96 - Either remove instance from HDFS or re-launch framework without init option
java -jar accumulo-mesos-framework-0.2.0-SNAPSHOT-jar-with-dependencies.jar -fc config/framework.json -cc config/cluster.json
2016-07-29 14:13:04 INFO  CommandLineHandler:82 - Reading Framework Configuration from: /mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT/config/framework.json
2016-07-29 14:13:04 INFO  CommandLineHandler:116 - Loading cluster configuration /mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT/config/cluster.json
2016-07-29 14:13:04 INFO  Main:68 - Connecting to Mesos state
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@716: Client environment:host.name=hostname-ofserver
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-71-generic
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@725: Client environment:os.version=#114-Ubuntu SMP Tue Dec 1 02:34:22 UTC 2015
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@733: Client environment:user.name=atsarida
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@741: Client environment:user.home=/var/lib/accumulo
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@log_env@753: Client environment:user.dir=/mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT
2016-07-29 14:13:04,374:24796(0x7f1b8bfff700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=10.32.0.10:2181 sessionTimeout=3000 watcher=0x7f1ba335f750 sessionId=0 sessionPasswd=<null> context=0x7f1b08000960 flags=0
2016-07-29 14:13:04,375:24796(0x7f1b8affd700):ZOO_INFO@check_events@1703: initiated connection to server [10.32.0.10:2181]
2016-07-29 14:13:04,375:24796(0x7f1b8affd700):ZOO_INFO@check_events@1750: session establishment complete on server [10.32.0.10:2181], sessionId=0x154e29a0470015c, negotiated timeout=4000
2016-07-29 14:13:04 ERROR FrameworkStateHelper:140 - Key not found via Execution Exception : registered_frameworks
2016-07-29 14:13:04 INFO  Main:76 - frameworks ? {}
2016-07-29 14:13:04 INFO  Main:119 - Starting mesos-accumumlo framework version 0.2.0-SNAPSHOT
2016-07-29 14:13:04 INFO  Main:135 - Preconditions check: Framework{bindAddress=10.32.0.10, httpPort=8192, dockerImage=null, id=accumulo-mesos-test-125, mesosMaster=10.32.0.10:5050, name=accumulo-mesos-test-4, tarballUri=hdfs://10.32.0.11:8020/dist/accumulo-mesos-dist-0.2.0-SNAPSHOT.tar.gz, zkServers=10.32.0.10:2181, cluster=class Accumulo {
  instance: TEST_10092015_3
  rootUser: root
  rootPassword: secret
  zkServers: 10.32.0.10:2181
  executorMemory: 128
  tarballUri: hdfs://10.32.0.11:8020/dist/accumulo-1.7.3-bin.tar.gz
  hdfsUri: hdfs://10.32.0.11:8020/accumulo-mesos
  serverGroups: [class Server {
  count: 3
  profile: class ServerProfile {
  name: BasicTserver
  description: Basic Tserver setup
  type: tserver
  memory: 1024
  cpus: 1.0
  launcher: null
  user: accumulo
  siteXml: null
}

}
, class Server {
  count: 1
  profile: class ServerProfile {
  name: BasicMaster
  description: Basic Master setup
  type: master
  memory: 512
  cpus: 1.0
  launcher: null
  user: accumulo
  siteXml: null
}

}
, class Server {
  count: 1
  profile: class ServerProfile {
  name: Monitor
  description: Basic Monitor setup
  type: monitor
  memory: 256
  cpus: 1.0
  launcher: null
  user: accumulo
  siteXml: null
}

}
, class Server {
  count: 1
  profile: class ServerProfile {
  name: BasicGC
  description: Basic Garbage Collector setup
  type: gc
  memory: 256
  cpus: 1.0
  launcher: null
  user: accumulo
  siteXml: null
}

}
]
}
}
2016-07-29 14:13:04 INFO  log:178 - Logging initialized @463ms
2016-07-29 14:13:04 INFO  Main:215 - Starting Framework Webserver
2016-07-29 14:13:04 INFO  Server:301 - jetty-9.1.z-SNAPSHOT
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering aredee.mesos.frameworks.accumulo.framework.api.EchoResource as a root resource class
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering aredee.mesos.frameworks.accumulo.framework.api.ClusterApi as a root resource class
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering aredee.mesos.frameworks.accumulo.framework.api.ConfigApi as a root resource class
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering aredee.mesos.frameworks.accumulo.framework.api.DefaultApi as a root resource class
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering aredee.mesos.frameworks.accumulo.framework.api.StatusApi as a root resource class
Jul 29, 2016 2:13:04 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.18.1 02/19/2014 03:28 AM'
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding aredee.mesos.frameworks.accumulo.framework.api.EchoResource to GuiceManagedComponentProvider with the scope "PerRequest"
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding aredee.mesos.frameworks.accumulo.framework.api.ClusterApi to GuiceManagedComponentProvider with the scope "PerRequest"
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding aredee.mesos.frameworks.accumulo.framework.api.ConfigApi to GuiceManagedComponentProvider with the scope "PerRequest"
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding aredee.mesos.frameworks.accumulo.framework.api.DefaultApi to GuiceManagedComponentProvider with the scope "PerRequest"
Jul 29, 2016 2:13:04 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getComponentProvider
INFO: Binding aredee.mesos.frameworks.accumulo.framework.api.StatusApi to GuiceManagedComponentProvider with the scope "PerRequest"
2016-07-29 14:13:04 INFO  ContextHandler:747 - Started o.e.j.s.ServletContextHandler@27508c5d{/,jar:file:/mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-framework-0.2.0-SNAPSHOT-jar-with-dependencies.jar!/webapp/public,AVAILABLE}
2016-07-29 14:13:04 INFO  ServerConnector:266 - Started ServerConnector@68034211{HTTP/1.1}{10.32.0.10:8192}
2016-07-29 14:13:04 INFO  Server:350 - Started @790ms
2016-07-29 14:13:04 INFO  Main:155 - Initializing mesos-accumulo Scheduler
2016-07-29 14:13:04 INFO  Main:169 - Running mesos-accumulo SchedulerDriver
I0729 14:13:04.885885 24797 sched.cpp:222] Version: 0.28.2
I0729 14:13:04.887879 24856 sched.cpp:326] New master detected at master@10.32.0.10:5050
I0729 14:13:04.888027 24856 sched.cpp:336] No credentials provided. Attempting to register without authentication
I0729 14:13:04.888641 24878 sched.cpp:703] Framework registered with accumulo-mesos-test-125
2016-07-29 14:13:04 INFO  Scheduler:34 - Framework Registered: accumulo-mesos-test-125
2016-07-29 14:13:04 INFO  Scheduler:78 - 5 Resource Offers Recieved
2016-07-29 14:13:04 INFO  Cluster:78 - Received 5 offers
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:40 - Matching 6 tasks to 5 offers
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:48 - Checking offer id 79532170-9966-41c0-b3c9-a024bcf08e58-O110319 for task tserver
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:55 - Found match! task tserver offer 79532170-9966-41c0-b3c9-a024bcf08e58-O110319
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:48 - Checking offer id 79532170-9966-41c0-b3c9-a024bcf08e58-O110320 for task tserver
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:55 - Found match! task tserver offer 79532170-9966-41c0-b3c9-a024bcf08e58-O110320
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:48 - Checking offer id 79532170-9966-41c0-b3c9-a024bcf08e58-O110321 for task tserver
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:55 - Found match! task tserver offer 79532170-9966-41c0-b3c9-a024bcf08e58-O110321
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:48 - Checking offer id 79532170-9966-41c0-b3c9-a024bcf08e58-O110322 for task master
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:55 - Found match! task master offer 79532170-9966-41c0-b3c9-a024bcf08e58-O110322
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:48 - Checking offer id 79532170-9966-41c0-b3c9-a024bcf08e58-O110323 for task monitor
2016-07-29 14:13:04 INFO  MinCpuMinRamFIFOMatcher:55 - Found match! task monitor offer 79532170-9966-41c0-b3c9-a024bcf08e58-O110323
2016-07-29 14:13:04 INFO  Cluster:86 - Found 5 matches for servers from 5 offers
2016-07-29 14:13:04 INFO  Cluster:91 - Launching Server: tserver using offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110319"

2016-07-29 14:13:04 INFO  AccumuloStartExecutorLauncher:161 - Creating executor accumuloExecutor-tserver-0
2016-07-29 14:13:04 INFO  AccumuloStartExecutorLauncher:162 - Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.3;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64;export PATH=/usr/local/tl/geomesa-1.1.0-rc.6/bin:/opt/consul/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/hadoop:/usr/local/bin/hadoop:/usr/local/go/bin;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=tserver -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:210 - Launching task value: "tserver::2717cd0d-13bf-4d3f-9f18-a505585904e2"
 offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110319"
 slave 91518512-06a0-49c3-9c63-225f6aaa9690-S11
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:216 - Launched task. status ?
2016-07-29 14:13:05 INFO  Cluster:98 - Created Task value: "tserver::2717cd0d-13bf-4d3f-9f18-a505585904e2"
 on slave 91518512-06a0-49c3-9c63-225f6aaa9690-S11
2016-07-29 14:13:05 INFO  Cluster:91 - Launching Server: tserver using offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110320"

2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:161 - Creating executor accumuloExecutor-tserver-1
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:162 - Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.3;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64;export PATH=/usr/local/tl/geomesa-1.1.0-rc.6/bin:/opt/consul/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/hadoop:/usr/local/bin/hadoop:/usr/local/go/bin;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=tserver -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:210 - Launching task value: "tserver::c144f829-1af1-4115-a760-4a4f9b3fd768"
 offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110320"
 slave 91518512-06a0-49c3-9c63-225f6aaa9690-S7
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:216 - Launched task. status ?
2016-07-29 14:13:05 INFO  Cluster:98 - Created Task value: "tserver::c144f829-1af1-4115-a760-4a4f9b3fd768"
 on slave 91518512-06a0-49c3-9c63-225f6aaa9690-S7
2016-07-29 14:13:05 INFO  Cluster:91 - Launching Server: tserver using offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110321"

2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:161 - Creating executor accumuloExecutor-tserver-2
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:162 - Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.3;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64;export PATH=/usr/local/tl/geomesa-1.1.0-rc.6/bin:/opt/consul/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/hadoop:/usr/local/bin/hadoop:/usr/local/go/bin;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=tserver -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:210 - Launching task value: "tserver::fdde3bb5-cc9b-4ae1-af8b-0f9b9c7ba88d"
 offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110321"
 slave 79532170-9966-41c0-b3c9-a024bcf08e58-S0
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:216 - Launched task. status ?
2016-07-29 14:13:05 INFO  Cluster:98 - Created Task value: "tserver::fdde3bb5-cc9b-4ae1-af8b-0f9b9c7ba88d"
 on slave 79532170-9966-41c0-b3c9-a024bcf08e58-S0
2016-07-29 14:13:05 INFO  Cluster:91 - Launching Server: master using offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110322"

2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:161 - Creating executor accumuloExecutor-master-3
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:162 - Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.3;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64;export PATH=/usr/local/tl/geomesa-1.1.0-rc.6/bin:/opt/consul/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/hadoop:/usr/local/bin/hadoop:/usr/local/go/bin;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=master -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:210 - Launching task value: "master::8650bbb4-0f82-4413-ab42-265c1c2e6b15"
 offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110322"
 slave 91518512-06a0-49c3-9c63-225f6aaa9690-S10
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:216 - Launched task. status ?
2016-07-29 14:13:05 INFO  Cluster:98 - Created Task value: "master::8650bbb4-0f82-4413-ab42-265c1c2e6b15"
 on slave 91518512-06a0-49c3-9c63-225f6aaa9690-S10
2016-07-29 14:13:05 INFO  Cluster:91 - Launching Server: monitor using offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110323"

2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:161 - Creating executor accumuloExecutor-monitor-4
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:162 - Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.3;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64;export PATH=/usr/local/tl/geomesa-1.1.0-rc.6/bin:/opt/consul/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/hadoop:/usr/local/bin/hadoop:/usr/local/go/bin;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=monitor -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:210 - Launching task value: "monitor::3e308abb-7c7d-4915-9c7a-9299eb2d2382"
 offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110323"
 slave 91518512-06a0-49c3-9c63-225f6aaa9690-S5
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:216 - Launched task. status ?
2016-07-29 14:13:05 INFO  Cluster:98 - Created Task value: "monitor::3e308abb-7c7d-4915-9c7a-9299eb2d2382"
 on slave 91518512-06a0-49c3-9c63-225f6aaa9690-S5
2016-07-29 14:13:05 INFO  Cluster:104 - Declining 0 offers
2016-07-29 14:13:05 INFO  Scheduler:184 - Executor lost: value: "accumuloExecutor-tserver-0"
on slave: value: "91518512-06a0-49c3-9c63-225f6aaa9690-S11"
 number 256
2016-07-29 14:13:05 INFO  Scheduler:120 - Status Update Received
2016-07-29 14:13:05 INFO  Cluster:181 - Finding task tserver::2717cd0d-13bf-4d3f-9f18-a505585904e2 slaveId 91518512-06a0-49c3-9c63-225f6aaa9690-S11
2016-07-29 14:13:05 INFO  Cluster:151 - Task Status Update: Status: TASK_FAILED Slave: 91518512-06a0-49c3-9c63-225f6aaa9690-S11 Task: tserver::2717cd0d-13bf-4d3f-9f18-a505585904e2
2016-07-29 14:13:05 INFO  Scheduler:78 - 1 Resource Offers Recieved
2016-07-29 14:13:05 INFO  Cluster:78 - Received 1 offers
2016-07-29 14:13:05 INFO  MinCpuMinRamFIFOMatcher:40 - Matching 2 tasks to 1 offers
2016-07-29 14:13:05 INFO  MinCpuMinRamFIFOMatcher:48 - Checking offer id 79532170-9966-41c0-b3c9-a024bcf08e58-O110324 for task tserver
2016-07-29 14:13:05 INFO  MinCpuMinRamFIFOMatcher:55 - Found match! task tserver offer 79532170-9966-41c0-b3c9-a024bcf08e58-O110324
2016-07-29 14:13:05 INFO  Cluster:86 - Found 1 matches for servers from 1 offers
2016-07-29 14:13:05 INFO  Cluster:91 - Launching Server: tserver using offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110324"

2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:161 - Creating executor accumuloExecutor-tserver-5
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:162 - Executor command export ACCUMULO_HOME=$MESOS_DIRECTORY/accumulo-1.7.3;export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs;export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64;export PATH=/usr/local/tl/geomesa-1.1.0-rc.6/bin:/opt/consul/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin/hadoop:/usr/local/bin/hadoop:/usr/local/go/bin;export HADOOP_PREFIX=/usr/local/tl/hadoop;export ZOOKEEPER_HOME=/etc/zookeeper;$ACCUMULO_HOME/bin/build_native_library.sh;env;/usr/bin/java -Dserver=tserver -Xmx128m -jar $MESOS_DIRECTORY/accumulo-mesos-dist-0.2.0-SNAPSHOT/accumulo-mesos-executor-0.2.0-SNAPSHOT-jar-with-dependencies.jar
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:210 - Launching task value: "tserver::0831a5e0-be09-4473-91e0-7470fce78ca8"
 offer value: "79532170-9966-41c0-b3c9-a024bcf08e58-O110324"
 slave 91518512-06a0-49c3-9c63-225f6aaa9690-S11
2016-07-29 14:13:05 INFO  AccumuloStartExecutorLauncher:216 - Launched task. status ?
2016-07-29 14:13:05 INFO  Cluster:98 - Created Task value: "tserver::0831a5e0-be09-4473-91e0-7470fce78ca8"
 on slave 91518512-06a0-49c3-9c63-225f6aaa9690-S11
2016-07-29 14:13:05 INFO  Cluster:104 - Declining 0 offers
2016-07-29 14:13:06 INFO  Scheduler:184 - Executor lost: value: "accumuloExecutor-tserver-5"
on slave: value: "91518512-06a0-49c3-9c63-225f6aaa9690-S11"
 number 9
klucar commented 8 years ago

That kind of looks like it started.

If not your launch should be more like

java -jar accumulo-mesos-framework-0.2.0-SNAPSHOT-jar-with-dependencies.jar \ -master 172.16.0.100:5050 \ -zookeepers 172.16.0.100:2181 \ -name TEST-xxxxxx-3

Also I developed this agains Mesos 0.23 I think so some things may have changed that require fixing.

tsaridas commented 8 years ago

I have mesos 0.28.2 I get 

java -jar accumulo-mesos-framework-0.2.0-SNAPSHOT-jar-with-dependencies.jar -master 10.32.0.10:5050 -zookeepers 10.32.0.10:2181 -name TEST_10092015_3
2016-07-29 15:49:03 INFO  Main:68 - Connecting to Mesos state
2016-07-29 15:49:03,529:11681(0x7fb777fff700):ZOO_INFO@log_env@712: Client environment:zookeeper.version=zookeeper C client 3.4.5
2016-07-29 15:49:03,529:11681(0x7fb777fff700):ZOO_INFO@log_env@716: Client environment:host.name=hostname
2016-07-29 15:49:03,529:11681(0x7fb777fff700):ZOO_INFO@log_env@723: Client environment:os.name=Linux
2016-07-29 15:49:03,529:11681(0x7fb777fff700):ZOO_INFO@log_env@724: Client environment:os.arch=3.13.0-71-generic
2016-07-29 15:49:03,529:11681(0x7fb777fff700):ZOO_INFO@log_env@725: Client environment:os.version=#114-Ubuntu SMP Tue Dec 1 02:34:22 UTC 2015
2016-07-29 15:49:03,530:11681(0x7fb777fff700):ZOO_INFO@log_env@733: Client environment:user.name=atsarida
2016-07-29 15:49:03,530:11681(0x7fb777fff700):ZOO_INFO@log_env@741: Client environment:user.home=/var/lib/accumulo
2016-07-29 15:49:03,530:11681(0x7fb777fff700):ZOO_INFO@log_env@753: Client environment:user.dir=/mnt/temp/accumulo-mesos-dist-0.2.0-SNAPSHOT
2016-07-29 15:49:03,530:11681(0x7fb777fff700):ZOO_INFO@zookeeper_init@786: Initiating client connection, host=10.32.0.10:2181 sessionTimeout=3000 watcher=0x7fb7d2a9f750 sessionId=0 sessionPasswd=<null> context=0x7fb74c000960 flags=0
2016-07-29 15:49:03,530:11681(0x7fb771ff3700):ZOO_INFO@check_events@1703: initiated connection to server [10.32.0.10:2181]
2016-07-29 15:49:03,530:11681(0x7fb771ff3700):ZOO_INFO@check_events@1750: session establishment complete on server [10.32.0.10:2181], sessionId=0x154e29a0470015f, negotiated timeout=4000
2016-07-29 15:49:03 ERROR FrameworkStateHelper:140 - Key not found via Execution Exception : registered_frameworks
2016-07-29 15:49:03 INFO  Main:76 - frameworks ? {}
2016-07-29 15:49:03 INFO  Main:119 - Starting mesos-accumumlo framework version 0.2.0-SNAPSHOT
2016-07-29 15:49:03 INFO  Main:135 - Preconditions check: Framework{bindAddress=0.0.0.0, httpPort=18120, dockerImage=null, id=null, mesosMaster=10.32.0.10:5050, name=TEST_10092015_3, tarballUri=null, zkServers=10.32.0.10:2181, cluster=}
2016-07-29 15:49:03 ERROR Main:122 - Unhandled exception encountered, exiting:
java.lang.IllegalStateException
    at com.google.common.base.Preconditions.checkState(Preconditions.java:158)
    at aredee.mesos.frameworks.accumulo.framework.Main.run(Main.java:137)
    at aredee.mesos.frameworks.accumulo.framework.Main.main(Main.java:120)
2016-07-29 15:49:03 INFO  Main:125 - Exiting Accumulo Framework with status: -1