mesos / docker-compose-executor

DEPRECATED: Find the new docker compose executor here https://github.com/paypal/dce-go
Apache License 2.0
56 stars 16 forks source link

Issues launching docker compose executor on Marathon #6

Closed bernadinm closed 8 years ago

bernadinm commented 8 years ago

I have issues performing a docker compose from Marathon. It doesn't work for a file online or a file locally accessible.

Current environment: Marathon v 0.14.0-SNAPSHOT Mesos v 0.26.0

Stdout Archive: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example.zip creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/branches/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/config
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/description
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/applypatch-msg.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/commit-msg.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/post-update.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-applypatch.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-commit.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-push.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-rebase.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/prepare-commit-msg.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/update.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/index
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/info/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/info/exclude
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/heads/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/heads/master
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/remotes/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/remotes/origin/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/remotes/origin/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/info/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/pack/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/pack/pack-fea84fa5dd78cef8224db7f5870c68c2d33b1087.idx
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/pack/pack-fea84fa5dd78cef8224db7f5870c68c2d33b1087.pack
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/packed-refs
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/heads/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/heads/master
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/remotes/ creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/remotes/origin/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/remotes/origin/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/tags/ inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/app.py
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/docker-compose.yml
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/docker-compose.yml.old
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/Dockerfile
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/README.md
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/requirements.txt
INFO 2016-03-04 19:41:16,030 0 com.paypal.mesos.executor.monitoring.ComposeMonitor [Thread-1] start montioring is called:/tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/docker-compose-generated.yml ERROR 2016-03-04 19:41:16,128 98 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-2] error executing command java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at java.lang.Runtime.exec(Runtime.java:620) at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61) at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:20) at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:83) at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:79) at rx.Observable.unsafeSubscribe(Observable.java:7710) at rx.internal.operators.OperatorSubscribeOn$1$1.call(OperatorSubscribeOn.java:62) at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:248) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) ... 20 more ERROR 2016-03-04 19:41:16,130 100 com.paypal.mesos.executor.DockerComposeExecutor [RxNewThreadScheduler-2] unable to pull updated images trying to bring the pod up with existing images ERROR 2016-03-04 19:41:16,131 101 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-2] error executing command java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at java.lang.Runtime.exec(Runtime.java:620) at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61) at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:20) at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:88) at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:79) at rx.Observable.unsafeSubscribe(Observable.java:7710) at rx.internal.operators.OperatorSubscribeOn$1$1.call(OperatorSubscribeOn.java:62) at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:248) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) ... 20 more INFO 2016-03-04 19:41:16,133 103 com.paypal.mesos.executor.DockerComposeProcessObserver [RxNewThreadScheduler-1] executor for taskId:docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8 exited with exitCode:1 ERROR 2016-03-04 19:41:16,134 104 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-1] error executing command java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at java.lang.Runtime.exec(Runtime.java:620) at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61) at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:20) at com.paypal.mesos.executor.DockerComposeExecutor.cleanUp(DockerComposeExecutor.java:114) at com.paypal.mesos.executor.DockerComposeExecutor.suicide(DockerComposeExecutor.java:96) at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:38) at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:8) at rx.Observable$30.onNext(Observable.java:7681) at rx.observers.SafeSubscriber.onNext(SafeSubscriber.java:130) at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber.pollQueue(OperatorObserveOn.java:208) at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber$2.call(OperatorObserveOn.java:170) at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:248) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) ... 24 more ERROR 2016-03-04 19:41:16,135 105 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-1] error executing command java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048) at java.lang.Runtime.exec(Runtime.java:620) at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61) at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279) at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166) at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153) at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39) at com.paypal.mesos.executor.monitoring.ComposeMonitor.getContainerIds(ComposeMonitor.java:74) at com.paypal.mesos.executor.DockerComposeExecutor.linuxKill(DockerComposeExecutor.java:122) at com.paypal.mesos.executor.DockerComposeExecutor.cleanUp(DockerComposeExecutor.java:116) at com.paypal.mesos.executor.DockerComposeExecutor.suicide(DockerComposeExecutor.java:96) at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:38) at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:8) at rx.Observable$30.onNext(Observable.java:7681) at rx.observers.SafeSubscriber.onNext(SafeSubscriber.java:130) at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber.pollQueue(OperatorObserveOn.java:208) at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber$2.call(OperatorObserveOn.java:170) at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:248) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029) ... 25 more

gtejasvarma commented 8 years ago

Do you have docker-compose installed ? can you please check user privileges once

bernadinm commented 8 years ago

Thank you. Have you seen this issue instead actually?

I0307 00:15:32.842478 45316 fetcher.cpp:414] Fetcher Info: {"cache_directory":"\/tmp\/mesos\/fetch\/slaves\/837bd4ee-4774-4910-921a-d2c98baac01d-S4\/root","items":[{"action":"BYPASS_CACHE","uri":{"extract":true,"value":"https:\/\/dl.dropboxusercontent.com\/u\/26009359\/web-app.zip"}}],"sandbox_directory":"\/tmp\/mesos\/slaves\/837bd4ee-4774-4910-921a-d2c98baac01d-S4\/frameworks\/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000\/executors\/marathon-docker-compose-demo-test.bb0c15c2-e43c-11e5-aa9a-82f937a600d8\/runs\/de013def-7bfe-41d5-9333-fc5ceb3c268b","user":"root"} I0307 00:15:32.848181 45316 fetcher.cpp:369] Fetching URI 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip' I0307 00:15:32.848207 45316 fetcher.cpp:243] Fetching directly into the sandbox directory I0307 00:15:32.848237 45316 fetcher.cpp:180] Fetching URI 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip' I0307 00:15:32.848268 45316 fetcher.cpp:127] Downloading resource from 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip' to '/tmp/mesos/slaves/837bd4ee-4774-4910-921a-d2c98baac01d-S4/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-test.bb0c15c2-e43c-11e5-aa9a-82f937a600d8/runs/de013def-7bfe-41d5-9333-fc5ceb3c268b/web-app.zip' Failed to fetch 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip': Error downloading resource: Problem with the SSL CA cert (path? access rights?) Failed to synchronize with slave (it's probably exited)

gtejasvarma commented 8 years ago

can you please check if unzip utility is installed on slave ?

bernadinm commented 8 years ago

Yes. I have checked that unzip is installed.

Does this marathon json block work for you? This is what I am using. I've tried changing the URI from https to http and that also failed.

{ "id": "docker-compose-demo-test", "cmd": "echo hello world", "cpus": 1.0, "mem": 64.0, "ports":[0,0,0], "instances": 1, "executor":"/docker-compose-executor.sh", "labels": { "fileName": "web-app/docker-compose.yml" }, "uris":["https://dl.dropboxusercontent.com/u/26009359/web-app.zip"] }

Error: Failed to fetch 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip': Error downloading resource: Problem with the SSL CA cert (path? access rights?) Failed to synchronize with slave (it's probably exited)

ridv commented 8 years ago

Hi Miguel,

Have you tried testing this with a non-https version of the link? i.e http://dl.dropboxusercontent.com/u/26009359/web-app.zip

If that works the problem may be that some libraries are missing on the slaves. I found this on a google search, may be of help. https://issues.apache.org/jira/browse/MESOS-2923

On Mon, Mar 7, 2016 at 5:04 PM, Miguel Bernadin notifications@github.com wrote:

Yes. I have checked that unzip is installed.

Does this marathon json block work for you? This is what I am using. I've tried changing the URI from https to http and that also failed.

{ "id": "docker-compose-demo-test", "cmd": "echo hello world", "cpus": 1.0, "mem": 64.0, "ports":[0,0,0], "instances": 1, "executor":"/docker-compose-executor.sh", "labels": { "fileName": "web-app/docker-compose.yml" }, "uris":["https://dl.dropboxusercontent.com/u/26009359/web-app.zip"] }

Error: Failed to fetch 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip': Error downloading resource: Problem with the SSL CA cert (path? access rights?) Failed to synchronize with slave (it's probably exited)

— Reply to this email directly or view it on GitHub https://github.com/mesos/docker-compose-executor/issues/6#issuecomment-193476442 .

gtejasvarma commented 8 years ago

@bernadinm yes that marathon json block worked for me. tested on mesos 0.25.0 and Docker version 1.9.1, build a34a1d5 Mesos slave is responsible for downloading and extracting uri info. Marathon and executor don't play any part in that.

mbdas commented 8 years ago

Probably we can close the issue?

bernadinm commented 8 years ago

@rdelval, I've tried with the non-https but the results were the same. I have also validated that unzip was installed. I am not sure what else I am missing...

ridv commented 8 years ago

@bernadinm Bummer! I think you'll have better luck figuring out this issue if you post on the Mesos mailing list (http://mesos.apache.org/community/). Like @gtejasvarma , all of that is taken care of by the Mesos Slave.

bernadinm commented 8 years ago

Thanks guys. I will close this thread.