EOSC-LOFAR / prefactor-cwl

CWL version of prefactor
MIT License
3 stars 3 forks source link

Mesos job doesn't start #20

Open gijzelaerr opened 6 years ago

gijzelaerr commented 6 years ago
ubuntu@packer-Ubuntu-16:/code/prefactor-cwl$ make mesos
export PYTHONPATH=/usr/lib/python2.7/site-packages
mkdir -p /code/prefactor-cwl/runs/run_2018-01-13-15-22-11/results
toil-cwl-runner \
        --batchSystem=mesos \
        --mesosMaster=145.100.59.50:5050 \
        --preserve-environment PATH \
        --no-container \
        --logFile /code/prefactor-cwl/runs/run_2018-01-13-15-22-11/log \
        --outdir /code/prefactor-cwl/runs/run_2018-01-13-15-22-11/results \
        --jobStore file:///code/prefactor-cwl/runs/run_2018-01-13-15-22-11/job_store \
        prefactor.cwl \
        jobs/job_20sb.yaml | tee /code/prefactor-cwl/runs/run_2018-01-13-15-22-11/output
packer-Ubuntu-16 2018-01-13 15:22:12,097 MainThread INFO toil.lib.bioio: Root logger is at level 'INFO', 'toil' logger at level 'INFO'.
packer-Ubuntu-16 2018-01-13 15:22:12,097 MainThread INFO toil.lib.bioio: Logging to file '/code/prefactor-cwl/runs/run_2018-01-13-15-22-11/log'.
packer-Ubuntu-16 2018-01-13 15:22:12,097 MainThread INFO toil.lib.bioio: Root logger is at level 'INFO', 'toil' logger at level 'INFO'.
packer-Ubuntu-16 2018-01-13 15:22:12,097 MainThread INFO toil.lib.bioio: Logging to file '/code/prefactor-cwl/runs/run_2018-01-13-15-22-11/log'.
packer-Ubuntu-16 2018-01-13 15:22:12,147 MainThread INFO toil.jobStores.abstractJobStore: The workflow ID is: '1dbad800-e7f8-4fab-99a0-f2db599a21ac'
Resolved 'prefactor.cwl' to 'file:///code/prefactor-cwl/prefactor.cwl'
packer-Ubuntu-16 2018-01-13 15:22:12,148 MainThread INFO cwltool: Resolved 'prefactor.cwl' to 'file:///code/prefactor-cwl/prefactor.cwl'
packer-Ubuntu-16 2018-01-13 15:22:13,126 MainThread WARNING rdflib.term: https://schema.org/docs/!DOCTYPE html does not look like a valid URI, trying to serialize this will break.
packer-Ubuntu-16 2018-01-13 15:22:13,128 MainThread WARNING rdflib.term: https://schema.org/docs/html lang="en" does not look like a valid URI, trying to serialize this will break.
packer-Ubuntu-16 2018-01-13 15:22:13,422 MainThread INFO rdflib.plugins.parsers.pyRdfa: Current options:
                preserve space                         : True
                output processor graph                 : True
                output default graph                   : True
                host language                          : RDFa Core
                accept embedded RDF                    : False
                check rdfa lite                        : False
                cache vocabulary graphs                : False
packer-Ubuntu-16 2018-01-13 15:22:17,875 MainThread INFO toil.common: Using the mesos batch system
WARNING: Logging before InitGoogleLogging() is written to STDERR
W0113 15:22:17.914628 16553 sched.cpp:1727]
**************************************************
Scheduler driver bound to loopback interface! Cannot communicate with remote master(s). You might want to set 'LIBPROCESS_IP' environment variable to use a routable IP address.
**************************************************
I0113 15:22:17.914916 16553 sched.cpp:232] Version: 1.4.1
packer-Ubuntu-16 2018-01-13 15:22:17,914 MainThread INFO toil.common: User script ModuleDescriptor(dirPath='/usr/local/lib/python2.7/dist-packages', name='toil.cwl.cwltoil', fromVirtualEnv=False) belongs to Toil. No need to hot-deploy it.
packer-Ubuntu-16 2018-01-13 15:22:17,915 MainThread INFO toil.common: No user script to hot-deploy.
packer-Ubuntu-16 2018-01-13 15:22:17,915 MainThread INFO toil.common: Written the environment for the jobs to the environment file
I0113 15:22:17.915812 16567 sched.cpp:336] New master detected at master@145.100.59.50:5050
packer-Ubuntu-16 2018-01-13 15:22:17,915 MainThread INFO toil.common: Caching all jobs in job store
I0113 15:22:17.915946 16567 sched.cpp:352] No credentials provided. Attempting to register without authentication
I0113 15:22:17.918217 16562 sched.cpp:759] Framework registered with 3c071e29-0cf4-47e8-81aa-639892d25c80-0001
packer-Ubuntu-16 2018-01-13 15:22:17,935 MainThread INFO toil.common: 0 jobs downloaded.
packer-Ubuntu-16 2018-01-13 15:22:18,192 MainThread INFO toil: Running Toil version 3.13.0a1-4c234e6b793737e9fa88019941241062b30c97c7.
packer-Ubuntu-16 2018-01-13 15:22:18,193 MainThread INFO toil.realtimeLogger: Real-time logging disabled
packer-Ubuntu-16 2018-01-13 15:22:18,212 MainThread INFO toil.toilState: (Re)building internal scheduler state
2018-01-13 15:22:18,212 - toil.toilState - INFO - (Re)building internal scheduler state
packer-Ubuntu-16 2018-01-13 15:22:18,212 MainThread INFO toil.leader: Found 1 jobs to start and 0 jobs with successors to run
2018-01-13 15:22:18,212 - toil.leader - INFO - Found 1 jobs to start and 0 jobs with successors to run
packer-Ubuntu-16 2018-01-13 15:22:18,212 MainThread INFO toil.leader: Checked batch system has no running jobs and no updated jobs
2018-01-13 15:22:18,212 - toil.leader - INFO - Checked batch system has no running jobs and no updated jobs
packer-Ubuntu-16 2018-01-13 15:22:18,216 MainThread INFO toil.leader: Starting the main loop
2018-01-13 15:22:18,216 - toil.leader - INFO - Starting the main loop