radical-cybertools / radical.pilot

RADICAL-Pilot
http://radical-cybertools.github.io/radical-pilot/index.html
Other
54 stars 23 forks source link

RP fails in running getting_started example #1721

Closed FreddieSun closed 5 years ago

FreddieSun commented 6 years ago

Hello, I tried to install RP on my Macbook Pro. After I install that, I have some problem running the 00_getting_started example. For all the 32 unit, they fail.

Stack:

  python               : 2.7.15
  pythonpath           : 
  virtualenv           : rp2

  radical.pilot        : 0.50.8
  radical.utils        : 0.50.2
  saga                 : 0.50.0

The error information in the pmgr.0000.launching.0.child.log is as follow:

Traceback (most recent call last):
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pmgr/launching/default.py", line 485, in work
    self._start_pilot_bulk(resource, schema, pilots)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pmgr/launching/default.py", line 651, in _start_pilot_bulk
    js_tmp  = rs.job.Service(js_url, session=self._session)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/saga/job/service.py", line 115, in __init__
    url, session, ttype=_ttype)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/saga/base.py", line 104, in __init__
    self._init_task = self._adaptor.init_instance (adaptor_state, *args, **kwargs)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/saga/adaptors/cpi/decorators.py", line 57, in wrap_function
    return sync_function (self, *args, **kwargs)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/saga/adaptors/shell/shell_job.py", line 516, in init_instance
    self.initialize ()
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/saga/adaptors/shell/shell_job.py", line 611, in initialize
    raise saga.NoSuccess ("failed to run bootstrap: (%s)(%s)" % (ret, out))
NoSuccess: failed to run bootstrap: (127)(/bin/sh: .saga/adaptors/shell_job//wrapper.sh: No such file or directory
) (/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/saga/adaptors/shell/shell_job.py +611 (initialize)  :  raise saga.NoSuccess ("failed to run bootstrap: (%s)(%s)" % (ret, out)))

here is the log files. log.zip

andre-merzky commented 6 years ago

@FreddieSun , thanks for the report! Can you please remove the directory $HOME/.saga? There seems to be a conflict with an earlier version. Apologies for that!

FreddieSun commented 6 years ago

Thanks for reply. I encountered the problem as follows when run the getting_started examples.

--------------
RADICAL Utils -- Stacktrace [24555] [MainThread]

  501 24555 24437   0  2:04PM ttys000    0:00.80 python 00_getting_started.py local.localhost_anaconda  
  501 24564 24555   0  2:04PM ttys000    0:00.02 rp.control.pubsub.bridge.0000.child  
  501 24565 24555   0  2:04PM ttys000    0:00.01 rp.state.pubsub.bridge.0000.child  
  501 24566 24555   0  2:04PM ttys000    0:00.01 rp.log.pubsub.bridge.0000.child  
  501 24567 24555   0  2:04PM ttys000    0:00.04 rp.update.0.child  
  501 24568 24555   0  2:04PM ttys000    0:00.01 rp.pmgr.launching.queue.bridge.0000.child  
  501 24569 24555   0  2:04PM ttys000    0:00.03 rp.pmgr.0000.launching.0.child  
Traceback (most recent call last):
File "00_getting_started.py", line 53, in <module>
pmgr = rp.PilotManager(session=session)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
self._session._register_pmgr(self)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
self._dbs.insert_pmgr(pmgr.as_dict())
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
result = self._c.insert(pmgr_doc)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
_check_write_command_response(results)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
raise DuplicateKeyError(error.get("errmsg"), 11000, error)
DuplicateKeyError: E11000 duplicate key error index: rp.test.$_id_ dup key: { : "pmgr.0000" }

--------------
Traceback (most recent call last):
  File "00_getting_started.py", line 53, in <module>
    pmgr = rp.PilotManager(session=session)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
    self._session._register_pmgr(self)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
    self._dbs.insert_pmgr(pmgr.as_dict())
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
    result = self._c.insert(pmgr_doc)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
    _check_write_command_response(results)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
    raise DuplicateKeyError(error.get("errmsg"), 11000, error)
pymongo.errors.DuplicateKeyError: E11000 duplicate key error index: rp.test.$_id_ dup key: { : "pmgr.0000" }
(rp2)  ✘  ~/miniconda2/envs/rp2/share/radical.pilot/examples  rm -r $HOME/.saga
(rp2)  ~/miniconda2/envs/rp2/share/radical.pilot/examples  vi 00_getting_started.py
(rp2)  ~/miniconda2/envs/rp2/share/radical.pilot/examples  open 00_getting_started.py
(rp2)  ~/miniconda2/envs/rp2/share/radical.pilot/examples  python 00_getting_started.py local.localhost_anaconda
(rp2)  ~/miniconda2/envs/rp2/share/radical.pilot/examples  source ~/.bashrc   
(rp2)  ~/miniconda2/envs/rp2/share/radical.pilot/examples  python 00_getting_started.py local.localhost_anaconda

================================================================================
 Getting Started (RP version 0.50.8)                                            
================================================================================

                                                                              ok
read config                                                                   ok

--------------------------------------------------------------------------------
submit pilots                                                                   

create pilot managercaught Exception: E11000 duplicate key error index: rp.test1.$_id_ dup key: { : "pmgr.0000" }
--------------
RADICAL Utils -- Stacktrace [25123] [MainThread]

  501 25123 24437   0  2:08PM ttys000    0:00.80 python 00_getting_started.py local.localhost_anaconda  
  501 25132 25123   0  2:08PM ttys000    0:00.01 rp.control.pubsub.bridge.0000.child  
  501 25133 25123   0  2:08PM ttys000    0:00.01 rp.state.pubsub.bridge.0000.child  
  501 25134 25123   0  2:08PM ttys000    0:00.01 rp.log.pubsub.bridge.0000.child  
  501 25135 25123   0  2:08PM ttys000    0:00.10 rp.update.0.child  
  501 25136 25123   0  2:08PM ttys000    0:00.01 rp.pmgr.launching.queue.bridge.0000.child  
  501 25137 25123   0  2:08PM ttys000    0:00.10 rp.pmgr.0000.launching.0.child  
Traceback (most recent call last):
File "00_getting_started.py", line 53, in <module>
pmgr = rp.PilotManager(session=session)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
self._session._register_pmgr(self)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
self._dbs.insert_pmgr(pmgr.as_dict())
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
result = self._c.insert(pmgr_doc)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
_check_write_command_response(results)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
raise DuplicateKeyError(error.get("errmsg"), 11000, error)
DuplicateKeyError: E11000 duplicate key error index: rp.test1.$_id_ dup key: { : "pmgr.0000" }

--------------

--------------------------------------------------------------------------------
finalize                                                                        

closing session test1+ test1 (json)
- pilot.0000 (profiles)
- pilot.0000 (logfiles)
session lifetime: 50.8s                                                       ok
Traceback (most recent call last):
  File "00_getting_started.py", line 53, in <module>
    pmgr = rp.PilotManager(session=session)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
    self._session._register_pmgr(self)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
    self._dbs.insert_pmgr(pmgr.as_dict())
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
    result = self._c.insert(pmgr_doc)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
    _check_write_command_response(results)
  File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
    raise DuplicateKeyError(error.get("errmsg"), 11000, error)
pymongo.errors.DuplicateKeyError: E11000 duplicate key error index: rp.test1.$_id_ dup key: { : "pmgr.0000" }

Then I tried

rm -r $HOME/.sage

It still got the same information.

@iparask helped me to debug today, and change some code in getting_started examples. Here is the getting_started code now.

#!/usr/bin/env python

__copyright__ = 'Copyright 2013-2014, http://radical.rutgers.edu'
__license__   = 'MIT'

import os
import sys
import time

import radical.pilot as rp
import radical.utils as ru

dh = ru.DebugHelper()

# ------------------------------------------------------------------------------
#
# READ the RADICAL-Pilot documentation: http://radicalpilot.readthedocs.org/
#
# ------------------------------------------------------------------------------

# ------------------------------------------------------------------------------
#
if __name__ == '__main__':

    # we use a reporter class for nicer output
    report = ru.Reporter(name='radical.pilot')
    report.title('Getting Started (RP version %s)' % rp.version)

    # use the resource specified as argument, fall back to localhost
    if   len(sys.argv)  > 2: report.exit('Usage:\t%s [resource]\n\n' % sys.argv[0])
    elif len(sys.argv) == 2: resource = sys.argv[1]
    else                   : resource = 'local.localhost_anaconda'

    # Create a new session. No need to try/except this: if session creation
    # fails, there is not much we can do anyways...
    session = rp.Session(uid='test')

    # all other pilot code is now tried/excepted.  If an exception is caught, we
    # can rely on the session object to exist and be valid, and we can thus tear
    # the whole RP stack down via a 'session.close()' call in the 'finally'
    # clause...
    try:

        # read the config used for resource details
        report.info('read config')
        config = ru.read_json('%s/config.json' % os.path.dirname(os.path.abspath(__file__)))
        report.ok('>>ok\n')

        report.header('submit pilots')

        # Add a Pilot Manager. Pilot managers manage one or more ComputePilots.
        pmgr = rp.PilotManager(session=session)

        # Define an [n]-core local pilot that runs for [x] minutes
        # Here we use a dict to initialize the description object
        pd_init = {'resource'      : resource,
                   'runtime'       : 15,  # pilot runtime (min)
                   'exit_on_error' : True,
                   'project'       : config[resource]['project'],
                   'queue'         : config[resource]['queue'],
                   'access_schema' : config[resource]['schema'],
                   'cores'         : 2 #config[resource]['cores']
                  }
        pdesc = rp.ComputePilotDescription(pd_init)

        # Launch the pilot.
        pilot = pmgr.submit_pilots(pdesc)

        report.header('submit units')

        # Register the ComputePilot in a UnitManager object.
        umgr = rp.UnitManager(session=session)
        umgr.add_pilots(pilot)

        # Create a workload of ComputeUnits.
        # Each compute unit runs '/bin/date'.

        n = 32  # number of units to run
        report.info('create %d unit description(s)\n\t' % n)

        cuds = list()
        for i in range(0, n):

            # create a new CU description, and fill it.
            # Here we don't use dict initialization.
            cud = rp.ComputeUnitDescription()
            cud.executable       = '/bin/date'
            cud.gpu_processes    = 0
            cud.cpu_processes    = 1
            cud.cpu_threads      = 1
            cud.cpu_process_type = rp.POSIX
            cuds.append(cud)
            report.progress()
        report.ok('>>ok\n')

        # Submit the previously created ComputeUnit descriptions to the
        # PilotManager. This will trigger the selected scheduler to start
        # assigning ComputeUnits to the ComputePilots.
        umgr.submit_units(cuds)

        # Wait for all compute units to reach a final state (DONE, CANCELED or FAILED).
        report.header('gather results')
        umgr.wait_units()

    except Exception as e:
        # Something unexpected happened in the pilot code above
        report.error('caught Exception: %s\n' % e)
        ru.print_exception_trace()
        raise

    except (KeyboardInterrupt, SystemExit) as e:
        # the callback called sys.exit(), and we can here catch the
        # corresponding KeyboardInterrupt exception for shutdown.  We also catch
        # SystemExit (which gets raised if the main threads exits for some other
        # reason).
        ru.print_exception_trace()
        report.warn('exit requested\n')

    finally:
        # always clean up the session, no matter if we caught an exception or
        # not.  This will kill all remaining pilots.
        report.header('finalize')
        session.close(download=True)

    report.header()

# ------------------------------------------------------------------------------

What should I do now? Thank you.

andre-merzky commented 6 years ago

Oh, this is unexpected: it means that RP is attempting to use a session ID which was already used before. Did you by any chance also remove $HOME/.radical/? Some data are stored there which help RP to keep session IDs unique.

You have two options at this point: purge the old sessions from MongoDB, or try until it succeeds. The latter sounds stupid, I know - but each try will increase the session ID counter, and eventually you's reach the range of unused IDs again (you need to run the same number of attempts before the ID state file got removed).

I hope this is not too confusing... :/ Thanks for your patience!

FreddieSun commented 6 years ago

Thanks for your reply. I create a MongoDB locally and set the DBURL to that one, it doesn't have the duplicate session problem right now. But still cannot run the 00_getting_started problem. And the error information is the same as before. (I remove both the $HOME/.radical and $HOME/.saga folder). Here is the error information from running 01_unit_details.py. I thought it might be helpful. Can you find something from it? Thank you for your patience.

(rp2)  ✘  ~/miniconda2/envs/rp2/share/radical.pilot/examples  python 01_unit_details.py                            
2018-09-26 16:03:02,605: radical.saga        : MainProcess                     : MainThread     : INFO    : python.interpreter   version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:02,605: radical.saga        : MainProcess                     : MainThread     : INFO    :                      pid/tid: 1495/MainThread
2018-09-26 16:03:02,605: radical.saga        : MainProcess                     : MainThread     : INFO    : radical.saga         version: 0.50.0

================================================================================
 Getting Started (RP version 0.50.8)                                            
================================================================================

2018-09-26 16:03:03,079: radical.saga        : MainProcess                     : MainThread     : WARNING : ru.get_logger() is deprecated, use ru.Logger()
2018-09-26 16:03:03,080: radical.saga        : MainProcess                     : MainThread     : WARNING : ru.get_logger() is deprecated, use ru.Logger()
2018-09-26 16:03:03,080: radical.saga        : MainProcess                     : MainThread     : DEBUG   : listing  adaptor registry: ['saga.adaptors.context.myproxy', 'saga.adaptors.context.x509', 'saga.adaptors.context.ssh', 'saga.adaptors.context.userpass', 'saga.adaptors.shell.shell_job', 'saga.adaptors.shell.shell_file', 'saga.adaptors.shell.shell_resource', 'saga.adaptors.redis.redis_advert', 'saga.adaptors.sge.sgejob', 'saga.adaptors.pbs.pbsjob', 'saga.adaptors.lsf.lsfjob', 'saga.adaptors.condor.condorjob', 'saga.adaptors.slurm.slurm_job', 'saga.adaptors.http.http_file', 'saga.adaptors.aws.ec2_resource', 'saga.adaptors.loadl.loadljob', 'saga.adaptors.globus_online.go_file', 'saga.adaptors.torque.torquejob', 'saga.adaptors.pbspro.pbsprojob', 'saga.adaptors.srm.srmfile', 'saga.adaptors.cobalt.cobaltjob']
2018-09-26 16:03:03,080: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.context.myproxy
2018-09-26 16:03:03,085: radical.saga.api    : MainProcess                     : MainThread     : INFO    : python.interpreter   version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,085: radical.saga.api    : MainProcess                     : MainThread     : INFO    :                      pid/tid: 1495/MainThread
2018-09-26 16:03:03,086: radical.saga        : MainProcess                     : MainThread     : WARNING : Skipping adaptor saga.adaptors.context.myproxy: loading failed: ''Adaptor' object has no attribute 'opts''
2018-09-26 16:03:03,086: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.context.x509
2018-09-26 16:03:03,088: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.context.x509 for saga.Context API with URL scheme(s) ['x509://']
2018-09-26 16:03:03,088: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.context.ssh
2018-09-26 16:03:03,090: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.context.ssh for saga.Context API with URL scheme(s) ['ssh://']
2018-09-26 16:03:03,090: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.context.userpass
2018-09-26 16:03:03,091: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.context.userpass for saga.Context API with URL scheme(s) ['userpass://']
2018-09-26 16:03:03,091: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.shell.shell_job
2018-09-26 16:03:03,115: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.shell.shell_job for saga.job.Service API with URL scheme(s) ['fork://', 'local://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,115: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.shell.shell_job for saga.job.Job API with URL scheme(s) ['fork://', 'local://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,115: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.shell.shell_file
2018-09-26 16:03:03,129: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.shell.shell_file for saga.namespace.Directory API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,129: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.shell.shell_file for saga.namespace.Entry API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,129: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.shell.shell_file for saga.filesystem.Directory API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,130: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.shell.shell_file for saga.filesystem.File API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,130: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.shell.shell_resource
2018-09-26 16:03:03,134: radical.saga        : MainProcess                     : MainThread     : WARNING : Skipping adaptor saga.adaptors.shell.shell_resource: beta versions are disabled (v0.1.beta)
2018-09-26 16:03:03,134: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.redis.redis_advert
2018-09-26 16:03:03,141: radical.saga        : MainProcess                     : MainThread     : WARNING : Skipping adaptor saga.adaptors.redis.redis_advert 1: module loading failed: No module named redis
2018-09-26 16:03:03,141: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.sge.sgejob
2018-09-26 16:03:03,168: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.sge.sgejob for saga.job.Service API with URL scheme(s) ['sge://', 'sge+ssh://', 'sge+gsissh://']
2018-09-26 16:03:03,168: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.sge.sgejob for saga.job.Job API with URL scheme(s) ['sge://', 'sge+ssh://', 'sge+gsissh://']
2018-09-26 16:03:03,169: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.pbs.pbsjob
2018-09-26 16:03:03,172: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.pbs.pbsjob for saga.job.Service API with URL scheme(s) ['pbs://', 'pbs+ssh://', 'pbs+gsissh://']
2018-09-26 16:03:03,172: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.pbs.pbsjob for saga.job.Job API with URL scheme(s) ['pbs://', 'pbs+ssh://', 'pbs+gsissh://']
2018-09-26 16:03:03,172: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.lsf.lsfjob
2018-09-26 16:03:03,176: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.lsf.lsfjob for saga.job.Service API with URL scheme(s) ['lsf://', 'lsf+ssh://', 'lsf+gsissh://']
2018-09-26 16:03:03,176: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.lsf.lsfjob for saga.job.Job API with URL scheme(s) ['lsf://', 'lsf+ssh://', 'lsf+gsissh://']
2018-09-26 16:03:03,176: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.condor.condorjob
2018-09-26 16:03:03,179: radical.saga.api    : MainProcess                     : MainThread     : INFO    : use condor_history: False
2018-09-26 16:03:03,179: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.condor.condorjob for saga.job.Service API with URL scheme(s) ['condor://', 'condor+ssh://', 'condor+gsissh://']
2018-09-26 16:03:03,179: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.condor.condorjob for saga.job.Job API with URL scheme(s) ['condor://', 'condor+ssh://', 'condor+gsissh://']
2018-09-26 16:03:03,179: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.slurm.slurm_job
2018-09-26 16:03:03,183: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.slurm.slurm_job for saga.job.Service API with URL scheme(s) ['slurm://', 'slurm+ssh://', 'slurm+gsissh://']
2018-09-26 16:03:03,183: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.slurm.slurm_job for saga.job.Job API with URL scheme(s) ['slurm://', 'slurm+ssh://', 'slurm+gsissh://']
2018-09-26 16:03:03,183: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.http.http_file
2018-09-26 16:03:03,185: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.http.http_file for saga.namespace.Entry API with URL scheme(s) ['http://', 'https://']
2018-09-26 16:03:03,185: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.http.http_file for saga.filesystem.File API with URL scheme(s) ['http://', 'https://']
2018-09-26 16:03:03,186: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.aws.ec2_resource
2018-09-26 16:03:03,296: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.aws.ec2_resource for saga.Context API with URL scheme(s) ['ec2://', 'ec2_keypair://', 'openstack://', 'eucalyptus://', 'euca://', 'aws://', 'amazon://', 'http://', 'https://']
2018-09-26 16:03:03,296: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.aws.ec2_resource for saga.resource.Manager API with URL scheme(s) ['ec2://', 'ec2_keypair://', 'openstack://', 'eucalyptus://', 'euca://', 'aws://', 'amazon://', 'http://', 'https://']
2018-09-26 16:03:03,296: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.aws.ec2_resource for saga.resource.Compute API with URL scheme(s) ['ec2://', 'ec2_keypair://', 'openstack://', 'eucalyptus://', 'euca://', 'aws://', 'amazon://', 'http://', 'https://']
2018-09-26 16:03:03,296: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.loadl.loadljob
2018-09-26 16:03:03,299: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.loadl.loadljob for saga.job.Service API with URL scheme(s) ['loadl://', 'loadl+ssh://', 'loadl+gsissh://']
2018-09-26 16:03:03,299: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.loadl.loadljob for saga.job.Job API with URL scheme(s) ['loadl://', 'loadl+ssh://', 'loadl+gsissh://']
2018-09-26 16:03:03,299: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.globus_online.go_file
2018-09-26 16:03:03,303: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.globus_online.go_file for saga.namespace.Directory API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.globus_online.go_file for saga.namespace.Entry API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.globus_online.go_file for saga.filesystem.Directory API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.globus_online.go_file for saga.filesystem.File API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.torque.torquejob
2018-09-26 16:03:03,306: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.torque.torquejob for saga.job.Service API with URL scheme(s) ['torque://', 'torque+ssh://', 'torque+gsissh://']
2018-09-26 16:03:03,306: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.torque.torquejob for saga.job.Job API with URL scheme(s) ['torque://', 'torque+ssh://', 'torque+gsissh://']
2018-09-26 16:03:03,306: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.pbspro.pbsprojob
2018-09-26 16:03:03,309: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.pbspro.pbsprojob for saga.job.Service API with URL scheme(s) ['pbspro://', 'pbspro+ssh://', 'pbspro+gsissh://']
2018-09-26 16:03:03,309: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.pbspro.pbsprojob for saga.job.Job API with URL scheme(s) ['pbspro://', 'pbspro+ssh://', 'pbspro+gsissh://']
2018-09-26 16:03:03,309: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.srm.srmfile
2018-09-26 16:03:03,312: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.srm.srmfile for saga.namespace.Directory API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.srm.srmfile for saga.namespace.Entry API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.srm.srmfile for saga.filesystem.Directory API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.srm.srmfile for saga.filesystem.File API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga        : MainProcess                     : MainThread     : INFO    : loading  adaptor saga.adaptors.cobalt.cobaltjob
2018-09-26 16:03:03,315: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.cobalt.cobaltjob for saga.job.Service API with URL scheme(s) ['cobalt://', 'cobalt+ssh://', 'cobalt+gsissh://']
2018-09-26 16:03:03,315: radical.saga        : MainProcess                     : MainThread     : INFO    : Register adaptor saga.adaptors.cobalt.cobaltjob for saga.job.Job API with URL scheme(s) ['cobalt://', 'cobalt+ssh://', 'cobalt+gsissh://']
2018-09-26 16:03:03,316: radical.utils       : MainProcess                     : MainThread     : INFO    : python.interpreter   version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,316: radical.utils       : MainProcess                     : MainThread     : INFO    : radical.utils        version: 0.50.2
2018-09-26 16:03:03,316: radical.utils       : MainProcess                     : MainThread     : INFO    :                      pid/tid: 1495/MainThread
2018-09-26 16:03:03,316: radical.utils       : MainProcess                     : MainThread     : DEBUG   : lm new manager
2018-09-26 16:03:03,338: radical.saga.cpi    : MainProcess                     : MainThread     : INFO    : python.interpreter   version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,338: radical.saga.cpi    : MainProcess                     : MainThread     : INFO    :                      pid/tid: 1495/MainThread
2018-09-26 16:03:03,339: radical.saga.api    : MainProcess                     : MainThread     : INFO    : default ssh key at /Users/weijiasun/.ssh/id_rsa
2018-09-26 16:03:03,339: radical.saga.api    : MainProcess                     : MainThread     : INFO    : ignore ssh key at /Users/weijiasun/.ssh/authorized_keys (no public key: /Users/weijiasun/.ssh/authorized_keys.pub)
2018-09-26 16:03:03,339: radical.saga.api    : MainProcess                     : MainThread     : INFO    : ignore ssh key at /Users/weijiasun/.ssh/known_hosts (no public key: /Users/weijiasun/.ssh/known_hosts.pub)
2018-09-26 16:03:03,351: radical.saga.cpi    : MainProcess                     : MainThread     : INFO    : init SSH context for key  at '/Users/weijiasun/.ssh/id_rsa' done
2018-09-26 16:03:03,352: radical.saga        : MainProcess                     : MainThread     : DEBUG   : default context [saga.adaptor.ssh    ] : {'LifeTime' : '-1', 'Type' : 'ssh', 'UserCert' : '/Users/weijiasun/.ssh/id_rsa.pub', 'UserKey' : '/Users/weijiasun/.ssh/id_rsa'}
2018-09-26 16:03:03,355: radical.saga        : MainProcess                     : MainThread     : WARNING : cannot initialize context - no session: {'LifeTime' : '-1', 'Type' : 'ssh', 'UserCert' : '/Users/weijiasun/.ssh/id_rsa.pub', 'UserKey' : '/Users/weijiasun/.ssh/id_rsa'}
new session: [rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000]\
database   : [mongodb://localhost:27017/rp2]                                  ok
read config                                                                   ok

--------------------------------------------------------------------------------
submit pilots                                                                   

create pilot manager                                                          ok
submit 1 pilot(s)
        2018-09-26 16:03:03,968: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : python.interpreter   version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,968: radical.saga.pty    : MainProcess                     : MainThread     : INFO    :                      pid/tid: 1495/MainThread
2018-09-26 16:03:03,968: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x110619810>
2018-09-26 16:03:03,970: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:03,971: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : ssh copy  mode set to 'sftp'
2018-09-26 16:03:03,971: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : ssh share mode set to 'auto'
2018-09-26 16:03:03,971: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : ssh timeout    set to '10.0'
2018-09-26 16:03:03,972: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : open master pty for [sh] [localhost] weijiasun: /usr/bin/env TERM=vt100  "/bin/zsh"  -i'
2018-09-26 16:03:03,972: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : PTYProcess init <saga.utils.pty_process.PTYProcess object at 0x110619c10>
2018-09-26 16:03:03,973: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : running: /usr/bin/env TERM=vt100 /bin/zsh -i
2018-09-26 16:03:03,975: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : write: [  187] [   51] ( export PROMPT_COMMAND='' PS1='$' ; set prompt='$'\n)
2018-09-26 16:03:04,165: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [  108] ()
2018-09-26 16:03:04,419: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [  100] (%                                                                                )
2018-09-26 16:03:04,422: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [  108] ()
2018-09-26 16:03:04,491: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [  111]  ~/miniconda2/envs/rp2/share/radical.pilot/examples  )
2018-09-26 16:03:04,491: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [   15] ()
2018-09-26 16:03:04,492: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] ( )
2018-09-26 16:03:04,494: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    3] e)
2018-09-26 16:03:04,494: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (x)
2018-09-26 16:03:04,495: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (p)
2018-09-26 16:03:04,495: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (o)
2018-09-26 16:03:04,496: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (r)
2018-09-26 16:03:04,496: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (t)
2018-09-26 16:03:04,497: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] ( )
2018-09-26 16:03:04,497: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (P)
2018-09-26 16:03:04,498: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (R)
2018-09-26 16:03:04,499: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (O)
2018-09-26 16:03:04,500: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (M)
2018-09-26 16:03:04,500: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (P)
2018-09-26 16:03:04,501: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (T)
2018-09-26 16:03:04,502: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (_)
2018-09-26 16:03:04,502: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (C)
2018-09-26 16:03:04,503: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (O)
2018-09-26 16:03:04,503: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (M)
2018-09-26 16:03:04,504: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (M)
2018-09-26 16:03:04,504: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (A)
2018-09-26 16:03:04,505: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (N)
2018-09-26 16:03:04,506: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (D)
2018-09-26 16:03:04,506: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (=)
2018-09-26 16:03:04,507: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (')
2018-09-26 16:03:04,508: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (')
2018-09-26 16:03:04,508: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    5] (  )
2018-09-26 16:03:04,509: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    3] )
2018-09-26 16:03:04,509: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (P)
2018-09-26 16:03:04,511: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    2] (PS)
2018-09-26 16:03:04,512: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (1)
2018-09-26 16:03:04,513: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (=)
2018-09-26 16:03:04,514: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] (')
2018-09-26 16:03:04,514: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  187] [    1] ($)
2018-09-26 16:03:04,515: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : got initial shell prompt (6) (%                                                                                 ~/miniconda2/envs/rp2/share/radical.pilot/examples   export PROMPT_COMMAND=''  PPS1='$)
2018-09-26 16:03:04,515: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : Got initial shell prompt (6) (%                                                                                 ~/miniconda2/envs/rp2/share/radical.pilot/examples   export PROMPT_COMMAND=''  PPS1='$)
2018-09-26 16:03:04,515: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : PTYProcess init <saga.utils.pty_process.PTYProcess object at 0x110619b50>
2018-09-26 16:03:04,515: radical.saga.pty    : MainProcess                     : MainThread     : INFO    : running: /usr/bin/env TERM=vt100 /bin/zsh -i
2018-09-26 16:03:04,519: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : write: [  199] [   51] ( export PROMPT_COMMAND='' PS1='$' ; set prompt='$'\n)
2018-09-26 16:03:04,629: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [  108] ()
2018-09-26 16:03:04,833: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [  100] (%                                                                                )
2018-09-26 16:03:04,836: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [  108] ()
2018-09-26 16:03:04,881: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [  111]  ~/miniconda2/envs/rp2/share/radical.pilot/examples  )
2018-09-26 16:03:04,881: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    7] ()
2018-09-26 16:03:04,882: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    8] ()
2018-09-26 16:03:04,882: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,883: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    3] e)
2018-09-26 16:03:04,883: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (x)
2018-09-26 16:03:04,884: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (p)
2018-09-26 16:03:04,884: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (o)
2018-09-26 16:03:04,885: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (r)
2018-09-26 16:03:04,885: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (t)
2018-09-26 16:03:04,886: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,886: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (P)
2018-09-26 16:03:04,886: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (R)
2018-09-26 16:03:04,887: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (O)
2018-09-26 16:03:04,887: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (M)
2018-09-26 16:03:04,888: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (P)
2018-09-26 16:03:04,888: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (T)
2018-09-26 16:03:04,889: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (_)
2018-09-26 16:03:04,889: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (C)
2018-09-26 16:03:04,889: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (O)
2018-09-26 16:03:04,890: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (M)
2018-09-26 16:03:04,890: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (M)
2018-09-26 16:03:04,891: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (A)
2018-09-26 16:03:04,891: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (N)
2018-09-26 16:03:04,892: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (D)
2018-09-26 16:03:04,892: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (=)
2018-09-26 16:03:04,893: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (')
2018-09-26 16:03:04,894: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (')
2018-09-26 16:03:04,894: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    5] (  )
2018-09-26 16:03:04,894: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    3] )
2018-09-26 16:03:04,895: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (P)
2018-09-26 16:03:04,895: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    2] (PS)
2018-09-26 16:03:04,896: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (1)
2018-09-26 16:03:04,896: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (=)
2018-09-26 16:03:04,898: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (')
2018-09-26 16:03:04,899: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ($)
2018-09-26 16:03:04,899: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : got initial shell prompt (6) (%                                                                                 ~/miniconda2/envs/rp2/share/radical.pilot/examples   export PROMPT_COMMAND=''  PPS1='$)
2018-09-26 16:03:04,899: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : Got initial shell prompt (6) (%                                                                                 ~/miniconda2/envs/rp2/share/radical.pilot/examples   export PROMPT_COMMAND=''  PPS1='$)
2018-09-26 16:03:04,900: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : running command shell: exec /bin/sh -i
2018-09-26 16:03:04,900: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : write: [  199] [   30] ( stty -echo ; exec /bin/sh -i\n)
2018-09-26 16:03:04,900: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (')
2018-09-26 16:03:04,900: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,901: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (;)
2018-09-26 16:03:04,901: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,902: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (s)
2018-09-26 16:03:04,902: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (e)
2018-09-26 16:03:04,903: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (t)
2018-09-26 16:03:04,903: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,903: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (p)
2018-09-26 16:03:04,904: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (r)
2018-09-26 16:03:04,904: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (o)
2018-09-26 16:03:04,905: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (m)
2018-09-26 16:03:04,905: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (p)
2018-09-26 16:03:04,905: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (t)
2018-09-26 16:03:04,906: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (=)
2018-09-26 16:03:04,906: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (')
2018-09-26 16:03:04,907: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ($)
2018-09-26 16:03:04,907: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : flush: [  199] [     ] (flush pty read cache)
2018-09-26 16:03:04,907: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (')
2018-09-26 16:03:04,907: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ''')
2018-09-26 16:03:04,908: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    7] ()
2018-09-26 16:03:04,908: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    7] (discard data: '')
2018-09-26 16:03:04,908: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   10] (\n)
2018-09-26 16:03:04,908: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    9] (discard data: '
')
2018-09-26 16:03:04,909: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [  100] (%                                                                                )
2018-09-26 16:03:04,909: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [  100] (discard data: '%                                                                                ')
2018-09-26 16:03:04,911: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [  108] ()
2018-09-26 16:03:04,911: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [  108] (discard data: '')
2018-09-26 16:03:04,935: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   17] $)
2018-09-26 16:03:04,935: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [   17] (discard data: '$')
2018-09-26 16:03:04,935: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   15] ()
2018-09-26 16:03:04,935: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [   15] (discard data: '')
2018-09-26 16:03:04,936: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,936: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ' ')
2018-09-26 16:03:04,936: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    3] s)
2018-09-26 16:03:04,936: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    3] (discard data:  s')
2018-09-26 16:03:04,937: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (t)
2018-09-26 16:03:04,937: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 't')
2018-09-26 16:03:04,937: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (t)
2018-09-26 16:03:04,937: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 't')
2018-09-26 16:03:04,938: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (y)
2018-09-26 16:03:04,938: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'y')
2018-09-26 16:03:04,938: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,938: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ' ')
2018-09-26 16:03:04,938: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (-)
2018-09-26 16:03:04,938: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: '-')
2018-09-26 16:03:04,939: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (e)
2018-09-26 16:03:04,939: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'e')
2018-09-26 16:03:04,939: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (c)
2018-09-26 16:03:04,939: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'c')
2018-09-26 16:03:04,940: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (h)
2018-09-26 16:03:04,940: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'h')
2018-09-26 16:03:04,940: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (o)
2018-09-26 16:03:04,940: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'o')
2018-09-26 16:03:04,941: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,941: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ' ')
2018-09-26 16:03:04,941: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (;)
2018-09-26 16:03:04,941: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ';')
2018-09-26 16:03:04,942: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,942: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ' ')
2018-09-26 16:03:04,942: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (e)
2018-09-26 16:03:04,942: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'e')
2018-09-26 16:03:04,943: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (x)
2018-09-26 16:03:04,943: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'x')
2018-09-26 16:03:04,943: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (e)
2018-09-26 16:03:04,943: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'e')
2018-09-26 16:03:04,944: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (c)
2018-09-26 16:03:04,944: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'c')
2018-09-26 16:03:04,944: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,944: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ' ')
2018-09-26 16:03:04,945: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (/)
2018-09-26 16:03:04,945: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: '/')
2018-09-26 16:03:04,945: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (b)
2018-09-26 16:03:04,945: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'b')
2018-09-26 16:03:04,946: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (i)
2018-09-26 16:03:04,946: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'i')
2018-09-26 16:03:04,946: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (n)
2018-09-26 16:03:04,946: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'n')
2018-09-26 16:03:04,947: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (/)
2018-09-26 16:03:04,947: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: '/')
2018-09-26 16:03:04,947: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (s)
2018-09-26 16:03:04,947: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 's')
2018-09-26 16:03:04,948: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (h)
2018-09-26 16:03:04,948: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'h')
2018-09-26 16:03:04,948: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ( )
2018-09-26 16:03:04,948: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: ' ')
2018-09-26 16:03:04,949: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (-)
2018-09-26 16:03:04,949: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: '-')
2018-09-26 16:03:04,949: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] (i)
2018-09-26 16:03:04,949: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: 'i')
2018-09-26 16:03:04,956: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG sttyread : [ exec /bin/sh] )
2018-09-26 16:03:04,956: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [   stty[  139] exec /bin/sha: ')
2018-09-26 16:03:04,956: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    7] ()
2018-09-26 16:03:04,956: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    7] (discard data: '')
2018-09-26 16:03:04,959: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   10] (\n)
2018-09-26 16:03:04,959: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    9] (discard data: '
')
2018-09-26 16:03:04,976: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [    1] ($)
2018-09-26 16:03:04,976: radical.saga.pty    : MainProcess                     : MainThread     : WARNING : flush: [  199] [    1] (discard data: '$')
2018-09-26 16:03:05,085: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : write: [  199] [  152] (set HISTFILE=$HOME/.saga_history; PS1='PROMPT-$?->'; PS2=''; PROMPT_COMMAND=''; export PS1 PS2 PROMPT_COMMAND 2>&1 >/dev/null; cd $HOME 2>&1 >/dev/null\n)
2018-09-26 16:03:05,087: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   10] (PROMPT-0->)
2018-09-26 16:03:05,087: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : got new shell prompt
2018-09-26 16:03:05,088: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : flush: [  199] [     ] (flush pty read cache)
2018-09-26 16:03:05,192: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : flush: [  199] [     ] (flush pty read cache)
2018-09-26 16:03:05,296: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : run_sync: echo "WORKDIR: $HOME"
2018-09-26 16:03:05,296: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : write: [  199] [   22] (echo "WORKDIR: $HOME"\n)
2018-09-26 16:03:05,297: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   27] (WORKDIR: /Users/weijiasun\n)
2018-09-26 16:03:05,297: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : read : [  199] [   10] (PROMPT-0->)
2018-09-26 16:03:05,297: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : PTYShell del  <saga.utils.pty_shell.PTYShell object at 0x110619810>
2018-09-26 16:03:05,398: radical.saga.pty    : MainProcess                     : MainThread     : DEBUG   : PTYProcess del  <saga.utils.pty_process.PTYProcess object at 0x110619b50>
[local.localhost:32]
                                                                              ok

--------------------------------------------------------------------------------
submit units                                                                    

create unit manager                                                           ok
add 1 pilot(s)                                                                ok
create 2 unit description(s)
        ..                                                                    ok
submit 2 unit(s)
        ..                                                                    ok

--------------------------------------------------------------------------------
gather results                                                                  

wait for 2 unit(s)
        /2018-09-26 16:03:06,862: radical.utils       : pmgr.0000.launching.0           : MainThread     : DEBUG   : lm create  pool   for file://localhost/shell_file_adaptor_command_shell/ (<type 'str'>) (<radical.utils.lease_manager.LeaseManager object at 0x1102f3090>)
2018-09-26 16:03:06,862: radical.utils       : pmgr.0000.launching.0           : MainThread     : DEBUG   : lm create  object for file://localhost/shell_file_adaptor_command_shell/
2018-09-26 16:03:06,863: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x10fb14450>
-2018-09-26 16:03:06,865: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:06,866: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh copy  mode set to 'sftp'
2018-09-26 16:03:06,867: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh share mode set to 'auto'
2018-09-26 16:03:06,867: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh timeout    set to '10.0'
/2018-09-26 16:03:07,227: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : running command shell: exec /bin/sh -i
\2018-09-26 16:03:07,409: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : got new shell prompt
/2018-09-26 16:03:07,629: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : run_sync: cd / &&  test -d  '/' && cd '/'
2018-09-26 16:03:07,633: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : initialized directory (0)()
-2018-09-26 16:03:07,735: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : run_sync: mkdir -p / && cd / &&  mkdir -p '/Users/weijiasun/radical.pilot.sandbox/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000/'
\2018-09-26 16:03:07,857: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : run_sync: cd / &&  cp  '//var/folders/zs/4qv8jdrs5nv3mbryc37gtvpw0000gn/T/rp_agent_tar_diruIbW17/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000.pmgr.0000.launching.0.child.tgz' '/Users/weijiasun/radical.pilot.sandbox/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000.pmgr.0000.launching.0.child.tgz'
2018-09-26 16:03:07,889: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x10fb14a90>
2018-09-26 16:03:07,890: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:07,891: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh copy  mode set to 'sftp'
2018-09-26 16:03:07,892: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh share mode set to 'auto'
2018-09-26 16:03:07,893: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh timeout    set to '10.0'
\2018-09-26 16:03:08,262: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : running command shell: exec /bin/sh -i
/2018-09-26 16:03:08,449: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : got new shell prompt
-2018-09-26 16:03:08,559: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x10fb14b10>
2018-09-26 16:03:08,562: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:08,563: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh copy  mode set to 'sftp'
2018-09-26 16:03:08,564: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh share mode set to 'auto'
2018-09-26 16:03:08,565: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : INFO    : ssh timeout    set to '10.0'
-2018-09-26 16:03:08,927: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : running command shell: exec /bin/sh -i
\2018-09-26 16:03:09,119: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : got new shell prompt
-2018-09-26 16:03:09,341: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : run_sync: mkdir -p .saga/adaptors/shell_job/
\2018-09-26 16:03:09,456: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : run_sync: test -f .saga/adaptors/shell_job//wrapper.sh
|2018-09-26 16:03:10,368: radical.saga.cpi    : pmgr.0000.launching.0           : MainThread     : DEBUG   : run_sync: /bin/sh .saga/adaptors/shell_job//wrapper.sh .saga/adaptors/shell_job/
--                                                                    ok

caught Exception: 'NoneType' object has no attribute '__getitem__'

--------------------------------------------------------------------------------
finalize                                                                        

closing session rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000
        \
close unit manager                                                            ok
close pilot manager                                                            \
wait for 1 pilot(s)
                                                                         timeout
                                                                              ok
session lifetime: 25.4s                                                       ok
Traceback (most recent call last):
  File "01_unit_details.py", line 113, in <module>
    unit.exit_code, unit.stderr[:35]))
TypeError: 'NoneType' object has no attribute '__getitem__'