Closed FreddieSun closed 5 years ago
@FreddieSun , thanks for the report! Can you please remove the directory $HOME/.saga
? There seems to be a conflict with an earlier version. Apologies for that!
Thanks for reply. I encountered the problem as follows when run the getting_started examples.
--------------
RADICAL Utils -- Stacktrace [24555] [MainThread]
501 24555 24437 0 2:04PM ttys000 0:00.80 python 00_getting_started.py local.localhost_anaconda
501 24564 24555 0 2:04PM ttys000 0:00.02 rp.control.pubsub.bridge.0000.child
501 24565 24555 0 2:04PM ttys000 0:00.01 rp.state.pubsub.bridge.0000.child
501 24566 24555 0 2:04PM ttys000 0:00.01 rp.log.pubsub.bridge.0000.child
501 24567 24555 0 2:04PM ttys000 0:00.04 rp.update.0.child
501 24568 24555 0 2:04PM ttys000 0:00.01 rp.pmgr.launching.queue.bridge.0000.child
501 24569 24555 0 2:04PM ttys000 0:00.03 rp.pmgr.0000.launching.0.child
Traceback (most recent call last):
File "00_getting_started.py", line 53, in <module>
pmgr = rp.PilotManager(session=session)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
self._session._register_pmgr(self)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
self._dbs.insert_pmgr(pmgr.as_dict())
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
result = self._c.insert(pmgr_doc)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
_check_write_command_response(results)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
raise DuplicateKeyError(error.get("errmsg"), 11000, error)
DuplicateKeyError: E11000 duplicate key error index: rp.test.$_id_ dup key: { : "pmgr.0000" }
--------------
Traceback (most recent call last):
File "00_getting_started.py", line 53, in <module>
pmgr = rp.PilotManager(session=session)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
self._session._register_pmgr(self)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
self._dbs.insert_pmgr(pmgr.as_dict())
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
result = self._c.insert(pmgr_doc)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
_check_write_command_response(results)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
raise DuplicateKeyError(error.get("errmsg"), 11000, error)
pymongo.errors.DuplicateKeyError: E11000 duplicate key error index: rp.test.$_id_ dup key: { : "pmgr.0000" }
(rp2) ✘ ~/miniconda2/envs/rp2/share/radical.pilot/examples rm -r $HOME/.saga
(rp2) ~/miniconda2/envs/rp2/share/radical.pilot/examples vi 00_getting_started.py
(rp2) ~/miniconda2/envs/rp2/share/radical.pilot/examples open 00_getting_started.py
(rp2) ~/miniconda2/envs/rp2/share/radical.pilot/examples python 00_getting_started.py local.localhost_anaconda
(rp2) ~/miniconda2/envs/rp2/share/radical.pilot/examples source ~/.bashrc
(rp2) ~/miniconda2/envs/rp2/share/radical.pilot/examples python 00_getting_started.py local.localhost_anaconda
================================================================================
Getting Started (RP version 0.50.8)
================================================================================
ok
read config ok
--------------------------------------------------------------------------------
submit pilots
create pilot managercaught Exception: E11000 duplicate key error index: rp.test1.$_id_ dup key: { : "pmgr.0000" }
--------------
RADICAL Utils -- Stacktrace [25123] [MainThread]
501 25123 24437 0 2:08PM ttys000 0:00.80 python 00_getting_started.py local.localhost_anaconda
501 25132 25123 0 2:08PM ttys000 0:00.01 rp.control.pubsub.bridge.0000.child
501 25133 25123 0 2:08PM ttys000 0:00.01 rp.state.pubsub.bridge.0000.child
501 25134 25123 0 2:08PM ttys000 0:00.01 rp.log.pubsub.bridge.0000.child
501 25135 25123 0 2:08PM ttys000 0:00.10 rp.update.0.child
501 25136 25123 0 2:08PM ttys000 0:00.01 rp.pmgr.launching.queue.bridge.0000.child
501 25137 25123 0 2:08PM ttys000 0:00.10 rp.pmgr.0000.launching.0.child
Traceback (most recent call last):
File "00_getting_started.py", line 53, in <module>
pmgr = rp.PilotManager(session=session)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
self._session._register_pmgr(self)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
self._dbs.insert_pmgr(pmgr.as_dict())
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
result = self._c.insert(pmgr_doc)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
_check_write_command_response(results)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
raise DuplicateKeyError(error.get("errmsg"), 11000, error)
DuplicateKeyError: E11000 duplicate key error index: rp.test1.$_id_ dup key: { : "pmgr.0000" }
--------------
--------------------------------------------------------------------------------
finalize
closing session test1+ test1 (json)
- pilot.0000 (profiles)
- pilot.0000 (logfiles)
session lifetime: 50.8s ok
Traceback (most recent call last):
File "00_getting_started.py", line 53, in <module>
pmgr = rp.PilotManager(session=session)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/pilot_manager.py", line 132, in __init__
self._session._register_pmgr(self)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/session.py", line 727, in _register_pmgr
self._dbs.insert_pmgr(pmgr.as_dict())
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/radical/pilot/db/database.py", line 190, in insert_pmgr
result = self._c.insert(pmgr_doc)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/collection.py", line 410, in insert
_check_write_command_response(results)
File "/Users/weijiasun/miniconda2/envs/rp2/lib/python2.7/site-packages/pymongo/helpers.py", line 202, in _check_write_command_response
raise DuplicateKeyError(error.get("errmsg"), 11000, error)
pymongo.errors.DuplicateKeyError: E11000 duplicate key error index: rp.test1.$_id_ dup key: { : "pmgr.0000" }
Then I tried
rm -r $HOME/.sage
It still got the same information.
@iparask helped me to debug today, and change some code in getting_started examples. Here is the getting_started code now.
#!/usr/bin/env python
__copyright__ = 'Copyright 2013-2014, http://radical.rutgers.edu'
__license__ = 'MIT'
import os
import sys
import time
import radical.pilot as rp
import radical.utils as ru
dh = ru.DebugHelper()
# ------------------------------------------------------------------------------
#
# READ the RADICAL-Pilot documentation: http://radicalpilot.readthedocs.org/
#
# ------------------------------------------------------------------------------
# ------------------------------------------------------------------------------
#
if __name__ == '__main__':
# we use a reporter class for nicer output
report = ru.Reporter(name='radical.pilot')
report.title('Getting Started (RP version %s)' % rp.version)
# use the resource specified as argument, fall back to localhost
if len(sys.argv) > 2: report.exit('Usage:\t%s [resource]\n\n' % sys.argv[0])
elif len(sys.argv) == 2: resource = sys.argv[1]
else : resource = 'local.localhost_anaconda'
# Create a new session. No need to try/except this: if session creation
# fails, there is not much we can do anyways...
session = rp.Session(uid='test')
# all other pilot code is now tried/excepted. If an exception is caught, we
# can rely on the session object to exist and be valid, and we can thus tear
# the whole RP stack down via a 'session.close()' call in the 'finally'
# clause...
try:
# read the config used for resource details
report.info('read config')
config = ru.read_json('%s/config.json' % os.path.dirname(os.path.abspath(__file__)))
report.ok('>>ok\n')
report.header('submit pilots')
# Add a Pilot Manager. Pilot managers manage one or more ComputePilots.
pmgr = rp.PilotManager(session=session)
# Define an [n]-core local pilot that runs for [x] minutes
# Here we use a dict to initialize the description object
pd_init = {'resource' : resource,
'runtime' : 15, # pilot runtime (min)
'exit_on_error' : True,
'project' : config[resource]['project'],
'queue' : config[resource]['queue'],
'access_schema' : config[resource]['schema'],
'cores' : 2 #config[resource]['cores']
}
pdesc = rp.ComputePilotDescription(pd_init)
# Launch the pilot.
pilot = pmgr.submit_pilots(pdesc)
report.header('submit units')
# Register the ComputePilot in a UnitManager object.
umgr = rp.UnitManager(session=session)
umgr.add_pilots(pilot)
# Create a workload of ComputeUnits.
# Each compute unit runs '/bin/date'.
n = 32 # number of units to run
report.info('create %d unit description(s)\n\t' % n)
cuds = list()
for i in range(0, n):
# create a new CU description, and fill it.
# Here we don't use dict initialization.
cud = rp.ComputeUnitDescription()
cud.executable = '/bin/date'
cud.gpu_processes = 0
cud.cpu_processes = 1
cud.cpu_threads = 1
cud.cpu_process_type = rp.POSIX
cuds.append(cud)
report.progress()
report.ok('>>ok\n')
# Submit the previously created ComputeUnit descriptions to the
# PilotManager. This will trigger the selected scheduler to start
# assigning ComputeUnits to the ComputePilots.
umgr.submit_units(cuds)
# Wait for all compute units to reach a final state (DONE, CANCELED or FAILED).
report.header('gather results')
umgr.wait_units()
except Exception as e:
# Something unexpected happened in the pilot code above
report.error('caught Exception: %s\n' % e)
ru.print_exception_trace()
raise
except (KeyboardInterrupt, SystemExit) as e:
# the callback called sys.exit(), and we can here catch the
# corresponding KeyboardInterrupt exception for shutdown. We also catch
# SystemExit (which gets raised if the main threads exits for some other
# reason).
ru.print_exception_trace()
report.warn('exit requested\n')
finally:
# always clean up the session, no matter if we caught an exception or
# not. This will kill all remaining pilots.
report.header('finalize')
session.close(download=True)
report.header()
# ------------------------------------------------------------------------------
What should I do now? Thank you.
Oh, this is unexpected: it means that RP is attempting to use a session ID which was already used before. Did you by any chance also remove $HOME/.radical/
? Some data are stored there which help RP to keep session IDs unique.
You have two options at this point: purge the old sessions from MongoDB, or try until it succeeds. The latter sounds stupid, I know - but each try will increase the session ID counter, and eventually you's reach the range of unused IDs again (you need to run the same number of attempts before the ID state file got removed).
I hope this is not too confusing... :/ Thanks for your patience!
Thanks for your reply. I create a MongoDB locally and set the DBURL to that one, it doesn't have the duplicate session problem right now. But still cannot run the 00_getting_started problem. And the error information is the same as before. (I remove both the $HOME/.radical and $HOME/.saga folder). Here is the error information from running 01_unit_details.py. I thought it might be helpful. Can you find something from it? Thank you for your patience.
(rp2) ✘ ~/miniconda2/envs/rp2/share/radical.pilot/examples python 01_unit_details.py
2018-09-26 16:03:02,605: radical.saga : MainProcess : MainThread : INFO : python.interpreter version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:02,605: radical.saga : MainProcess : MainThread : INFO : pid/tid: 1495/MainThread
2018-09-26 16:03:02,605: radical.saga : MainProcess : MainThread : INFO : radical.saga version: 0.50.0
================================================================================
Getting Started (RP version 0.50.8)
================================================================================
2018-09-26 16:03:03,079: radical.saga : MainProcess : MainThread : WARNING : ru.get_logger() is deprecated, use ru.Logger()
2018-09-26 16:03:03,080: radical.saga : MainProcess : MainThread : WARNING : ru.get_logger() is deprecated, use ru.Logger()
2018-09-26 16:03:03,080: radical.saga : MainProcess : MainThread : DEBUG : listing adaptor registry: ['saga.adaptors.context.myproxy', 'saga.adaptors.context.x509', 'saga.adaptors.context.ssh', 'saga.adaptors.context.userpass', 'saga.adaptors.shell.shell_job', 'saga.adaptors.shell.shell_file', 'saga.adaptors.shell.shell_resource', 'saga.adaptors.redis.redis_advert', 'saga.adaptors.sge.sgejob', 'saga.adaptors.pbs.pbsjob', 'saga.adaptors.lsf.lsfjob', 'saga.adaptors.condor.condorjob', 'saga.adaptors.slurm.slurm_job', 'saga.adaptors.http.http_file', 'saga.adaptors.aws.ec2_resource', 'saga.adaptors.loadl.loadljob', 'saga.adaptors.globus_online.go_file', 'saga.adaptors.torque.torquejob', 'saga.adaptors.pbspro.pbsprojob', 'saga.adaptors.srm.srmfile', 'saga.adaptors.cobalt.cobaltjob']
2018-09-26 16:03:03,080: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.context.myproxy
2018-09-26 16:03:03,085: radical.saga.api : MainProcess : MainThread : INFO : python.interpreter version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,085: radical.saga.api : MainProcess : MainThread : INFO : pid/tid: 1495/MainThread
2018-09-26 16:03:03,086: radical.saga : MainProcess : MainThread : WARNING : Skipping adaptor saga.adaptors.context.myproxy: loading failed: ''Adaptor' object has no attribute 'opts''
2018-09-26 16:03:03,086: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.context.x509
2018-09-26 16:03:03,088: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.context.x509 for saga.Context API with URL scheme(s) ['x509://']
2018-09-26 16:03:03,088: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.context.ssh
2018-09-26 16:03:03,090: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.context.ssh for saga.Context API with URL scheme(s) ['ssh://']
2018-09-26 16:03:03,090: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.context.userpass
2018-09-26 16:03:03,091: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.context.userpass for saga.Context API with URL scheme(s) ['userpass://']
2018-09-26 16:03:03,091: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.shell.shell_job
2018-09-26 16:03:03,115: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.shell.shell_job for saga.job.Service API with URL scheme(s) ['fork://', 'local://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,115: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.shell.shell_job for saga.job.Job API with URL scheme(s) ['fork://', 'local://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,115: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.shell.shell_file
2018-09-26 16:03:03,129: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.shell.shell_file for saga.namespace.Directory API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,129: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.shell.shell_file for saga.namespace.Entry API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,129: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.shell.shell_file for saga.filesystem.Directory API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,130: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.shell.shell_file for saga.filesystem.File API with URL scheme(s) ['file://', 'local://', 'sftp://', 'gsisftp://', 'ssh://', 'gsissh://']
2018-09-26 16:03:03,130: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.shell.shell_resource
2018-09-26 16:03:03,134: radical.saga : MainProcess : MainThread : WARNING : Skipping adaptor saga.adaptors.shell.shell_resource: beta versions are disabled (v0.1.beta)
2018-09-26 16:03:03,134: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.redis.redis_advert
2018-09-26 16:03:03,141: radical.saga : MainProcess : MainThread : WARNING : Skipping adaptor saga.adaptors.redis.redis_advert 1: module loading failed: No module named redis
2018-09-26 16:03:03,141: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.sge.sgejob
2018-09-26 16:03:03,168: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.sge.sgejob for saga.job.Service API with URL scheme(s) ['sge://', 'sge+ssh://', 'sge+gsissh://']
2018-09-26 16:03:03,168: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.sge.sgejob for saga.job.Job API with URL scheme(s) ['sge://', 'sge+ssh://', 'sge+gsissh://']
2018-09-26 16:03:03,169: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.pbs.pbsjob
2018-09-26 16:03:03,172: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.pbs.pbsjob for saga.job.Service API with URL scheme(s) ['pbs://', 'pbs+ssh://', 'pbs+gsissh://']
2018-09-26 16:03:03,172: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.pbs.pbsjob for saga.job.Job API with URL scheme(s) ['pbs://', 'pbs+ssh://', 'pbs+gsissh://']
2018-09-26 16:03:03,172: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.lsf.lsfjob
2018-09-26 16:03:03,176: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.lsf.lsfjob for saga.job.Service API with URL scheme(s) ['lsf://', 'lsf+ssh://', 'lsf+gsissh://']
2018-09-26 16:03:03,176: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.lsf.lsfjob for saga.job.Job API with URL scheme(s) ['lsf://', 'lsf+ssh://', 'lsf+gsissh://']
2018-09-26 16:03:03,176: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.condor.condorjob
2018-09-26 16:03:03,179: radical.saga.api : MainProcess : MainThread : INFO : use condor_history: False
2018-09-26 16:03:03,179: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.condor.condorjob for saga.job.Service API with URL scheme(s) ['condor://', 'condor+ssh://', 'condor+gsissh://']
2018-09-26 16:03:03,179: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.condor.condorjob for saga.job.Job API with URL scheme(s) ['condor://', 'condor+ssh://', 'condor+gsissh://']
2018-09-26 16:03:03,179: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.slurm.slurm_job
2018-09-26 16:03:03,183: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.slurm.slurm_job for saga.job.Service API with URL scheme(s) ['slurm://', 'slurm+ssh://', 'slurm+gsissh://']
2018-09-26 16:03:03,183: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.slurm.slurm_job for saga.job.Job API with URL scheme(s) ['slurm://', 'slurm+ssh://', 'slurm+gsissh://']
2018-09-26 16:03:03,183: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.http.http_file
2018-09-26 16:03:03,185: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.http.http_file for saga.namespace.Entry API with URL scheme(s) ['http://', 'https://']
2018-09-26 16:03:03,185: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.http.http_file for saga.filesystem.File API with URL scheme(s) ['http://', 'https://']
2018-09-26 16:03:03,186: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.aws.ec2_resource
2018-09-26 16:03:03,296: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.aws.ec2_resource for saga.Context API with URL scheme(s) ['ec2://', 'ec2_keypair://', 'openstack://', 'eucalyptus://', 'euca://', 'aws://', 'amazon://', 'http://', 'https://']
2018-09-26 16:03:03,296: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.aws.ec2_resource for saga.resource.Manager API with URL scheme(s) ['ec2://', 'ec2_keypair://', 'openstack://', 'eucalyptus://', 'euca://', 'aws://', 'amazon://', 'http://', 'https://']
2018-09-26 16:03:03,296: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.aws.ec2_resource for saga.resource.Compute API with URL scheme(s) ['ec2://', 'ec2_keypair://', 'openstack://', 'eucalyptus://', 'euca://', 'aws://', 'amazon://', 'http://', 'https://']
2018-09-26 16:03:03,296: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.loadl.loadljob
2018-09-26 16:03:03,299: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.loadl.loadljob for saga.job.Service API with URL scheme(s) ['loadl://', 'loadl+ssh://', 'loadl+gsissh://']
2018-09-26 16:03:03,299: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.loadl.loadljob for saga.job.Job API with URL scheme(s) ['loadl://', 'loadl+ssh://', 'loadl+gsissh://']
2018-09-26 16:03:03,299: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.globus_online.go_file
2018-09-26 16:03:03,303: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.globus_online.go_file for saga.namespace.Directory API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.globus_online.go_file for saga.namespace.Entry API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.globus_online.go_file for saga.filesystem.Directory API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.globus_online.go_file for saga.filesystem.File API with URL scheme(s) ['go://']
2018-09-26 16:03:03,303: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.torque.torquejob
2018-09-26 16:03:03,306: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.torque.torquejob for saga.job.Service API with URL scheme(s) ['torque://', 'torque+ssh://', 'torque+gsissh://']
2018-09-26 16:03:03,306: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.torque.torquejob for saga.job.Job API with URL scheme(s) ['torque://', 'torque+ssh://', 'torque+gsissh://']
2018-09-26 16:03:03,306: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.pbspro.pbsprojob
2018-09-26 16:03:03,309: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.pbspro.pbsprojob for saga.job.Service API with URL scheme(s) ['pbspro://', 'pbspro+ssh://', 'pbspro+gsissh://']
2018-09-26 16:03:03,309: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.pbspro.pbsprojob for saga.job.Job API with URL scheme(s) ['pbspro://', 'pbspro+ssh://', 'pbspro+gsissh://']
2018-09-26 16:03:03,309: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.srm.srmfile
2018-09-26 16:03:03,312: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.srm.srmfile for saga.namespace.Directory API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.srm.srmfile for saga.namespace.Entry API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.srm.srmfile for saga.filesystem.Directory API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.srm.srmfile for saga.filesystem.File API with URL scheme(s) ['srm://']
2018-09-26 16:03:03,312: radical.saga : MainProcess : MainThread : INFO : loading adaptor saga.adaptors.cobalt.cobaltjob
2018-09-26 16:03:03,315: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.cobalt.cobaltjob for saga.job.Service API with URL scheme(s) ['cobalt://', 'cobalt+ssh://', 'cobalt+gsissh://']
2018-09-26 16:03:03,315: radical.saga : MainProcess : MainThread : INFO : Register adaptor saga.adaptors.cobalt.cobaltjob for saga.job.Job API with URL scheme(s) ['cobalt://', 'cobalt+ssh://', 'cobalt+gsissh://']
2018-09-26 16:03:03,316: radical.utils : MainProcess : MainThread : INFO : python.interpreter version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,316: radical.utils : MainProcess : MainThread : INFO : radical.utils version: 0.50.2
2018-09-26 16:03:03,316: radical.utils : MainProcess : MainThread : INFO : pid/tid: 1495/MainThread
2018-09-26 16:03:03,316: radical.utils : MainProcess : MainThread : DEBUG : lm new manager
2018-09-26 16:03:03,338: radical.saga.cpi : MainProcess : MainThread : INFO : python.interpreter version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,338: radical.saga.cpi : MainProcess : MainThread : INFO : pid/tid: 1495/MainThread
2018-09-26 16:03:03,339: radical.saga.api : MainProcess : MainThread : INFO : default ssh key at /Users/weijiasun/.ssh/id_rsa
2018-09-26 16:03:03,339: radical.saga.api : MainProcess : MainThread : INFO : ignore ssh key at /Users/weijiasun/.ssh/authorized_keys (no public key: /Users/weijiasun/.ssh/authorized_keys.pub)
2018-09-26 16:03:03,339: radical.saga.api : MainProcess : MainThread : INFO : ignore ssh key at /Users/weijiasun/.ssh/known_hosts (no public key: /Users/weijiasun/.ssh/known_hosts.pub)
2018-09-26 16:03:03,351: radical.saga.cpi : MainProcess : MainThread : INFO : init SSH context for key at '/Users/weijiasun/.ssh/id_rsa' done
2018-09-26 16:03:03,352: radical.saga : MainProcess : MainThread : DEBUG : default context [saga.adaptor.ssh ] : {'LifeTime' : '-1', 'Type' : 'ssh', 'UserCert' : '/Users/weijiasun/.ssh/id_rsa.pub', 'UserKey' : '/Users/weijiasun/.ssh/id_rsa'}
2018-09-26 16:03:03,355: radical.saga : MainProcess : MainThread : WARNING : cannot initialize context - no session: {'LifeTime' : '-1', 'Type' : 'ssh', 'UserCert' : '/Users/weijiasun/.ssh/id_rsa.pub', 'UserKey' : '/Users/weijiasun/.ssh/id_rsa'}
new session: [rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000]\
database : [mongodb://localhost:27017/rp2] ok
read config ok
--------------------------------------------------------------------------------
submit pilots
create pilot manager ok
submit 1 pilot(s)
2018-09-26 16:03:03,968: radical.saga.pty : MainProcess : MainThread : INFO : python.interpreter version: 2.7.15 | packaged by conda-forge | (default, Jul 27 2018, 10:23:44) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)]
2018-09-26 16:03:03,968: radical.saga.pty : MainProcess : MainThread : INFO : pid/tid: 1495/MainThread
2018-09-26 16:03:03,968: radical.saga.pty : MainProcess : MainThread : DEBUG : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x110619810>
2018-09-26 16:03:03,970: radical.saga.pty : MainProcess : MainThread : INFO : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:03,971: radical.saga.pty : MainProcess : MainThread : INFO : ssh copy mode set to 'sftp'
2018-09-26 16:03:03,971: radical.saga.pty : MainProcess : MainThread : INFO : ssh share mode set to 'auto'
2018-09-26 16:03:03,971: radical.saga.pty : MainProcess : MainThread : INFO : ssh timeout set to '10.0'
2018-09-26 16:03:03,972: radical.saga.pty : MainProcess : MainThread : DEBUG : open master pty for [sh] [localhost] weijiasun: /usr/bin/env TERM=vt100 "/bin/zsh" -i'
2018-09-26 16:03:03,972: radical.saga.pty : MainProcess : MainThread : DEBUG : PTYProcess init <saga.utils.pty_process.PTYProcess object at 0x110619c10>
2018-09-26 16:03:03,973: radical.saga.pty : MainProcess : MainThread : INFO : running: /usr/bin/env TERM=vt100 /bin/zsh -i
2018-09-26 16:03:03,975: radical.saga.pty : MainProcess : MainThread : DEBUG : write: [ 187] [ 51] ( export PROMPT_COMMAND='' PS1='$' ; set prompt='$'\n)
2018-09-26 16:03:04,165: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 108] ()
2018-09-26 16:03:04,419: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 100] (% )
2018-09-26 16:03:04,422: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 108] ()
2018-09-26 16:03:04,491: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 111] ~/miniconda2/envs/rp2/share/radical.pilot/examples )
2018-09-26 16:03:04,491: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 15] ()
2018-09-26 16:03:04,492: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] ( )
2018-09-26 16:03:04,494: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 3] e)
2018-09-26 16:03:04,494: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (x)
2018-09-26 16:03:04,495: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (p)
2018-09-26 16:03:04,495: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (o)
2018-09-26 16:03:04,496: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (r)
2018-09-26 16:03:04,496: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (t)
2018-09-26 16:03:04,497: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] ( )
2018-09-26 16:03:04,497: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (P)
2018-09-26 16:03:04,498: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (R)
2018-09-26 16:03:04,499: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (O)
2018-09-26 16:03:04,500: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (M)
2018-09-26 16:03:04,500: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (P)
2018-09-26 16:03:04,501: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (T)
2018-09-26 16:03:04,502: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (_)
2018-09-26 16:03:04,502: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (C)
2018-09-26 16:03:04,503: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (O)
2018-09-26 16:03:04,503: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (M)
2018-09-26 16:03:04,504: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (M)
2018-09-26 16:03:04,504: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (A)
2018-09-26 16:03:04,505: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (N)
2018-09-26 16:03:04,506: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (D)
2018-09-26 16:03:04,506: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (=)
2018-09-26 16:03:04,507: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (')
2018-09-26 16:03:04,508: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (')
2018-09-26 16:03:04,508: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 5] ( )
2018-09-26 16:03:04,509: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 3] )
2018-09-26 16:03:04,509: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (P)
2018-09-26 16:03:04,511: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 2] (PS)
2018-09-26 16:03:04,512: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (1)
2018-09-26 16:03:04,513: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (=)
2018-09-26 16:03:04,514: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] (')
2018-09-26 16:03:04,514: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 187] [ 1] ($)
2018-09-26 16:03:04,515: radical.saga.pty : MainProcess : MainThread : DEBUG : got initial shell prompt (6) (% ~/miniconda2/envs/rp2/share/radical.pilot/examples export PROMPT_COMMAND='' PPS1='$)
2018-09-26 16:03:04,515: radical.saga.pty : MainProcess : MainThread : DEBUG : Got initial shell prompt (6) (% ~/miniconda2/envs/rp2/share/radical.pilot/examples export PROMPT_COMMAND='' PPS1='$)
2018-09-26 16:03:04,515: radical.saga.pty : MainProcess : MainThread : DEBUG : PTYProcess init <saga.utils.pty_process.PTYProcess object at 0x110619b50>
2018-09-26 16:03:04,515: radical.saga.pty : MainProcess : MainThread : INFO : running: /usr/bin/env TERM=vt100 /bin/zsh -i
2018-09-26 16:03:04,519: radical.saga.pty : MainProcess : MainThread : DEBUG : write: [ 199] [ 51] ( export PROMPT_COMMAND='' PS1='$' ; set prompt='$'\n)
2018-09-26 16:03:04,629: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 108] ()
2018-09-26 16:03:04,833: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 100] (% )
2018-09-26 16:03:04,836: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 108] ()
2018-09-26 16:03:04,881: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 111] ~/miniconda2/envs/rp2/share/radical.pilot/examples )
2018-09-26 16:03:04,881: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 7] ()
2018-09-26 16:03:04,882: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 8] ()
2018-09-26 16:03:04,882: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,883: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 3] e)
2018-09-26 16:03:04,883: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (x)
2018-09-26 16:03:04,884: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (p)
2018-09-26 16:03:04,884: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (o)
2018-09-26 16:03:04,885: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (r)
2018-09-26 16:03:04,885: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (t)
2018-09-26 16:03:04,886: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,886: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (P)
2018-09-26 16:03:04,886: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (R)
2018-09-26 16:03:04,887: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (O)
2018-09-26 16:03:04,887: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (M)
2018-09-26 16:03:04,888: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (P)
2018-09-26 16:03:04,888: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (T)
2018-09-26 16:03:04,889: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (_)
2018-09-26 16:03:04,889: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (C)
2018-09-26 16:03:04,889: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (O)
2018-09-26 16:03:04,890: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (M)
2018-09-26 16:03:04,890: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (M)
2018-09-26 16:03:04,891: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (A)
2018-09-26 16:03:04,891: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (N)
2018-09-26 16:03:04,892: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (D)
2018-09-26 16:03:04,892: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (=)
2018-09-26 16:03:04,893: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (')
2018-09-26 16:03:04,894: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (')
2018-09-26 16:03:04,894: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 5] ( )
2018-09-26 16:03:04,894: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 3] )
2018-09-26 16:03:04,895: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (P)
2018-09-26 16:03:04,895: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 2] (PS)
2018-09-26 16:03:04,896: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (1)
2018-09-26 16:03:04,896: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (=)
2018-09-26 16:03:04,898: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (')
2018-09-26 16:03:04,899: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ($)
2018-09-26 16:03:04,899: radical.saga.pty : MainProcess : MainThread : DEBUG : got initial shell prompt (6) (% ~/miniconda2/envs/rp2/share/radical.pilot/examples export PROMPT_COMMAND='' PPS1='$)
2018-09-26 16:03:04,899: radical.saga.pty : MainProcess : MainThread : DEBUG : Got initial shell prompt (6) (% ~/miniconda2/envs/rp2/share/radical.pilot/examples export PROMPT_COMMAND='' PPS1='$)
2018-09-26 16:03:04,900: radical.saga.pty : MainProcess : MainThread : DEBUG : running command shell: exec /bin/sh -i
2018-09-26 16:03:04,900: radical.saga.pty : MainProcess : MainThread : DEBUG : write: [ 199] [ 30] ( stty -echo ; exec /bin/sh -i\n)
2018-09-26 16:03:04,900: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (')
2018-09-26 16:03:04,900: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,901: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (;)
2018-09-26 16:03:04,901: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,902: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (s)
2018-09-26 16:03:04,902: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (e)
2018-09-26 16:03:04,903: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (t)
2018-09-26 16:03:04,903: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,903: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (p)
2018-09-26 16:03:04,904: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (r)
2018-09-26 16:03:04,904: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (o)
2018-09-26 16:03:04,905: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (m)
2018-09-26 16:03:04,905: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (p)
2018-09-26 16:03:04,905: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (t)
2018-09-26 16:03:04,906: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (=)
2018-09-26 16:03:04,906: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (')
2018-09-26 16:03:04,907: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ($)
2018-09-26 16:03:04,907: radical.saga.pty : MainProcess : MainThread : DEBUG : flush: [ 199] [ ] (flush pty read cache)
2018-09-26 16:03:04,907: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (')
2018-09-26 16:03:04,907: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ''')
2018-09-26 16:03:04,908: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 7] ()
2018-09-26 16:03:04,908: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 7] (discard data: '')
2018-09-26 16:03:04,908: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 10] (\n)
2018-09-26 16:03:04,908: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 9] (discard data: '
')
2018-09-26 16:03:04,909: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 100] (% )
2018-09-26 16:03:04,909: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 100] (discard data: '% ')
2018-09-26 16:03:04,911: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 108] ()
2018-09-26 16:03:04,911: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 108] (discard data: '')
2018-09-26 16:03:04,935: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 17] $)
2018-09-26 16:03:04,935: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 17] (discard data: '$')
2018-09-26 16:03:04,935: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 15] ()
2018-09-26 16:03:04,935: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 15] (discard data: '')
2018-09-26 16:03:04,936: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,936: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ' ')
2018-09-26 16:03:04,936: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 3] s)
2018-09-26 16:03:04,936: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 3] (discard data: s')
2018-09-26 16:03:04,937: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (t)
2018-09-26 16:03:04,937: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 't')
2018-09-26 16:03:04,937: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (t)
2018-09-26 16:03:04,937: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 't')
2018-09-26 16:03:04,938: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (y)
2018-09-26 16:03:04,938: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'y')
2018-09-26 16:03:04,938: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,938: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ' ')
2018-09-26 16:03:04,938: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (-)
2018-09-26 16:03:04,938: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: '-')
2018-09-26 16:03:04,939: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (e)
2018-09-26 16:03:04,939: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'e')
2018-09-26 16:03:04,939: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (c)
2018-09-26 16:03:04,939: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'c')
2018-09-26 16:03:04,940: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (h)
2018-09-26 16:03:04,940: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'h')
2018-09-26 16:03:04,940: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (o)
2018-09-26 16:03:04,940: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'o')
2018-09-26 16:03:04,941: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,941: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ' ')
2018-09-26 16:03:04,941: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (;)
2018-09-26 16:03:04,941: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ';')
2018-09-26 16:03:04,942: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,942: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ' ')
2018-09-26 16:03:04,942: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (e)
2018-09-26 16:03:04,942: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'e')
2018-09-26 16:03:04,943: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (x)
2018-09-26 16:03:04,943: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'x')
2018-09-26 16:03:04,943: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (e)
2018-09-26 16:03:04,943: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'e')
2018-09-26 16:03:04,944: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (c)
2018-09-26 16:03:04,944: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'c')
2018-09-26 16:03:04,944: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,944: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ' ')
2018-09-26 16:03:04,945: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (/)
2018-09-26 16:03:04,945: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: '/')
2018-09-26 16:03:04,945: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (b)
2018-09-26 16:03:04,945: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'b')
2018-09-26 16:03:04,946: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (i)
2018-09-26 16:03:04,946: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'i')
2018-09-26 16:03:04,946: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (n)
2018-09-26 16:03:04,946: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'n')
2018-09-26 16:03:04,947: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (/)
2018-09-26 16:03:04,947: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: '/')
2018-09-26 16:03:04,947: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (s)
2018-09-26 16:03:04,947: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 's')
2018-09-26 16:03:04,948: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (h)
2018-09-26 16:03:04,948: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'h')
2018-09-26 16:03:04,948: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ( )
2018-09-26 16:03:04,948: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: ' ')
2018-09-26 16:03:04,949: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (-)
2018-09-26 16:03:04,949: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: '-')
2018-09-26 16:03:04,949: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] (i)
2018-09-26 16:03:04,949: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: 'i')
2018-09-26 16:03:04,956: radical.saga.pty : MainProcess : MainThread : DEBUG sttyread : [ exec /bin/sh] )
2018-09-26 16:03:04,956: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ stty[ 139] exec /bin/sha: ')
2018-09-26 16:03:04,956: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 7] ()
2018-09-26 16:03:04,956: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 7] (discard data: '')
2018-09-26 16:03:04,959: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 10] (\n)
2018-09-26 16:03:04,959: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 9] (discard data: '
')
2018-09-26 16:03:04,976: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 1] ($)
2018-09-26 16:03:04,976: radical.saga.pty : MainProcess : MainThread : WARNING : flush: [ 199] [ 1] (discard data: '$')
2018-09-26 16:03:05,085: radical.saga.pty : MainProcess : MainThread : DEBUG : write: [ 199] [ 152] (set HISTFILE=$HOME/.saga_history; PS1='PROMPT-$?->'; PS2=''; PROMPT_COMMAND=''; export PS1 PS2 PROMPT_COMMAND 2>&1 >/dev/null; cd $HOME 2>&1 >/dev/null\n)
2018-09-26 16:03:05,087: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 10] (PROMPT-0->)
2018-09-26 16:03:05,087: radical.saga.pty : MainProcess : MainThread : DEBUG : got new shell prompt
2018-09-26 16:03:05,088: radical.saga.pty : MainProcess : MainThread : DEBUG : flush: [ 199] [ ] (flush pty read cache)
2018-09-26 16:03:05,192: radical.saga.pty : MainProcess : MainThread : DEBUG : flush: [ 199] [ ] (flush pty read cache)
2018-09-26 16:03:05,296: radical.saga.pty : MainProcess : MainThread : DEBUG : run_sync: echo "WORKDIR: $HOME"
2018-09-26 16:03:05,296: radical.saga.pty : MainProcess : MainThread : DEBUG : write: [ 199] [ 22] (echo "WORKDIR: $HOME"\n)
2018-09-26 16:03:05,297: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 27] (WORKDIR: /Users/weijiasun\n)
2018-09-26 16:03:05,297: radical.saga.pty : MainProcess : MainThread : DEBUG : read : [ 199] [ 10] (PROMPT-0->)
2018-09-26 16:03:05,297: radical.saga.pty : MainProcess : MainThread : DEBUG : PTYShell del <saga.utils.pty_shell.PTYShell object at 0x110619810>
2018-09-26 16:03:05,398: radical.saga.pty : MainProcess : MainThread : DEBUG : PTYProcess del <saga.utils.pty_process.PTYProcess object at 0x110619b50>
[local.localhost:32]
ok
--------------------------------------------------------------------------------
submit units
create unit manager ok
add 1 pilot(s) ok
create 2 unit description(s)
.. ok
submit 2 unit(s)
.. ok
--------------------------------------------------------------------------------
gather results
wait for 2 unit(s)
/2018-09-26 16:03:06,862: radical.utils : pmgr.0000.launching.0 : MainThread : DEBUG : lm create pool for file://localhost/shell_file_adaptor_command_shell/ (<type 'str'>) (<radical.utils.lease_manager.LeaseManager object at 0x1102f3090>)
2018-09-26 16:03:06,862: radical.utils : pmgr.0000.launching.0 : MainThread : DEBUG : lm create object for file://localhost/shell_file_adaptor_command_shell/
2018-09-26 16:03:06,863: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x10fb14450>
-2018-09-26 16:03:06,865: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:06,866: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh copy mode set to 'sftp'
2018-09-26 16:03:06,867: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh share mode set to 'auto'
2018-09-26 16:03:06,867: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh timeout set to '10.0'
/2018-09-26 16:03:07,227: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : running command shell: exec /bin/sh -i
\2018-09-26 16:03:07,409: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : got new shell prompt
/2018-09-26 16:03:07,629: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : run_sync: cd / && test -d '/' && cd '/'
2018-09-26 16:03:07,633: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : initialized directory (0)()
-2018-09-26 16:03:07,735: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : run_sync: mkdir -p / && cd / && mkdir -p '/Users/weijiasun/radical.pilot.sandbox/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000/'
\2018-09-26 16:03:07,857: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : run_sync: cd / && cp '//var/folders/zs/4qv8jdrs5nv3mbryc37gtvpw0000gn/T/rp_agent_tar_diruIbW17/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000.pmgr.0000.launching.0.child.tgz' '/Users/weijiasun/radical.pilot.sandbox/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000/rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000.pmgr.0000.launching.0.child.tgz'
2018-09-26 16:03:07,889: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x10fb14a90>
2018-09-26 16:03:07,890: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:07,891: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh copy mode set to 'sftp'
2018-09-26 16:03:07,892: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh share mode set to 'auto'
2018-09-26 16:03:07,893: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh timeout set to '10.0'
\2018-09-26 16:03:08,262: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : running command shell: exec /bin/sh -i
/2018-09-26 16:03:08,449: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : got new shell prompt
-2018-09-26 16:03:08,559: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : PTYShell init <saga.utils.pty_shell.PTYShell object at 0x10fb14b10>
2018-09-26 16:03:08,562: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : PTY prompt pattern: [\$#%>\]]\s*$
2018-09-26 16:03:08,563: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh copy mode set to 'sftp'
2018-09-26 16:03:08,564: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh share mode set to 'auto'
2018-09-26 16:03:08,565: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : INFO : ssh timeout set to '10.0'
-2018-09-26 16:03:08,927: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : running command shell: exec /bin/sh -i
\2018-09-26 16:03:09,119: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : got new shell prompt
-2018-09-26 16:03:09,341: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : run_sync: mkdir -p .saga/adaptors/shell_job/
\2018-09-26 16:03:09,456: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : run_sync: test -f .saga/adaptors/shell_job//wrapper.sh
|2018-09-26 16:03:10,368: radical.saga.cpi : pmgr.0000.launching.0 : MainThread : DEBUG : run_sync: /bin/sh .saga/adaptors/shell_job//wrapper.sh .saga/adaptors/shell_job/
-- ok
caught Exception: 'NoneType' object has no attribute '__getitem__'
--------------------------------------------------------------------------------
finalize
closing session rp.session.nbp-141-205.nbp.ruw.rutgers.edu.weijiasun.017800.0000
\
close unit manager ok
close pilot manager \
wait for 1 pilot(s)
timeout
ok
session lifetime: 25.4s ok
Traceback (most recent call last):
File "01_unit_details.py", line 113, in <module>
unit.exit_code, unit.stderr[:35]))
TypeError: 'NoneType' object has no attribute '__getitem__'
Hello, I tried to install RP on my Macbook Pro. After I install that, I have some problem running the 00_getting_started example. For all the 32 unit, they fail.
Stack:
The error information in the pmgr.0000.launching.0.child.log is as follow:
here is the log files. log.zip