Closed dinesh-ganapati closed 9 years ago
andre-merzky
commented
9 years ago Hi Dinesh -- thanks for running the tests! Alas, from the log above, I don't really see which tests fail, and which what error. Searching for 'FAIL' yields no match. What am I missing?
dinesh-ganapati
commented
9 years ago Hi Andre, I just copied the parts where I saw some sort of failure. (test__issue_162_part_1 and 2 , test_pilot_errors). I did see an 'ok' at the end of each and every the test. What I might have missed is maybe the test involves creating a a faliure condtion?(like failing to launch pilot). The test summary didn't mention any FAILS, it just said run 31 tests in 1640 seconds. Did I misunderstand something ? Would running it again help?
Thanks and regards, Dinesh
On Thu, Sep 4, 2014 at 1:49 PM, Andre Merzky notifications@github.com wrote:
Hi Dinesh -- thanks for running the tests! Alas, from the log above, I don't really see which tests fail, and which what error. Searching for 'FAIL' yields no match. What am I missing?
— Reply to this email directly or view it on GitHub https://github.com/radical-cybertools/radical.pilot/issues/328#issuecomment-54516860 .
andre-merzky
commented
9 years ago Ah, got it! Yes, the tests include creating failure conditions on purpose, so you will see some stack traces floating by. If you look closely, they come from invalid sandbox names. If the summary says that there were no errors, then all is well, and you can consider the tests as passed. Thanks!
Errors in test__issue_162_part_1 and 2 , test_pilot_errors
Final test rsummary
Ran 31 tests in 1620.103s
OK Error in atexit._run_exitfuncs: Traceback (most recent call last): File "/usr/lib/python2.7/atexit.py", line 24, in _run_exitfuncs func(_targs, _kargs) File "/usr/lib/python2.7/multiprocessing/util.py", line 284, in _exit_function info('process shutting down') TypeError: 'NoneType' object is not callable Error in sys.exitfunc: Traceback (most recent call last): File "/usr/lib/python2.7/atexit.py", line 24, in _run_exitfuncs func(_targs, _kargs) File "/usr/lib/python2.7/multiprocessing/util.py", line 284, in _exit_function info('process shutting down') TypeError: 'NoneType' object is not callable
Individual tests (failed) verbose output:
testissue_169_part_1 (radical.pilot.tests.issues.issue_169.TestIssue169) https://github.com/radical-cybertools/radical.pilot/issues/169 ... 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] using database url mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/ 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] using database name my_private_name 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/ncar.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/das4.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/localhost.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/iu.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/futuregrid.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/epsrc.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/lrz.json 2014:09:04 08:17:04 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/xsede.json 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] New Session created{'database_url': 'mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/', 'database_name': 'my_private_name', 'last_reconnect': None, 'uid': '540858401d41c82f1fa1ee97', 'created': datetime.datetime(2014, 9, 4, 12, 17, 4, 849751)}. 2014:09:04 08:17:05 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-15[-1236272320]) for PilotManager 540858411d41c82f1fa1ee98 started. 2014:09:04 08:17:05 radical.pilot.MainProcess: [DEBUG ] Connected to MongoDB. Serving requests for PilotManager 540858411d41c82f1fa1ee98. 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 5, 381000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858411d41c82f1fa1ee99/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 5, 380000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858411d41c82f1fa1ee99'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:05 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858411d41c82f1fa1ee99/'. 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] ComputePilot '540858411d41c82f1fa1ee99' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:05 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858411d41c82f1fa1ee99': mkdir: cannot create directory `/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858411d41c82f1fa1ee99 (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in init _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in init _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in init url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, _kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, _kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858411d41c82f1fa1ee99': mkdir: cannot create directory `/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858411d41c82f1fa1ee99 (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))
2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] ComputePilot '540858411d41c82f1fa1ee99' state changed from 'Launching' to 'Failed'. 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 5, 805000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858411d41c82f1fa1ee9a/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 5, 805000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858411d41c82f1fa1ee9a'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:05 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:05 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858411d41c82f1fa1ee9a/'. 2014:09:04 08:17:06 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858411d41c82f1fa1ee9a': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858411d41c82f1fa1ee9a (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858411d41c82f1fa1ee9a': mkdir: cannot create directory/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858411d41c82f1fa1ee9a (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] ComputePilot '540858411d41c82f1fa1ee9a' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] ComputePilot '540858411d41c82f1fa1ee9a' state changed from 'Launching' to 'Failed'. 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 6, 366000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9b/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 6, 364000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858421d41c82f1fa1ee9b'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:06 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9b/'. 2014:09:04 08:17:06 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9b': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858421d41c82f1fa1ee9b (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9b': mkdir: cannot create directory/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858421d41c82f1fa1ee9b (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] ComputePilot '540858421d41c82f1fa1ee9b' state changed from 'PendingLaunch' to 'Failed'. 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 6, 826000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9c/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 6, 825000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858421d41c82f1fa1ee9c'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:06 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:06 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9c/'. 2014:09:04 08:17:06 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9c': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858421d41c82f1fa1ee9c (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858421d41c82f1fa1ee9c': mkdir: cannot create directory/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858421d41c82f1fa1ee9c (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:07 radical.pilot.MainProcess: [INFO ] ComputePilot '540858421d41c82f1fa1ee9c' state changed from 'PendingLaunch' to 'Failed'. 2014:09:04 08:17:07 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 7, 188000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858431d41c82f1fa1ee9d/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 7, 186000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858431d41c82f1fa1ee9d'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:07 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:07 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:07 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858431d41c82f1fa1ee9d/'. 2014:09:04 08:17:07 radical.pilot.MainProcess: [INFO ] ComputePilot '540858431d41c82f1fa1ee9d' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:08 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858431d41c82f1fa1ee9d': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 6: cd: can't cd to /non-/existing/directory.../pilot-540858431d41c82f1fa1ee9d (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858431d41c82f1fa1ee9d': mkdir: cannot create directory/non-': Permission denied /bin/sh: 6: cd: can't cd to /non-/existing/directory.../pilot-540858431d41c82f1fa1ee9d (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:08 radical.pilot.MainProcess: [INFO ] ComputePilot '540858431d41c82f1fa1ee9d' state changed from 'Launching' to 'Failed'. 2014:09:04 08:17:08 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 8, 679000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858441d41c82f1fa1ee9e/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 8, 674000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858441d41c82f1fa1ee9e'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:08 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:08 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:08 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858441d41c82f1fa1ee9e/'. 2014:09:04 08:17:09 radical.pilot.MainProcess: [INFO ] ComputePilot '540858441d41c82f1fa1ee9e' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:09 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858441d41c82f1fa1ee9e': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 6: cd: can't cd to /non-/existing/directory.../pilot-540858441d41c82f1fa1ee9e (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858441d41c82f1fa1ee9e': mkdir: cannot create directory/non-': Permission denied /bin/sh: 6: cd: can't cd to /non-/existing/directory.../pilot-540858441d41c82f1fa1ee9e (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:10 radical.pilot.MainProcess: [INFO ] ComputePilot '540858441d41c82f1fa1ee9e' state changed from 'Launching' to 'Failed'. 2014:09:04 08:17:10 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 10, 357000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858461d41c82f1fa1ee9f/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 10, 355000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858461d41c82f1fa1ee9f'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:10 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:10 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:10 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858461d41c82f1fa1ee9f/'. 2014:09:04 08:17:10 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858461d41c82f1fa1ee9f': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858461d41c82f1fa1ee9f (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858461d41c82f1fa1ee9f': mkdir: cannot create directory/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-540858461d41c82f1fa1ee9f (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:10 radical.pilot.MainProcess: [INFO ] ComputePilot '540858461d41c82f1fa1ee9f' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:10 radical.pilot.MainProcess: [INFO ] ComputePilot '540858461d41c82f1fa1ee9f' state changed from 'Launching' to 'Failed'. 2014:09:04 08:17:11 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 11, 35000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-540858471d41c82f1fa1eea0/', u'pilotmanager': u'540858411d41c82f1fa1ee98', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 11, 33000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858471d41c82f1fa1eea0'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:11 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:11 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:11 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-540858471d41c82f1fa1eea0/'. 2014:09:04 08:17:11 radical.pilot.MainProcess: [INFO ] ComputePilot '540858471d41c82f1fa1eea0' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:12 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-540858471d41c82f1fa1eea0': mkdir: cannot create directory
/non-': Permission denied /bin/sh: 6: cd: can't cd to /non-/existing/directory.../pilot-540858471d41c82f1fa1eea0 (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in __init__ _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in __init__ url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in __init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, *_kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-540858471d41c82f1fa1eea0': mkdir: cannot create directory/non-': Permission denied /bin/sh: 6: cd: can't cd to /non-/existing/directory.../pilot-540858471d41c82f1fa1eea0 (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))2014:09:04 08:17:12 radical.pilot.MainProcess: [INFO ] ComputePilot '540858471d41c82f1fa1eea0' state changed from 'Launching' to 'Failed'. 2014:09:04 08:17:12 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:17:12 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:17:12 radical.pilot.MainProcess: [DEBUG ] PilotManager.close(): PilotLauncherWorker-1 terminated. 2014:09:04 08:17:12 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-15[-1236272320]) for PilotManager 540858411d41c82f1fa1ee98 stopped. 2014:09:04 08:17:12 radical.pilot.MainProcess: [INFO ] Closed PilotManager 540858411d41c82f1fa1ee98. 2014:09:04 08:17:12 radical.pilot.MainProcess: [INFO ] Deleted session 540858401d41c82f1fa1ee97 from database. 2014:09:04 08:17:12 radical.pilot.MainProcess: [INFO ] Closed Session 540858401d41c82f1fa1ee97.
test__issue_169_part_2 (radical.pilot.tests.issues.issue_169.TestIssue169) https://github.com/radical-cybertools/radical.pilot/issues/169 ... 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] using database url mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/ 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] using database name my_private_name 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/ncar.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/das4.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/localhost.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/iu.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/futuregrid.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/epsrc.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/lrz.json 2014:09:04 08:17:13 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/xsede.json 2014:09:04 08:17:14 radical.pilot.MainProcess: [INFO ] New Session created{'database_url': 'mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/', 'database_name': 'my_private_name', 'last_reconnect': None, 'uid': '540858491d41c82f1fa1eea1', 'created': datetime.datetime(2014, 9, 4, 12, 17, 14, 89276)}. 2014:09:04 08:17:14 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-17[-1351615680]) for PilotManager 5408584a1d41c82f1fa1eea2 started. 2014:09:04 08:17:14 radical.pilot.MainProcess: [DEBUG ] Connected to MongoDB. Serving requests for PilotManager 5408584a1d41c82f1fa1eea2. 2014:09:04 08:17:14 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/tmp/radical.pilot.sandbox.unittests', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 14, 414000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea3/', u'pilotmanager': u'5408584a1d41c82f1fa1eea2', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 14, 411000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('5408584a1d41c82f1fa1eea3'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:14 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:14 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:14 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea3/'. 2014:09:04 08:17:14 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea3' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:15 radical.pilot.MainProcess: [DEBUG ] Copying bootstrapper 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea3/). 2014:09:04 08:17:15 radical.pilot.MainProcess: [DEBUG ] Copying agent 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea3/). 2014:09:04 08:17:16 radical.pilot.MainProcess: [INFO ] request cleanup for pilot 5408584a1d41c82f1fa1eea3 2014:09:04 08:17:16 radical.pilot.MainProcess: [DEBUG ] Bootstrap command line: /bin/bash ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 540858491d41c82f1fa1eea1 -p 5408584a1d41c82f1fa1eea3 -t 1 -d 10 -c 1 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'] 2014:09:04 08:17:16 radical.pilot.MainProcess: [DEBUG ] Submitting SAGA job with description: {'Executable': '/bin/bash', 'WorkingDirectory': '/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea3', 'WallTimeLimit': 1, 'Arguments': ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 540858491d41c82f1fa1eea1 -p 5408584a1d41c82f1fa1eea3 -t 1 -d 10 -c 1 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'], 'Error': 'AGENT.STDERR', 'Output': 'AGENT.STDOUT', 'TotalCPUCount': 1} 2014:09:04 08:17:16 radical.pilot.MainProcess: [DEBUG ] SAGA job submitted with job id [fork://localhost]-[12359] 2014:09:04 08:17:16 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea3' state changed from 'Launching' to 'PendingActive'. 2014:09:04 08:17:16 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/tmp/radical.pilot.sandbox.unittests', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 17, 14, 470000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea4/', u'pilotmanager': u'5408584a1d41c82f1fa1eea2', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 17, 14, 469000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('5408584a1d41c82f1fa1eea4'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:17:16 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:17:16 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:17:16 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea4/'. 2014:09:04 08:17:16 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea4' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:17:17 radical.pilot.MainProcess: [DEBUG ] Copying bootstrapper 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea4/). 2014:09:04 08:17:17 radical.pilot.MainProcess: [DEBUG ] Copying agent 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea4/). 2014:09:04 08:17:17 radical.pilot.MainProcess: [INFO ] request cleanup for pilot 5408584a1d41c82f1fa1eea4 2014:09:04 08:17:17 radical.pilot.MainProcess: [DEBUG ] Bootstrap command line: /bin/bash ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 540858491d41c82f1fa1eea1 -p 5408584a1d41c82f1fa1eea4 -t 1 -d 10 -c 1 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'] 2014:09:04 08:17:17 radical.pilot.MainProcess: [DEBUG ] Submitting SAGA job with description: {'Executable': '/bin/bash', 'WorkingDirectory': '/tmp/radical.pilot.sandbox.unittests/pilot-5408584a1d41c82f1fa1eea4', 'WallTimeLimit': 1, 'Arguments': ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 540858491d41c82f1fa1eea1 -p 5408584a1d41c82f1fa1eea4 -t 1 -d 10 -c 1 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'], 'Error': 'AGENT.STDERR', 'Output': 'AGENT.STDOUT', 'TotalCPUCount': 1} 2014:09:04 08:17:17 radical.pilot.MainProcess: [DEBUG ] SAGA job submitted with job id [fork://localhost]-[12427] 2014:09:04 08:17:17 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea4' state changed from 'Launching' to 'PendingActive'. 2014:09:04 08:17:43 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea3' state changed from 'PendingActive' to 'Active'. 2014:09:04 08:17:46 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea4' state changed from 'PendingActive' to 'Active'. 2014:09:04 08:18:14 radical.pilot.MainProcess: [INFO ] Performing periodical health check for 5408584a1d41c82f1fa1eea3 (SAGA job id [fork://localhost]-[12359]) 2014:09:04 08:18:15 radical.pilot.MainProcess: [INFO ] pilot 5408584a1d41c82f1fa1eea3 seems alive and well 2014:09:04 08:18:15 radical.pilot.MainProcess: [INFO ] Performing periodical health check for 5408584a1d41c82f1fa1eea4 (SAGA job id [fork://localhost]-[12427]) 2014:09:04 08:18:15 radical.pilot.MainProcess: [INFO ] pilot 5408584a1d41c82f1fa1eea4 seems alive and well 2014:09:04 08:18:45 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea3' state changed from 'Active' to 'Done'. 2014:09:04 08:18:47 radical.pilot.MainProcess: [INFO ] ComputePilot '5408584a1d41c82f1fa1eea4' state changed from 'Active' to 'Done'. 2014:09:04 08:18:47 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:18:47 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:18:47 radical.pilot.MainProcess: [DEBUG ] PilotManager.close(): PilotLauncherWorker-1 terminated. 2014:09:04 08:18:47 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-17[-1351615680]) for PilotManager 5408584a1d41c82f1fa1eea2 stopped. 2014:09:04 08:18:47 radical.pilot.MainProcess: [INFO ] Closed PilotManager 5408584a1d41c82f1fa1eea2. 2014:09:04 08:18:47 radical.pilot.MainProcess: [INFO ] Deleted session 540858491d41c82f1fa1eea1 from database. 2014:09:04 08:18:47 radical.pilot.MainProcess: [INFO ] Closed Session 540858491d41c82f1fa1eea1. ok test__issue_18_part_1 (radical.pilot.tests.issues.issue_18.TestIssue18) https://github.com/radical-cybertools/radical.pilot/issues/18 ... 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] using database url mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/ 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] using database name my_private_name 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/ncar.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/das4.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/localhost.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/iu.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/futuregrid.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/epsrc.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/lrz.json 2014:09:04 08:18:48 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/xsede.json 2014:09:04 08:18:49 radical.pilot.MainProcess: [INFO ] New Session created{'database_url': 'mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/', 'database_name': 'my_private_name', 'last_reconnect': None, 'uid': '540858a81d41c82f1fa1eea5', 'created': datetime.datetime(2014, 9, 4, 12, 18, 48, 853699)}. 2014:09:04 08:18:49 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-19[-1362101440]) for PilotManager 540858a91d41c82f1fa1eea6 started. 2014:09:04 08:18:49 radical.pilot.MainProcess: [DEBUG ] Connected to MongoDB. Serving requests for PilotManager 540858a91d41c82f1fa1eea6. 2014:09:04 08:18:49 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/tmp/radical.pilot.sandbox.unittests', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 5}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 18, 49, 215000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-540858a91d41c82f1fa1eea7/', u'pilotmanager': u'540858a91d41c82f1fa1eea6', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 18, 49, 214000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('540858a91d41c82f1fa1eea7'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:18:49 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:18:49 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:18:49 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-540858a91d41c82f1fa1eea7/'. 2014:09:04 08:18:49 radical.pilot.MainProcess: [DEBUG ] Copying bootstrapper 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-540858a91d41c82f1fa1eea7/). 2014:09:04 08:18:49 radical.pilot.MainProcess: [DEBUG ] Copying agent 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-540858a91d41c82f1fa1eea7/). 2014:09:04 08:18:50 radical.pilot.MainProcess: [INFO ] ComputePilot '540858a91d41c82f1fa1eea7' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:18:50 radical.pilot.MainProcess: [INFO ] request cleanup for pilot 540858a91d41c82f1fa1eea7 2014:09:04 08:18:50 radical.pilot.MainProcess: [DEBUG ] Bootstrap command line: /bin/bash ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 540858a81d41c82f1fa1eea5 -p 540858a91d41c82f1fa1eea7 -t 5 -d 10 -c 1 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'] 2014:09:04 08:18:50 radical.pilot.MainProcess: [DEBUG ] Submitting SAGA job with description: {'Executable': '/bin/bash', 'WorkingDirectory': '/tmp/radical.pilot.sandbox.unittests/pilot-540858a91d41c82f1fa1eea7', 'WallTimeLimit': 5, 'Arguments': ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 540858a81d41c82f1fa1eea5 -p 540858a91d41c82f1fa1eea7 -t 5 -d 10 -c 1 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'], 'Error': 'AGENT.STDERR', 'Output': 'AGENT.STDOUT', 'TotalCPUCount': 1} 2014:09:04 08:18:50 radical.pilot.MainProcess: [DEBUG ] SAGA job submitted with job id [fork://localhost]-[12731] 2014:09:04 08:18:50 radical.pilot.MainProcess: [INFO ] ComputePilot '540858a91d41c82f1fa1eea7' state changed from 'Launching' to 'PendingActive'. 2014:09:04 08:19:15 radical.pilot.MainProcess: [INFO ] ComputePilot '540858a91d41c82f1fa1eea7' state changed from 'PendingActive' to 'Active'. 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] Performing periodical health check for 540858a91d41c82f1fa1eea7 (SAGA job id [fork://localhost]-[12731]) 2014:09:04 08:19:49 radical.pilot.MainProcess: [WARNING ] pilot state check failed: failed to get job stats for '[fork://localhost]-[12731]': (1)( ERROR pid 12731 has no state
) (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_job.py +549 (_job_get_stats) : % (id, ret, out))) 2014:09:04 08:19:49 radical.pilot.MainProcess: [ERROR ] Couldn't determine job state for ComputePilot 540858a91d41c82f1fa1eea7. Assuming it has failed. 2014:09:04 08:19:49 radical.pilot.MainProcess: [ERROR ] pilot 540858a91d41c82f1fa1eea7 declared dead 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] ComputePilot '540858a91d41c82f1fa1eea7' state changed from 'Active' to 'Failed'. 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:19:49 radical.pilot.MainProcess: [DEBUG ] PilotManager.close(): PilotLauncherWorker-1 terminated. 2014:09:04 08:19:49 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-19[-1362101440]) for PilotManager 540858a91d41c82f1fa1eea6 stopped. 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] Closed PilotManager 540858a91d41c82f1fa1eea6. 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] Deleted session 540858a81d41c82f1fa1eea5 from database. 2014:09:04 08:19:49 radical.pilot.MainProcess: [INFO ] Closed Session 540858a81d41c82f1fa1eea5.
testpilot_errors (radical.pilot.tests.api.test_pilot.TestPilot) Test if pilot errors are raised properly. ... 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] using database url mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/ 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] using database name my_private_name 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/ncar.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/das4.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/localhost.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/iu.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/futuregrid.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/epsrc.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/lrz.json 2014:09:04 08:33:03 radical.pilot.MainProcess: [INFO ] Loaded resource configurations from /home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/configs/xsede.json 2014:09:04 08:33:04 radical.pilot.MainProcess: [INFO ] New Session created{'database_url': 'mongodb://ec2-184-72-89-141.compute-1.amazonaws.com:27017/', 'database_name': 'my_private_name', 'last_reconnect': None, 'uid': '54085bff1d41c82f1fa1eeec', 'created': datetime.datetime(2014, 9, 4, 12, 33, 4, 53541)}. 2014:09:04 08:33:04 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-89[-1737491648]) for PilotManager 54085c001d41c82f1fa1eeed started. 2014:09:04 08:33:04 radical.pilot.MainProcess: [DEBUG ] Connected to MongoDB. Serving requests for PilotManager 54085c001d41c82f1fa1eeed. 2014:09:04 08:33:04 radical.pilot.MainProcess: [INFO ] ComputePilot '54085c001d41c82f1fa1eeee' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:33:04 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/non-/existing/directory...', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 1, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 33, 4, 342000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/non-/existing/directory.../pilot-54085c001d41c82f1fa1eeee/', u'pilotmanager': u'54085c001d41c82f1fa1eeed', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 33, 4, 341000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('54085c001d41c82f1fa1eeee'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:33:04 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:33:04 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:33:04 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/non-/existing/directory.../pilot-54085c001d41c82f1fa1eeee/'. 2014:09:04 08:33:04 radical.pilot.MainProcess: [ERROR ] Pilot launching failed: invalid dir '/non-/existing/directory.../pilot-54085c001d41c82f1fa1eeee': mkdir: cannot create directory `/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-54085c001d41c82f1fa1eeee (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out))) Traceback (most recent call last): File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/controller/pilot_launcher_worker.py", line 320, in run saga.filesystem.CREATE_PARENTS, session=self._session) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/filesystem/directory.py", line 95, in init _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/directory.py", line 95, in init _adaptor, _adaptor_state, _ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/namespace/entry.py", line 89, in init url, flags, session, ttype=_ttype) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/base.py", line 99, in init__ self._init_task = self._adaptor.init_instance (adaptor_state, _args, _kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/cpi/decorators.py", line 51, in wrap_function return sync_function (self, _args, _kwargs) File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 285, in init_instance self.initialize () File "/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py", line 319, in initialize raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)) BadParameter: invalid dir '/non-/existing/directory.../pilot-54085c001d41c82f1fa1eeee': mkdir: cannot create directory `/non-': Permission denied /bin/sh: 3: cd: can't cd to /non-/existing/directory.../pilot-54085c001d41c82f1fa1eeee (/home/dinesh/rp_test/local/lib/python2.7/site-packages/saga_python-0.18-py2.7.egg/saga/adaptors/shell/shell_file.py +319 (initialize) : raise saga.BadParameter ("invalid dir '%s': %s" % (self.url.path, out)))
2014:09:04 08:33:04 radical.pilot.MainProcess: [INFO ] ComputePilot '54085c001d41c82f1fa1eeee' state changed from 'Launching' to 'Failed'. 2014:09:04 08:33:05 radical.pilot.MainProcess: [INFO ] Launching ComputePilot {u'state': u'PendingLaunch', u'commands': [], u'description': {u'project': None, u'resource': u'localhost', u'queue': None, u'sandbox': u'/tmp/radical.pilot.sandbox.unittests', u'cleanup': True, u'pilot_agent_priv': None, u'memory': None, u'cores': 100000000000L, u'runtime': 1}, u'sagajobid': None, u'started': None, u'cores_per_node': None, u'output_transfer_started': None, u'finished': None, u'submitted': datetime.datetime(2014, 9, 4, 12, 33, 5, 133000), u'output_transfer_finished': None, u'sandbox': u'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-54085c011d41c82f1fa1eeef/', u'pilotmanager': u'54085c001d41c82f1fa1eeed', u'unitmanager': None, u'heartbeat': None, u'statehistory': [{u'timestamp': datetime.datetime(2014, 9, 4, 12, 33, 5, 132000), u'state': u'PendingLaunch'}], u'input_transfer_started': None, u'_id': ObjectId('54085c011d41c82f1fa1eeef'), u'input_transfer_finished': None, u'nodes': None, u'log': []} 2014:09:04 08:33:05 radical.pilot.MainProcess: [INFO ] Using pilot agent /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py 2014:09:04 08:33:05 radical.pilot.MainProcess: [INFO ] Using bootstrapper /home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh 2014:09:04 08:33:05 radical.pilot.MainProcess: [DEBUG ] Creating agent sandbox 'file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-54085c011d41c82f1fa1eeef/'. 2014:09:04 08:33:05 radical.pilot.MainProcess: [DEBUG ] Copying bootstrapper 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/bootstrapper/default_bootstrapper.sh' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-54085c011d41c82f1fa1eeef/). 2014:09:04 08:33:05 radical.pilot.MainProcess: [DEBUG ] Copying agent 'file://localhost//home/dinesh/rp_test/lib/python2.7/site-packages/radical.pilot-0.19-py2.7.egg/radical/pilot/agent/radical-pilot-agent-multicore.py' to agent sandbox (file://localhost/tmp/radical.pilot.sandbox.unittests/pilot-54085c011d41c82f1fa1eeef/). 2014:09:04 08:33:05 radical.pilot.MainProcess: [INFO ] ComputePilot '54085c011d41c82f1fa1eeef' state changed from 'PendingLaunch' to 'Launching'. 2014:09:04 08:33:06 radical.pilot.MainProcess: [INFO ] request cleanup for pilot 54085c011d41c82f1fa1eeef 2014:09:04 08:33:06 radical.pilot.MainProcess: [DEBUG ] Bootstrap command line: /bin/bash ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 54085bff1d41c82f1fa1eeec -p 54085c011d41c82f1fa1eeef -t 1 -d 10 -c 100000000000 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'] 2014:09:04 08:33:06 radical.pilot.MainProcess: [DEBUG ] Submitting SAGA job with description: {'Executable': '/bin/bash', 'WorkingDirectory': '/tmp/radical.pilot.sandbox.unittests/pilot-54085c011d41c82f1fa1eeef', 'WallTimeLimit': 1, 'Arguments': ['-l', 'default_bootstrapper.sh', '-n my_private_name -s 54085bff1d41c82f1fa1eeec -p 54085c011d41c82f1fa1eeef -t 1 -d 10 -c 100000000000 -v 0.19 -m ec2-184-72-89-141.compute-1.amazonaws.com:27017 -l FORK -j LOCAL -k MPIRUN -x luve'], 'Error': 'AGENT.STDERR', 'Output': 'AGENT.STDOUT', 'TotalCPUCount': 100000000000L} 2014:09:04 08:33:06 radical.pilot.MainProcess: [DEBUG ] SAGA job submitted with job id [fork://localhost]-[16827] 2014:09:04 08:33:06 radical.pilot.MainProcess: [INFO ] ComputePilot '54085c011d41c82f1fa1eeef' state changed from 'Launching' to 'PendingActive'. 2014:09:04 08:33:36 radical.pilot.MainProcess: [INFO ] ComputePilot '54085c011d41c82f1fa1eeef' state changed from 'PendingActive' to 'Failed'. 2014:09:04 08:33:37 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:33:37 radical.pilot.MainProcess: [INFO ] Sent 'COMMAND_CANCEL_PILOT' command to all pilots. 2014:09:04 08:33:37 radical.pilot.MainProcess: [DEBUG ] PilotManager.close(): PilotLauncherWorker-1 terminated. 2014:09:04 08:33:37 radical.pilot.MainProcess: [DEBUG ] Worker thread (ID: Thread-89[-1737491648]) for PilotManager 54085c001d41c82f1fa1eeed stopped. 2014:09:04 08:33:37 radical.pilot.MainProcess: [INFO ] Closed PilotManager 54085c001d41c82f1fa1eeed. 2014:09:04 08:33:37 radical.pilot.MainProcess: [INFO ] Deleted session 54085bff1d41c82f1fa1eeec from database. 2014:09:04 08:33:37 radical.pilot.MainProcess: [INFO ] Closed Session 54085bff1d41c82f1fa1eeec.