search

alces-software / adminware

A sandbox CLI for running commands remotely across nodes
1 stars 0 forks source link

Unidentified intermittent bug with run command #181

Closed DavidMarchant closed 5 years ago

DavidMarchant commented 5 years ago

When running a group of tools over a group of nodes the following stacktrace was output before executing continued. Its cause and its effect are unknown, this issue is being created for later reference.

``` adminware> run nspace1 nspace2 -g control You are about to run: nspace1 nspace2 cmd4 nspace1 nspace2 cmd5 nspace1 nspace2 nspace3 cmd6 nspace1 nspace2 nspace4 cmd7 nspace1 nspace2 cmd12 Over nodes: [2,4,6,8,10,84] Please enter [y/n] to confirm: y Executing: nspace1 nspace2 cmd4 Starting Job: 2 Exception in callback Job.JobTask.report_results( result=None>) at /tmp/adminware/src/models/job.py:91 handle: result=None>) at /tmp/adminware/src/models/job.py:91> Traceback (most recent call last): File "/usr/lib64/python3.5/asyncio/events.py", line 127, in _run self._callback(*self._args) File "/tmp/adminware/src/models/job.py", line 93, in report_results if self.batch.is_interactive(): return File "/tmp/adminware/src/models/job.py", line 79, in __getattr__ return getattr(self.job, attr) File "/tmp/adminware/venv/lib/python3.5/site-packages/sqlalchemy/orm/attributes.py", line 242, in __get__ return self.impl.get(instance_state(instance), dict_) File "/tmp/adminware/venv/lib/python3.5/site-packages/sqlalchemy/orm/attributes.py", line 599, in get value = self.callable_(state, passive) File "/tmp/adminware/venv/lib/python3.5/site-packages/sqlalchemy/orm/strategies.py", line 596, in _load_for_state (orm_util.state_str(state), self.key) sqlalchemy.orm.exc.DetachedInstanceError: Parent instance is not bound to a Session; lazy load operation of attribute 'batch' cannot proceed (Background on this error at: http://sqlalche.me/e/bhk3) Exception in callback Job.JobTask.report_results( result=None>) at /tmp/adminware/src/models/job.py:91 handle: result=None>) at /tmp/adminware/src/models/job.py:91> Traceback (most recent call last): File "/usr/lib64/python3.5/asyncio/events.py", line 127, in _run self._callback(*self._args) File "/tmp/adminware/src/models/job.py", line 93, in report_results if self.batch.is_interactive(): return File "/tmp/adminware/src/models/job.py", line 79, in __getattr__ return getattr(self.job, attr) File "/tmp/adminware/venv/lib/python3.5/site-packages/sqlalchemy/orm/attributes.py", line 242, in __get__ return self.impl.get(instance_state(instance), dict_) File "/tmp/adminware/venv/lib/python3.5/site-packages/sqlalchemy/orm/attributes.py", line 599, in get value = self.callable_(state, passive) File "/tmp/adminware/venv/lib/python3.5/site-packages/sqlalchemy/orm/strategies.py", line 596, in _load_for_state (orm_util.state_str(state), self.key) sqlalchemy.orm.exc.DetachedInstanceError: Parent instance is not bound to a Session; lazy load operation of attribute 'batch' cannot proceed (Background on this error at: http://sqlalche.me/e/bhk3) ID: 3913, Node: 2, Failed: -1 Starting Job: 4 ID: 3914, Node: 4, Failed: -1 Starting Job: 6 ID: 3915, Node: 6, Failed: -1 Starting Job: 8 ID: 3916, Node: 8, Failed: -1 Starting Job: 10 ID: 3917, Node: 10, Failed: -1 Starting Job: 84 ID: 3918, Node: 84, Failed: -1 Waiting for jobs to finish... Executing: nspace1 nspace2 cmd5 ```
WilliamMcCumstie commented 5 years ago

We don't have a version of the traceback with line breaks?

I think this might be my current viewer playing up