search

NSLS-II / Bug-Reports

Unified issue-tracker for bugs in the data acquisition, management, and analysis software at NSLS-II
BSD 3-Clause "New" or "Revised" License
2 stars 5 forks source link

bluesky v1.5.2: A second 'create' message is not allowed until the current event bundle is closed with a 'save' or dropmessage. #200

Closed mrakitin closed 5 years ago

mrakitin commented 5 years ago

Observed at CSX with @wen-hu:

In [17]: RE(count([fccd], num=3))                                                                                                                                                                   
Transient Scan ID: 116779     Time: 2019-04-16 14:50:14
Persistent Unique Scan ID: '06d5d2a5-f1a1-4c04-8baf-200715cbb2d5'
New stream: 'baseline'
[E 14:50:19.645 run_engine:1264] Run aborted                                                                                                                                                        
    Traceback (most recent call last):
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py", line 1153, in _run
        msg = self._plan_stack[-1].send(resp)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 1294, in __call__
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 1149, in baseline_wrapper
        return (yield from plan_mutator(plan, insert_baseline))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 790, in monitor_during_wrapper
        return (yield from plan2)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 848, in fly_during_wrapper
        return (yield from plan2)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plans.py", line 67, in count
        return (yield from inner_count())
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py", line 1011, in dec_inner
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 939, in stage_wrapper
        return (yield from finalize_wrapper(inner(), unstage_devices()))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 500, in finalize_wrapper
        ret = yield from plan
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 937, in inner
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py", line 1011, in dec_inner
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 326, in run_wrapper
        else_plan=close_run)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 572, in contingency_wrapper
        yield from except_plan(e)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 322, in except_plan
        yield from close_run(exit_status='fail', reason=str(e))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 733, in close_run
        return (yield Msg('close_run', exit_status=exit_status, reason=reason))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 77, in plan_mutator
        msg = plan_stack[-1].throw(exception)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 840, in new_gen
        yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 77, in plan_mutator
        msg = plan_stack[-1].throw(exception)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 782, in new_gen
        yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 77, in plan_mutator
        msg = plan_stack[-1].throw(exception)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 1138, in post_baseline
        yield from trigger_and_read(devices, name=name)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 802, in trigger_and_read
        rewindable))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 680, in rewindable_wrapper
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 792, in inner_trigger_and_read
        yield from create(name)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 41, in create
        return (yield Msg('create', name=name))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py", line 1211, in _run
        new_response = yield from coro(msg)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/asyncio/coroutines.py", line 212, in coro
        res = func(*args, **kw)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py", line 1458, in _create
        raise IllegalMessageSequence("A second 'create' message is not "
    bluesky.utils.IllegalMessageSequence: A second 'create' message is not allowed until the current event bundle is closed with a 'save' or dropmessage.
---------------------------------------------------------------------------
IllegalMessageSequence                    Traceback (most recent call last)
~/Beamline/Commissioning/2019_04/startup.py in <module>
----> 1 RE(count([fccd], num=3))

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in __call__(self, *args, **metadata_kw)
    754                     # it (unless it is a canceled error)
    755                     if exc is not None:
--> 756                         raise exc
    757 
    758             if self._interrupted:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _run(self)
   1263             self._reason = str(err)
   1264             self.log.exception("Run aborted")
-> 1265             raise err
   1266         finally:
   1267             # Some done_callbacks may still be alive in other threads.

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _run(self)
   1151                     else:
   1152                         try:
-> 1153                             msg = self._plan_stack[-1].send(resp)
   1154                         # We have exhausted the top generator
   1155                         except StopIteration:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in __call__(self, plan)
   1292         plan = monitor_during_wrapper(plan, self.monitors)
   1293         plan = baseline_wrapper(plan, self.baseline)
-> 1294         return (yield from plan)

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in baseline_wrapper(plan, devices, name)
   1147         return (yield from plan)
   1148     else:
-> 1149         return (yield from plan_mutator(plan, insert_baseline))
   1150 
   1151 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in monitor_during_wrapper(plan, signals)
    788     plan1 = plan_mutator(plan, insert_after_open)
    789     plan2 = plan_mutator(plan1, insert_before_close)
--> 790     return (yield from plan2)
    791 
    792 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in fly_during_wrapper(plan, flyers)
    846     plan1 = plan_mutator(plan, insert_after_open)
    847     plan2 = plan_mutator(plan1, insert_before_close)
--> 848     return (yield from plan2)
    849 
    850 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plans.py in count(detectors, num, delay, md)
     65                                       num=num, delay=delay))
     66 
---> 67     return (yield from inner_count())
     68 
     69 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py in dec_inner(*inner_args, **inner_kwargs)
   1009                 plan = gen_func(*inner_args, **inner_kwargs)
   1010                 plan = wrapper(plan, *args, **kwargs)
-> 1011                 return (yield from plan)
   1012             return dec_inner
   1013         return dec

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in stage_wrapper(plan, devices)
    937         return (yield from plan)
    938 
--> 939     return (yield from finalize_wrapper(inner(), unstage_devices()))
    940 
    941 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in finalize_wrapper(plan, final_plan, pause_for_debug)
    498     cleanup = True
    499     try:
--> 500         ret = yield from plan
    501     except GeneratorExit:
    502         cleanup = False

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in inner()
    935     def inner():
    936         yield from stage_devices()
--> 937         return (yield from plan)
    938 
    939     return (yield from finalize_wrapper(inner(), unstage_devices()))

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py in dec_inner(*inner_args, **inner_kwargs)
   1009                 plan = gen_func(*inner_args, **inner_kwargs)
   1010                 plan = wrapper(plan, *args, **kwargs)
-> 1011                 return (yield from plan)
   1012             return dec_inner
   1013         return dec

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in run_wrapper(plan, md)
    324     yield from contingency_wrapper(plan,
    325                                    except_plan=except_plan,
--> 326                                    else_plan=close_run)
    327     return rs_uid
    328 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in contingency_wrapper(plan, except_plan, else_plan, final_plan, pause_for_debug)
    570             # it might be better to throw this in, but this is simpler
    571             # to implement for now
--> 572             yield from except_plan(e)
    573         raise
    574     else:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in except_plan(e)
    320             yield from close_run()
    321         else:
--> 322             yield from close_run(exit_status='fail', reason=str(e))
    323 
    324     yield from contingency_wrapper(plan,

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in close_run(exit_status, reason)
    731     :func:`bluesky.plans_stubs.open_run`
    732     """
--> 733     return (yield Msg('close_run', exit_status=exit_status, reason=reason))
    734 
    735 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
     75             # if we have a stashed exception, pass it along
     76             try:
---> 77                 msg = plan_stack[-1].throw(exception)
     78             except StopIteration as e:
     79                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in new_gen()
    838                 yield from ensure_generator(complete_msgs)
    839                 yield from ensure_generator(collect_msgs)
--> 840                 yield msg
    841             return new_gen(), None
    842         else:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
     75             # if we have a stashed exception, pass it along
     76             try:
---> 77                 msg = plan_stack[-1].throw(exception)
     78             except StopIteration as e:
     79                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in new_gen()
    780             def new_gen():
    781                 yield from ensure_generator(unmonitor_msgs)
--> 782                 yield msg
    783             return new_gen(), None
    784         else:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
     75             # if we have a stashed exception, pass it along
     76             try:
---> 77                 msg = plan_stack[-1].throw(exception)
     78             except StopIteration as e:
     79                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in post_baseline()
   1136         elif msg.command == 'close_run':
   1137             def post_baseline():
-> 1138                 yield from trigger_and_read(devices, name=name)
   1139                 return (yield msg)
   1140 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in trigger_and_read(devices, name)
    800     from .preprocessors import rewindable_wrapper
    801     return (yield from rewindable_wrapper(inner_trigger_and_read(),
--> 802                                           rewindable))
    803 
    804 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in rewindable_wrapper(plan, rewindable)
    678                                             restore_rewindable()))
    679     else:
--> 680         return (yield from plan)
    681 
    682 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in inner_trigger_and_read()
    790         if not no_wait:
    791             yield from wait(group=grp)
--> 792         yield from create(name)
    793         ret = {}  # collect and return readings to give plan access to them
    794         for obj in devices:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in create(name)
     39     :func:`bluesky.plan_stubs.save`
     40     """
---> 41     return (yield Msg('create', name=name))
     42 
     43 

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _run(self)
   1209                         # exceptions (coming in via throw) can be
   1210                         # raised
-> 1211                         new_response = yield from coro(msg)
   1212 
   1213                     # special case `CancelledError` and let the outer

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/asyncio/coroutines.py in coro(*args, **kw)
    210         @functools.wraps(func)
    211         def coro(*args, **kw):
--> 212             res = func(*args, **kw)
    213             if (base_futures.isfuture(res) or inspect.isgenerator(res) or
    214                 isinstance(res, CoroWrapper)):

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _create(self, msg)
   1456                                          "be preceded by 'open_run'.")
   1457         if self._bundling:
-> 1458             raise IllegalMessageSequence("A second 'create' message is not "
   1459                                          "allowed until the current event "
   1460                                          "bundle is closed with a 'save' or "

IllegalMessageSequence: A second 'create' message is not allowed until the current event bundle is closed with a 'save' or dropmessage.

In [19]: import bluesky                                                                                                                                                                             

In [20]: bluesky.__version__                                                                                                                                                                        
Out[20]: '1.5.2'

In [21]: import ophyd                                                                                                                                                                               

In [22]: ophyd.__version__                                                                                                                                                                          
Out[22]: '1.3.2'

In [23]: import databroker                                                                                                                                                                          

In [24]: databroker.__version__                                                                                                                                                                     
Out[24]: '0.12.2'
mrakitin commented 5 years ago

Here is the output with the msg_hook:

In [1]: RE.clear_suspenders()                                                                                                                                                                       

In [2]: from bluesky.utils import ts_msg_hook                                                                                                                                                       

In [3]: RE.msg_hook = ts_msg_hook                                                                                                                                                                   

In [4]: RE(count([fccd], num=3))                                                                                                                                                                    
15:06:31.760925 stage             -> fccd            args: (), kwargs: {}
15:06:31.761191 open_run          -> None            args: (), kwargs: {'detectors': ['fccd'], 'num_points': 3, 'num_intervals': 2, 'plan_args': {'detectors': ["StageOnFirstTrigger(prefix='XF:23ID1-ES{FCCD}', name='fccd', read_attrs=['stats1', 'stats1.total', 'stats2', 'stats2.total', 'stats3', 'stats3.total', 'stats4', 'stats4.total', 'stats5', 'stats5.total', 'hdf5', 'mcs', 'mcs.wfrm', 'mcs.wfrm.wfrm_1', 'mcs.wfrm.wfrm_2', 'mcs.wfrm.wfrm_3', 'mcs.wfrm.wfrm_4', 'mcs.wfrm.wfrm_5', 'mcs.wfrm.wfrm_6', 'mcs.wfrm.wfrm_7', 'mcs.wfrm.wfrm_8', 'mcs.wfrm.wfrm_9', 'mcs.wfrm.wfrm_10', 'mcs.wfrm.wfrm_11', 'mcs.wfrm.wfrm_12', 'mcs.wfrm.wfrm_13', 'mcs.wfrm.wfrm_14', 'mcs.wfrm.wfrm_15', 'mcs.wfrm.wfrm_16', 'mcs.wfrm.wfrm_17', 'mcs.wfrm.wfrm_18', 'mcs.wfrm.wfrm_19', 'mcs.wfrm.wfrm_20', 'mcs.wfrm.wfrm_21', 'mcs.wfrm.wfrm_22', 'mcs.wfrm.wfrm_23', 'mcs.wfrm.wfrm_24', 'mcs.wfrm.wfrm_25', 'mcs.wfrm.wfrm_26', 'mcs.wfrm.wfrm_27', 'mcs.wfrm.wfrm_28', 'mcs.wfrm.wfrm_29', 'mcs.wfrm.wfrm_30', 'mcs.wfrm.wfrm_31', 'mcs.wfrm.wfrm_32'], configuration_attrs=['cam', 'cam.fcric_clamp', 'stats1', 'stats1.configuration_names', 'stats1.port_name', 'stats1.asyn_pipeline_config', 'stats1.blocking_callbacks', 'stats1.enable', 'stats1.nd_array_port', 'stats1.plugin_type', 'stats1.bgd_width', 'stats1.centroid_threshold', 'stats1.compute_centroid', 'stats1.compute_histogram', 'stats1.compute_profiles', 'stats1.compute_statistics', 'stats1.hist_max', 'stats1.hist_min', 'stats1.hist_size', 'stats1.profile_cursor', 'stats1.profile_size', 'stats2', 'stats2.configuration_names', 'stats2.port_name', 'stats2.asyn_pipeline_config', 'stats2.blocking_callbacks', 'stats2.enable', 'stats2.nd_array_port', 'stats2.plugin_type', 'stats2.bgd_width', 'stats2.centroid_threshold', 'stats2.compute_centroid', 'stats2.compute_histogram', 'stats2.compute_profiles', 'stats2.compute_statistics', 'stats2.hist_max', 'stats2.hist_min', 'stats2.hist_size', 'stats2.profile_cursor', 'stats2.profile_size', 'stats3', 'stats3.configuration_names', 'stats3.port_name', 'stats3.asyn_pipeline_config', 'stats3.blocking_callbacks', 'stats3.enable', 'stats3.nd_array_port', 'stats3.plugin_type', 'stats3.bgd_width', 'stats3.centroid_threshold', 'stats3.compute_centroid', 'stats3.compute_histogram', 'stats3.compute_profiles', 'stats3.compute_statistics', 'stats3.hist_max', 'stats3.hist_min', 'stats3.hist_size', 'stats3.profile_cursor', 'stats3.profile_size', 'stats4', 'stats4.configuration_names', 'stats4.port_name', 'stats4.asyn_pipeline_config', 'stats4.blocking_callbacks', 'stats4.enable', 'stats4.nd_array_port', 'stats4.plugin_type', 'stats4.bgd_width', 'stats4.centroid_threshold', 'stats4.compute_centroid', 'stats4.compute_histogram', 'stats4.compute_profiles', 'stats4.compute_statistics', 'stats4.hist_max', 'stats4.hist_min', 'stats4.hist_size', 'stats4.profile_cursor', 'stats4.profile_size', 'stats5', 'stats5.configuration_names', 'stats5.port_name', 'stats5.asyn_pipeline_config', 'stats5.blocking_callbacks', 'stats5.enable', 'stats5.nd_array_port', 'stats5.plugin_type', 'stats5.bgd_width', 'stats5.centroid_threshold', 'stats5.compute_centroid', 'stats5.compute_histogram', 'stats5.compute_profiles', 'stats5.compute_statistics', 'stats5.hist_max', 'stats5.hist_min', 'stats5.hist_size', 'stats5.profile_cursor', 'stats5.profile_size', 'hdf5', 'hdf5.configuration_names', 'hdf5.port_name', 'hdf5.asyn_pipeline_config', 'hdf5.blocking_callbacks', 'hdf5.enable', 'hdf5.nd_array_port', 'hdf5.plugin_type', 'hdf5.auto_increment', 'hdf5.auto_save', 'hdf5.file_format', 'hdf5.file_name', 'hdf5.file_path', 'hdf5.file_path_exists', 'hdf5.file_template', 'hdf5.file_write_mode', 'hdf5.full_file_name', 'hdf5.num_capture', 'hdf5.boundary_align', 'hdf5.boundary_threshold', 'hdf5.compression', 'hdf5.data_bits_offset', 'hdf5.extra_dim_name', 'hdf5.extra_dim_size', 'hdf5.io_speed', 'hdf5.num_col_chunks', 'hdf5.num_data_bits', 'hdf5.num_extra_dims', 'hdf5.num_frames_chunks', 'hdf5.num_frames_flush', 'hdf5.num_row_chunks', 'hdf5.run_time', 'hdf5.szip_num_pixels', 'hdf5.store_attr', 'hdf5.store_perform', 'hdf5.zlevel', 'hdf5.swmr_active', 'hdf5.swmr_mode', 'hdf5.swmr_supported', 'dg2', 'dg2.C', 'dg1', 'dg1.B', 'dg1.G', 'mcs', 'mcs.input_mode', 'mcs.output_mode', 'mcs.output_polarity', 'mcs.channel_advance', 'mcs.count_on_start', 'mcs.max_channels', 'mcs.wfrm'])"], 'num': 3}, 'plan_name': 'count', 'hints': {'dimensions': [(('time',), 'primary')]}}
Transient Scan ID: 116785     Time: 2019-04-16 15:06:31
Persistent Unique Scan ID: 'cae325e7-b0d4-4da7-8a74-af5f29b21663'
15:06:31.823515 trigger           -> sx              args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.823912 trigger           -> say             args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.824276 trigger           -> saz             args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.824506 trigger           -> cryoangle       args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.824977 trigger           -> sy              args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.825495 trigger           -> sz              args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.825801 trigger           -> epu2            args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.826079 trigger           -> slt1            args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.826282 trigger           -> slt2            args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.826470 trigger           -> slt3            args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.826665 trigger           -> m1a             args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.826860 trigger           -> m3a             args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.827110 trigger           -> tardis          args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.827309 trigger           -> stemp           args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.827504 trigger           -> pgm             args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.827691 trigger           -> nanop           args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.827891 wait              -> None            args: (), kwargs: {'group': 'trigger-2d4fa8'}
15:06:31.828614 create            -> None            args: (), kwargs: {'name': 'baseline'}
15:06:31.828760 read              -> sx              args: (), kwargs: {}
15:06:31.845853 read              -> say             args: (), kwargs: {}
15:06:31.861752 read              -> saz             args: (), kwargs: {}
15:06:31.876792 read              -> cryoangle       args: (), kwargs: {}
15:06:31.881125 read              -> sy              args: (), kwargs: {}
15:06:31.884671 read              -> sz              args: (), kwargs: {}
15:06:31.889396 read              -> epu2            args: (), kwargs: {}
15:06:32.330703 read              -> slt1            args: (), kwargs: {}
15:06:32.400172 read              -> slt2            args: (), kwargs: {}
15:06:32.451218 read              -> slt3            args: (), kwargs: {}
15:06:32.480868 read              -> m1a             args: (), kwargs: {}
15:06:32.522608 read              -> m3a             args: (), kwargs: {}
15:06:32.555186 read              -> tardis          args: (), kwargs: {}
15:06:32.595583 read              -> stemp           args: (), kwargs: {}
15:06:32.626864 read              -> pgm             args: (), kwargs: {}
15:06:32.674823 read              -> nanop           args: (), kwargs: {}
15:06:32.823705 save              -> None            args: (), kwargs: {}
New stream: 'baseline'
15:06:32.953810 checkpoint        -> None            args: (), kwargs: {}
15:06:32.954177 trigger           -> fccd            args: (), kwargs: {'group': 'trigger-c860c2'}
15:06:35.173110 wait              -> None            args: (), kwargs: {'group': 'trigger-c860c2'}
15:06:35.484124 create            -> None            args: (), kwargs: {'name': 'primary'}                                                                                                          
15:06:35.484447 read              -> fccd            args: (), kwargs: {}
15:06:38.680767 trigger           -> sx              args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.681294 trigger           -> say             args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.681583 trigger           -> saz             args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.681828 trigger           -> cryoangle       args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.682099 trigger           -> sy              args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.682348 trigger           -> sz              args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.682582 trigger           -> epu2            args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.682830 trigger           -> slt1            args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.683087 trigger           -> slt2            args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.683311 trigger           -> slt3            args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.683542 trigger           -> m1a             args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.683760 trigger           -> m3a             args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.683996 trigger           -> tardis          args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.684227 trigger           -> stemp           args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.684455 trigger           -> pgm             args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.684677 trigger           -> nanop           args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.684911 wait              -> None            args: (), kwargs: {'group': 'trigger-cbf2ef'}
15:06:38.685684 create            -> None            args: (), kwargs: {'name': 'baseline'}
15:06:38.685873 unstage           -> fccd            args: (), kwargs: {}
[E 15:06:38.791 run_engine:1264] Run aborted
mrakitin commented 5 years ago

After following @tacaswell's suggestion to reset the sd.baseline, here is what we have:

[xf23id1@xf23id-ws3 ~/.ipython/profile_collection/startup]$ BS_ENV=collection-2019-2.0-csx bsui
/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/tifffile/tifffile.py:298: UserWarning: ImportError: No module named '_tifffile'. Loading of some compressed images will be very slow. Tifffile.c can be obtained at http://www.lfd.uci.edu/~gohlke/
  "ImportError: No module named '_tifffile'. "

Versions of DAMA software:

    - Bluesky    : v1.5.2
    - Ophyd      : v1.3.2
    - Databroker : v0.12.2

Links to Bluesky and Databroker tutorials:

    - http://nsls-ii.github.io/bluesky/tutorial.html
    - http://nsls-ii.github.io/databroker/tutorial.html

If you get lost or confused, then we want to know! We have a friendly chat channel:

    https://gitter.im/NSLS-II/DAMA

or you can file a bug to let us know where our documentation could be made more clear:

    https://github.com/NSLS-II/Bug-Reports/issues

bsui is running these commands now to start an interactive computing environment for data acquisition:
    $ conda activate collection-2019-2.0-csx
    $ ipython --profile=collection --IPCompleter.use_jedi=False

Activating auto-logging. Current session state plus future input saved.
Filename       : /epics/xf/23id/ophyd/logs/xf23id1_log.py
Mode           : append
Output logging : False
Raw input log  : False
Timestamping   : False
State          : active
Python 3.6.6 |Anaconda, Inc.| (default, Oct  9 2018, 12:34:16)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.2.0 -- An enhanced Interactive Python. Type '?' for help.

IPython profile: collection
Using matplotlib backend: Qt5Agg
Loading metadata history from /home/xf23id1/.config/bluesky/bluesky_history.db
/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/tifffile/tifffile.py:298: UserWarning: ImportError: No module named '_tifffile'. Loading of some compressed images will be very slow. Tifffile.c can be obtained at http://www.lfd.uci.edu/~gohlke/
  "ImportError: No module named '_tifffile'. "
QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-xf23id1'
/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/magics.py:39: UserWarning: BlueskyMagics.positioners is deprecated. Please use the newer labels feature.
  warnings.warn("BlueskyMagics.positioners is deprecated. "
/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/magics.py:33: UserWarning: BlueskyMagics.positioners is deprecated. Please use the newer labels feature.
  warnings.warn("BlueskyMagics.positioners is deprecated. "

In [1]:

In [1]:

In [1]: RE.clear_suspenders()

In [2]: from bluesky.utils import ts_msg_hook

In [3]: RE.msg_hook = ts_msg_hook

In [4]:

In [4]:

In [4]:

In [4]: sd.baseline
Out[4]:
[EpicsMotor(prefix='XF:23ID1-ES{Dif-Ax:Th}Mtr', name='tardis_theta', parent='tardis', settle_time=0.0, timeout=None, read_attrs=['user_readback', 'user_setpoint'], configuration_attrs=['user_offset', 'user_offset_dir', 'velocity', 'acceleration', 'motor_egu']),
 EpicsMotor(prefix='XF:23ID1-ES{Dif-Ax:Del}Mtr', name='tardis_delta', parent='tardis', settle_time=0.0, timeout=None, read_attrs=['user_readback', 'user_setpoint'], configuration_attrs=['user_offset', 'user_offset_dir', 'velocity', 'acceleration', 'motor_egu']),
 EpicsMotor(prefix='XF:23ID1-ES{Dif-Ax:Gam}Mtr', name='tardis_gamma', parent='tardis', settle_time=0.0, timeout=None, read_attrs=['user_readback', 'user_setpoint'], configuration_attrs=['user_offset', 'user_offset_dir', 'velocity', 'acceleration', 'motor_egu']),
 EpicsMotor(prefix='XF:23ID1-ES{Dif-Ax:X}Mtr', name='sx', settle_time=0.0, timeout=None, read_attrs=['user_readback', 'user_setpoint'], configuration_attrs=['user_offset', 'user_offset_dir', 'velocity', 'acceleration', 'motor_egu']),
 EpicsMotor(prefix='XF:23ID1-ES{Dif-Ax:Y}Mtr', name='say', settle_time=0.0, timeout=None, read_attrs=['user_readback', 'user_setpoint'], configuration_attrs=['user_offset', 'user_offset_dir', 'velocity', 'acceleration', 'motor_egu']),
 EpicsMotor(prefix='XF:23ID1-ES{Dif-Ax:Z}Mtr', name='saz', settle_time=0.0, timeout=None, read_attrs=['user_readback', 'user_setpoint'], configuration_attrs=['user_offset', 'user_offset_dir', 'velocity', 'acceleration', 'motor_egu']),
 Cryoangle(prefix='', name='cryoangle', settle_time=0.0, timeout=None, read_attrs=['readback', 'setpoint'], configuration_attrs=[], limits=None, egu=''),
 SamplePosVirtualMotor(prefix='XF:23ID1-ES{Dif-Ax:SY}', name='sy', settle_time=0.0, timeout=None, read_attrs=['readback', 'setpoint'], configuration_attrs=[], limits=None, egu=''),
 SamplePosVirtualMotor(prefix='XF:23ID1-ES{Dif-Ax:SZ}', name='sz', settle_time=0.0, timeout=None, read_attrs=['readback', 'setpoint'], configuration_attrs=[], limits=None, egu=''),
 EPU(prefix='XF:23ID-ID{EPU:2', name='epu2', read_attrs=['gap', 'gap.readback', 'gap.setpoint', 'gap.stop_signal', 'phase', 'phase.readback', 'phase.setpoint', 'phase.stop_signal', 'x_off', 'x_ang', 'y_off', 'y_ang'], configuration_attrs=['gap', 'phase']),
 SlitsGapCenter(prefix='XF:23ID1-OP{Slt:1', name='slt1', read_attrs=['xg', 'xg.user_readback', 'xg.user_setpoint', 'xc', 'xc.user_readback', 'xc.user_setpoint', 'yg', 'yg.user_readback', 'yg.user_setpoint', 'yc', 'yc.user_readback', 'yc.user_setpoint'], configuration_attrs=['xg', 'xg.user_offset', 'xg.user_offset_dir', 'xg.velocity', 'xg.acceleration', 'xg.motor_egu', 'xc', 'xc.user_offset', 'xc.user_offset_dir', 'xc.velocity', 'xc.acceleration', 'xc.motor_egu', 'yg', 'yg.user_offset', 'yg.user_offset_dir', 'yg.velocity', 'yg.acceleration', 'yg.motor_egu', 'yc', 'yc.user_offset', 'yc.user_offset_dir', 'yc.velocity', 'yc.acceleration', 'yc.motor_egu']),
 SlitsGapCenter(prefix='XF:23ID1-OP{Slt:2', name='slt2', read_attrs=['xg', 'xg.user_readback', 'xg.user_setpoint', 'xc', 'xc.user_readback', 'xc.user_setpoint', 'yg', 'yg.user_readback', 'yg.user_setpoint', 'yc', 'yc.user_readback', 'yc.user_setpoint'], configuration_attrs=['xg', 'xg.user_offset', 'xg.user_offset_dir', 'xg.velocity', 'xg.acceleration', 'xg.motor_egu', 'xc', 'xc.user_offset', 'xc.user_offset_dir', 'xc.velocity', 'xc.acceleration', 'xc.motor_egu', 'yg', 'yg.user_offset', 'yg.user_offset_dir', 'yg.velocity', 'yg.acceleration', 'yg.motor_egu', 'yc', 'yc.user_offset', 'yc.user_offset_dir', 'yc.velocity', 'yc.acceleration', 'yc.motor_egu']),
 SlitsXY(prefix='XF:23ID1-OP{Slt:3', name='slt3', read_attrs=['x', 'x.user_readback', 'x.user_setpoint', 'y', 'y.user_readback', 'y.user_setpoint'], configuration_attrs=['x', 'x.user_offset', 'x.user_offset_dir', 'x.velocity', 'x.acceleration', 'x.motor_egu', 'y', 'y.user_offset', 'y.user_offset_dir', 'y.velocity', 'y.acceleration', 'y.motor_egu']),
 FMBHexapodMirror(prefix='XF:23IDA-OP:1{Mir:1', name='m1a', read_attrs=['z', 'z.readback', 'z.setpoint', 'z.actuate', 'z.stop_signal', 'z.done', 'y', 'y.readback', 'y.setpoint', 'y.actuate', 'y.stop_signal', 'y.done', 'x', 'x.readback', 'x.setpoint', 'x.actuate', 'x.stop_signal', 'x.done', 'pit', 'pit.readback', 'pit.setpoint', 'pit.actuate', 'pit.stop_signal', 'pit.done', 'yaw', 'yaw.readback', 'yaw.setpoint', 'yaw.actuate', 'yaw.stop_signal', 'yaw.done', 'rol', 'rol.readback', 'rol.setpoint', 'rol.actuate', 'rol.stop_signal', 'rol.done'], configuration_attrs=['z', 'y', 'x', 'pit', 'yaw', 'rol']),
 M3AMirror(prefix='XF:23ID1-OP{Mir:3', name='m3a', read_attrs=['x', 'x.user_readback', 'x.user_setpoint', 'pit', 'pit.user_readback', 'pit.user_setpoint', 'bdr', 'bdr.user_readback', 'bdr.user_setpoint'], configuration_attrs=['x', 'x.user_offset', 'x.user_offset_dir', 'x.velocity', 'x.acceleration', 'x.motor_egu', 'pit', 'pit.user_offset', 'pit.user_offset_dir', 'pit.velocity', 'pit.acceleration', 'pit.motor_egu', 'bdr', 'bdr.user_offset', 'bdr.user_offset_dir', 'bdr.velocity', 'bdr.acceleration', 'bdr.motor_egu']),
 Tardis(prefix='', name='tardis', settle_time=0.0, timeout=None, egu='', limits=(0, 0), source='computed', read_attrs=['h', 'h.readback', 'h.setpoint', 'k', 'k.readback', 'k.setpoint', 'l', 'l.readback', 'l.setpoint', 'theta', 'theta.user_readback', 'theta.user_setpoint', 'mu', 'chi', 'phi', 'delta', 'delta.user_readback', 'delta.user_setpoint', 'gamma', 'gamma.user_readback', 'gamma.user_setpoint'], configuration_attrs=['energy', 'UB', 'h', 'k', 'l', 'theta', 'theta.user_offset', 'theta.user_offset_dir', 'theta.velocity', 'theta.acceleration', 'theta.motor_egu', 'delta', 'delta.user_offset', 'delta.user_offset_dir', 'delta.velocity', 'delta.acceleration', 'delta.motor_egu', 'gamma', 'gamma.user_offset', 'gamma.user_offset_dir', 'gamma.velocity', 'gamma.acceleration', 'gamma.motor_egu'], concurrent=True),
 Lakeshore336(prefix='XF:23ID1-ES{TCtrl:1', name='stemp', read_attrs=['temp', 'temp.A', 'temp.A.T', 'temp.A.V', 'temp.A.status', 'temp.B', 'temp.B.T', 'temp.B.V', 'temp.B.status', 'temp.C', 'temp.C.T', 'temp.C.V', 'temp.C.status', 'temp.D', 'temp.D.T', 'temp.D.V', 'temp.D.status', 'ctrl1', 'ctrl1.readback', 'ctrl1.setpoint', 'ctrl1.done', 'ctrl1.ramp_enabled', 'ctrl2', 'ctrl2.readback', 'ctrl2.setpoint', 'ctrl2.done', 'ctrl2.ramp_enabled'], configuration_attrs=['temp', 'temp.A', 'temp.B', 'temp.C', 'temp.D', 'ctrl1', 'ctrl2']),
 PGM(prefix='XF:23ID1-OP{Mon', name='pgm', read_attrs=['energy', 'energy.readback', 'energy.setpoint', 'energy.stop_signal', 'mir_pit', 'mir_pit.user_readback', 'mir_pit.user_setpoint', 'mir_x', 'mir_x.user_readback', 'mir_x.user_setpoint', 'grt_pit', 'grt_pit.user_readback', 'grt_pit.user_setpoint', 'grt_x', 'grt_x.user_readback', 'grt_x.user_setpoint', 'mir_temp_in', 'grt_temp_in', 'mir_temp_out', 'grt_temp_out', 'grt1_temp', 'grt2_temp', 'grt3_temp', 'grt4_temp'], configuration_attrs=['energy', 'mir_pit', 'mir_pit.user_offset', 'mir_pit.user_offset_dir', 'mir_pit.velocity', 'mir_pit.acceleration', 'mir_pit.motor_egu', 'mir_x', 'mir_x.user_offset', 'mir_x.user_offset_dir', 'mir_x.velocity', 'mir_x.acceleration', 'mir_x.motor_egu', 'grt_pit', 'grt_pit.user_offset', 'grt_pit.user_offset_dir', 'grt_pit.velocity', 'grt_pit.acceleration', 'grt_pit.motor_egu', 'grt_x', 'grt_x.user_offset', 'grt_x.user_offset_dir', 'grt_x.velocity', 'grt_x.acceleration', 'grt_x.motor_egu']),
 NanoBundle(prefix='XF:23ID1-ES{Dif:Nano-Ax:', name='nanop', read_attrs=['tx', 'tx.user_readback', 'tx.user_setpoint', 'tx.dly', 'tx.rtry', 'tx.rdbd', 'tx.rmod', 'tx.cnen', 'tx.pcof', 'tx.icof', 'ty', 'ty.user_readback', 'ty.user_setpoint', 'ty.dly', 'ty.rtry', 'ty.rdbd', 'ty.rmod', 'ty.cnen', 'ty.pcof', 'ty.icof', 'tz', 'tz.user_readback', 'tz.user_setpoint', 'tz.dly', 'tz.rtry', 'tz.rdbd', 'tz.rmod', 'tz.cnen', 'tz.pcof', 'tz.icof', 'bx', 'bx.user_readback', 'bx.user_setpoint', 'bx.dly', 'bx.rtry', 'bx.rdbd', 'bx.rmod', 'bx.cnen', 'bx.pcof', 'bx.icof', 'by', 'by.user_readback', 'by.user_setpoint', 'by.dly', 'by.rtry', 'by.rdbd', 'by.rmod', 'by.cnen', 'by.pcof', 'by.icof', 'bz', 'bz.user_readback', 'bz.user_setpoint', 'bz.dly', 'bz.rtry', 'bz.rdbd', 'bz.rmod', 'bz.cnen', 'bz.pcof', 'bz.icof'], configuration_attrs=['tx', 'tx.velocity', 'tx.acceleration', 'tx.dly', 'tx.rtry', 'tx.rdbd', 'tx.rmod', 'tx.cnen', 'tx.pcof', 'tx.icof', 'ty', 'ty.velocity', 'ty.acceleration', 'ty.dly', 'ty.rtry', 'ty.rdbd', 'ty.rmod', 'ty.cnen', 'ty.pcof', 'ty.icof', 'tz', 'tz.velocity', 'tz.acceleration', 'tz.dly', 'tz.rtry', 'tz.rdbd', 'tz.rmod', 'tz.cnen', 'tz.pcof', 'tz.icof', 'bx', 'bx.velocity', 'bx.acceleration', 'bx.dly', 'bx.rtry', 'bx.rdbd', 'bx.rmod', 'bx.cnen', 'bx.pcof', 'bx.icof', 'by', 'by.velocity', 'by.acceleration', 'by.dly', 'by.rtry', 'by.rdbd', 'by.rmod', 'by.cnen', 'by.pcof', 'by.icof', 'bz', 'bz.velocity', 'bz.acceleration', 'bz.dly', 'bz.rtry', 'bz.rdbd', 'bz.rmod', 'bz.cnen', 'bz.pcof', 'bz.icof'])]

In [5]: sd.baseline = []

In [6]: sd.baseline
Out[6]: []

In [7]: sd
Out[7]: SupplementalData(baseline=[], monitors=[], flyers=[])

In [8]: RE(count([fccd], num=3))
17:40:00.279195 stage             -> fccd            args: (), kwargs: {}
17:40:00.279720 open_run          -> None            args: (), kwargs: {'detectors': ['fccd'], 'num_points': 3, 'num_intervals': 2, 'plan_args': {'detectors': ["StageOnFirstTrigger(prefix='XF:23ID1-ES{FCCD}', name='fccd', read_attrs=['stats1', 'stats1.total', 'stats2', 'stats2.total', 'stats3', 'stats3.total', 'stats4', 'stats4.total', 'stats5', 'stats5.total', 'hdf5', 'mcs', 'mcs.wfrm', 'mcs.wfrm.wfrm_1', 'mcs.wfrm.wfrm_2', 'mcs.wfrm.wfrm_3', 'mcs.wfrm.wfrm_4', 'mcs.wfrm.wfrm_5', 'mcs.wfrm.wfrm_6', 'mcs.wfrm.wfrm_7', 'mcs.wfrm.wfrm_8', 'mcs.wfrm.wfrm_9', 'mcs.wfrm.wfrm_10', 'mcs.wfrm.wfrm_11', 'mcs.wfrm.wfrm_12', 'mcs.wfrm.wfrm_13', 'mcs.wfrm.wfrm_14', 'mcs.wfrm.wfrm_15', 'mcs.wfrm.wfrm_16', 'mcs.wfrm.wfrm_17', 'mcs.wfrm.wfrm_18', 'mcs.wfrm.wfrm_19', 'mcs.wfrm.wfrm_20', 'mcs.wfrm.wfrm_21', 'mcs.wfrm.wfrm_22', 'mcs.wfrm.wfrm_23', 'mcs.wfrm.wfrm_24', 'mcs.wfrm.wfrm_25', 'mcs.wfrm.wfrm_26', 'mcs.wfrm.wfrm_27', 'mcs.wfrm.wfrm_28', 'mcs.wfrm.wfrm_29', 'mcs.wfrm.wfrm_30', 'mcs.wfrm.wfrm_31', 'mcs.wfrm.wfrm_32'], configuration_attrs=['cam', 'cam.acquire_period', 'stats1', 'stats1.configuration_names', 'stats1.port_name', 'stats1.asyn_pipeline_config', 'stats1.blocking_callbacks', 'stats1.enable', 'stats1.nd_array_port', 'stats1.plugin_type', 'stats1.bgd_width', 'stats1.centroid_threshold', 'stats1.compute_centroid', 'stats1.compute_histogram', 'stats1.compute_profiles', 'stats1.compute_statistics', 'stats1.hist_max', 'stats1.hist_min', 'stats1.hist_size', 'stats1.profile_cursor', 'stats1.profile_size', 'stats2', 'stats2.configuration_names', 'stats2.port_name', 'stats2.asyn_pipeline_config', 'stats2.blocking_callbacks', 'stats2.enable', 'stats2.nd_array_port', 'stats2.plugin_type', 'stats2.bgd_width', 'stats2.centroid_threshold', 'stats2.compute_centroid', 'stats2.compute_histogram', 'stats2.compute_profiles', 'stats2.compute_statistics', 'stats2.hist_max', 'stats2.hist_min', 'stats2.hist_size', 'stats2.profile_cursor', 'stats2.profile_size', 'stats3', 'stats3.configuration_names', 'stats3.port_name', 'stats3.asyn_pipeline_config', 'stats3.blocking_callbacks', 'stats3.enable', 'stats3.nd_array_port', 'stats3.plugin_type', 'stats3.bgd_width', 'stats3.centroid_threshold', 'stats3.compute_centroid', 'stats3.compute_histogram', 'stats3.compute_profiles', 'stats3.compute_statistics', 'stats3.hist_max', 'stats3.hist_min', 'stats3.hist_size', 'stats3.profile_cursor', 'stats3.profile_size', 'stats4', 'stats4.configuration_names', 'stats4.port_name', 'stats4.asyn_pipeline_config', 'stats4.blocking_callbacks', 'stats4.enable', 'stats4.nd_array_port', 'stats4.plugin_type', 'stats4.bgd_width', 'stats4.centroid_threshold', 'stats4.compute_centroid', 'stats4.compute_histogram', 'stats4.compute_profiles', 'stats4.compute_statistics', 'stats4.hist_max', 'stats4.hist_min', 'stats4.hist_size', 'stats4.profile_cursor', 'stats4.profile_size', 'stats5', 'stats5.configuration_names', 'stats5.port_name', 'stats5.asyn_pipeline_config', 'stats5.blocking_callbacks', 'stats5.enable', 'stats5.nd_array_port', 'stats5.plugin_type', 'stats5.bgd_width', 'stats5.centroid_threshold', 'stats5.compute_centroid', 'stats5.compute_histogram', 'stats5.compute_profiles', 'stats5.compute_statistics', 'stats5.hist_max', 'stats5.hist_min', 'stats5.hist_size', 'stats5.profile_cursor', 'stats5.profile_size', 'hdf5', 'hdf5.configuration_names', 'hdf5.port_name', 'hdf5.asyn_pipeline_config', 'hdf5.blocking_callbacks', 'hdf5.enable', 'hdf5.nd_array_port', 'hdf5.plugin_type', 'hdf5.auto_increment', 'hdf5.auto_save', 'hdf5.file_format', 'hdf5.file_name', 'hdf5.file_path', 'hdf5.file_path_exists', 'hdf5.file_template', 'hdf5.file_write_mode', 'hdf5.full_file_name', 'hdf5.num_capture', 'hdf5.boundary_align', 'hdf5.boundary_threshold', 'hdf5.compression', 'hdf5.data_bits_offset', 'hdf5.extra_dim_name', 'hdf5.extra_dim_size', 'hdf5.io_speed', 'hdf5.num_col_chunks', 'hdf5.num_data_bits', 'hdf5.num_extra_dims', 'hdf5.num_frames_chunks', 'hdf5.num_frames_flush', 'hdf5.num_row_chunks', 'hdf5.run_time', 'hdf5.szip_num_pixels', 'hdf5.store_attr', 'hdf5.store_perform', 'hdf5.zlevel', 'hdf5.swmr_active', 'hdf5.swmr_mode', 'hdf5.swmr_supported', 'dg2', 'dg2.F', 'dg1', 'dg1.C', 'mcs', 'mcs.input_mode', 'mcs.output_mode', 'mcs.output_polarity', 'mcs.channel_advance', 'mcs.count_on_start', 'mcs.max_channels', 'mcs.wfrm'])"], 'num': 3}, 'plan_name': 'count', 'hints': {'dimensions': [(('time',), 'primary')]}}
Transient Scan ID: 116786     Time: 2019-04-16 17:40:00
Persistent Unique Scan ID: '4ce15c42-553d-45f5-b2b4-5803e338099c'
17:40:00.363626 checkpoint        -> None            args: (), kwargs: {}
17:40:00.364000 trigger           -> fccd            args: (), kwargs: {'group': 'trigger-b8a268'}
17:40:02.605213 wait              -> None            args: (), kwargs: {'group': 'trigger-b8a268'}
17:40:02.849720 create            -> None            args: (), kwargs: {'name': 'primary'}
17:40:02.849938 read              -> fccd            args: (), kwargs: {}
17:40:06.288857 close_run         -> None            args: (), kwargs: {'exit_status': 'fail', 'reason': 'Failed to connect to XF:23ID1-ES{Dly:2-Chan:F}DO:Dly-RB'}
17:40:06.346394 unstage           -> fccd            args: (), kwargs: {}
[E 17:40:06.476 run_engine:1264] Run aborted
    Traceback (most recent call last):
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py", line 1153, in _run
        msg = self._plan_stack[-1].send(resp)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 1294, in __call__
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 1147, in baseline_wrapper
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 790, in monitor_during_wrapper
        return (yield from plan2)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 848, in fly_during_wrapper
        return (yield from plan2)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 169, in plan_mutator
        raise ex
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 122, in plan_mutator
        msg = plan_stack[-1].send(ret)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plans.py", line 67, in count
        return (yield from inner_count())
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py", line 1011, in dec_inner
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 939, in stage_wrapper
        return (yield from finalize_wrapper(inner(), unstage_devices()))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 500, in finalize_wrapper
        ret = yield from plan
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 937, in inner
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py", line 1011, in dec_inner
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 326, in run_wrapper
        else_plan=close_run)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 562, in contingency_wrapper
        ret = yield from plan
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plans.py", line 65, in inner_count
        num=num, delay=delay))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 1022, in repeat
        return (yield from repeated_plan())
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 1005, in repeated_plan
        yield from ensure_generator(plan())
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 802, in trigger_and_read
        rewindable))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 680, in rewindable_wrapper
        return (yield from plan)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 795, in inner_trigger_and_read
        reading = (yield from read(obj))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py", line 90, in read
        return (yield Msg('read', obj))
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py", line 194, in plan_mutator
        inner_ret = yield msg
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py", line 1211, in _run
        new_response = yield from coro(msg)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/asyncio/coroutines.py", line 212, in coro
        res = func(*args, **kw)
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py", line 1496, in _read
        self._config_desc_cache[obj] = obj.describe_configuration()
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/device.py", line 1060, in describe_configuration
        res.update(component.describe_configuration())
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/device.py", line 1060, in describe_configuration
        res.update(component.describe_configuration())
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py", line 227, in describe_configuration
        return self.describe()
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py", line 587, in describe
        val = self.value
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py", line 197, in value
        return self.get()
      File "/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py", line 554, in get
        self._read_pv.pvname)
    TimeoutError: Failed to connect to XF:23ID1-ES{Dly:2-Chan:F}DO:Dly-RB
---------------------------------------------------------------------------
TimeoutError                              Traceback (most recent call last)
<ipython-input-8-94c3610b27a9> in <module>
----> 1 RE(count([fccd], num=3))

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in __call__(self, *args, **metadata_kw)
    754                     # it (unless it is a canceled error)
    755                     if exc is not None:
--> 756                         raise exc
    757
    758             if self._interrupted:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _run(self)
   1263             self._reason = str(err)
   1264             self.log.exception("Run aborted")
-> 1265             raise err
   1266         finally:
   1267             # Some done_callbacks may still be alive in other threads.

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _run(self)
   1151                     else:
   1152                         try:
-> 1153                             msg = self._plan_stack[-1].send(resp)
   1154                         # We have exhausted the top generator
   1155                         except StopIteration:

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in __call__(self, plan)
   1292         plan = monitor_during_wrapper(plan, self.monitors)
   1293         plan = baseline_wrapper(plan, self.baseline)
-> 1294         return (yield from plan)

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in baseline_wrapper(plan, devices, name)
   1145     if not devices:
   1146         # no-op
-> 1147         return (yield from plan)
   1148     else:
   1149         return (yield from plan_mutator(plan, insert_baseline))

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in monitor_during_wrapper(plan, signals)
    788     plan1 = plan_mutator(plan, insert_after_open)
    789     plan2 = plan_mutator(plan1, insert_before_close)
--> 790     return (yield from plan2)
    791
    792

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in fly_during_wrapper(plan, flyers)
    846     plan1 = plan_mutator(plan, insert_after_open)
    847     plan2 = plan_mutator(plan1, insert_before_close)
--> 848     return (yield from plan2)
    849
    850

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    167                     continue
    168                 else:
--> 169                     raise ex
    170         # if inserting / mutating, put new generator on the stack
    171         # and replace the current msg with the first element from the

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    120             ret = result_stack.pop()
    121             try:
--> 122                 msg = plan_stack[-1].send(ret)
    123             except StopIteration as e:
    124                 # discard the exhausted generator

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plans.py in count(detectors, num, delay, md)
     65                                       num=num, delay=delay))
     66
---> 67     return (yield from inner_count())
     68
     69

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py in dec_inner(*inner_args, **inner_kwargs)
   1009                 plan = gen_func(*inner_args, **inner_kwargs)
   1010                 plan = wrapper(plan, *args, **kwargs)
-> 1011                 return (yield from plan)
   1012             return dec_inner
   1013         return dec

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in stage_wrapper(plan, devices)
    937         return (yield from plan)
    938
--> 939     return (yield from finalize_wrapper(inner(), unstage_devices()))
    940
    941

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in finalize_wrapper(plan, final_plan, pause_for_debug)
    498     cleanup = True
    499     try:
--> 500         ret = yield from plan
    501     except GeneratorExit:
    502         cleanup = False

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in inner()
    935     def inner():
    936         yield from stage_devices()
--> 937         return (yield from plan)
    938
    939     return (yield from finalize_wrapper(inner(), unstage_devices()))

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/utils.py in dec_inner(*inner_args, **inner_kwargs)
   1009                 plan = gen_func(*inner_args, **inner_kwargs)
   1010                 plan = wrapper(plan, *args, **kwargs)
-> 1011                 return (yield from plan)
   1012             return dec_inner
   1013         return dec

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in run_wrapper(plan, md)
    324     yield from contingency_wrapper(plan,
    325                                    except_plan=except_plan,
--> 326                                    else_plan=close_run)
    327     return rs_uid
    328

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in contingency_wrapper(plan, except_plan, else_plan, final_plan, pause_for_debug)
    560     cleanup = True
    561     try:
--> 562         ret = yield from plan
    563     except GeneratorExit:
    564         cleanup = False

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plans.py in inner_count()
     63     def inner_count():
     64         return (yield from bps.repeat(partial(bps.trigger_and_read, detectors),
---> 65                                       num=num, delay=delay))
     66
     67     return (yield from inner_count())

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in repeat(plan, num, delay)
   1020                     yield Msg('sleep', None, d)
   1021
-> 1022     return (yield from repeated_plan())

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in repeated_plan()
   1003             now = time.time()  # Intercept the flow in its earliest moment.
   1004             yield Msg('checkpoint')
-> 1005             yield from ensure_generator(plan())
   1006             try:
   1007                 d = next(delay)

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in trigger_and_read(devices, name)
    800     from .preprocessors import rewindable_wrapper
    801     return (yield from rewindable_wrapper(inner_trigger_and_read(),
--> 802                                           rewindable))
    803
    804

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in rewindable_wrapper(plan, rewindable)
    678                                             restore_rewindable()))
    679     else:
--> 680         return (yield from plan)
    681
    682

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in inner_trigger_and_read()
    793         ret = {}  # collect and return readings to give plan access to them
    794         for obj in devices:
--> 795             reading = (yield from read(obj))
    796             if reading is not None:
    797                 ret.update(reading)

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/plan_stubs.py in read(obj)
     88         Msg('read', obj)
     89     """
---> 90     return (yield Msg('read', obj))
     91
     92

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/preprocessors.py in plan_mutator(plan, msg_proc)
    192         try:
    193             # yield out the 'current message' and collect the return
--> 194             inner_ret = yield msg
    195         except GeneratorExit:
    196             # special case GeneratorExit.  We must clean up all of our plans

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _run(self)
   1209                         # exceptions (coming in via throw) can be
   1210                         # raised
-> 1211                         new_response = yield from coro(msg)
   1212
   1213                     # special case `CancelledError` and let the outer

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/asyncio/coroutines.py in coro(*args, **kw)
    210         @functools.wraps(func)
    211         def coro(*args, **kw):
--> 212             res = func(*args, **kw)
    213             if (base_futures.isfuture(res) or inspect.isgenerator(res) or
    214                 isinstance(res, CoroWrapper)):

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/bluesky/run_engine.py in _read(self, msg)
   1494                 data_keys = obj.describe()
   1495                 self._describe_cache[obj] = data_keys
-> 1496                 self._config_desc_cache[obj] = obj.describe_configuration()
   1497                 self._cache_config(obj)
   1498

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/device.py in describe_configuration(self)
   1058             if component.kind & Kind.config:
   1059                 component = getattr(self, component_name)
-> 1060                 res.update(component.describe_configuration())
   1061         return res
   1062

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/device.py in describe_configuration(self)
   1058             if component.kind & Kind.config:
   1059                 component = getattr(self, component_name)
-> 1060                 res.update(component.describe_configuration())
   1061         return res
   1062

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py in describe_configuration(self)
    225     def describe_configuration(self):
    226         "Subclasses may customize this."
--> 227         return self.describe()
    228
    229     @property

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py in describe(self)
    585         desc = {'source': 'PV:{}'.format(self._read_pv.pvname), }
    586
--> 587         val = self.value
    588         desc['dtype'] = data_type(val)
    589         desc['shape'] = data_shape(val)

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py in value(self)
    195     def value(self):
    196         '''The signal's value'''
--> 197         return self.get()
    198
    199     @value.setter

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/ophyd/signal.py in get(self, as_string, connection_timeout, **kwargs)
    552                 if not self._read_pv.wait_for_connection(connection_timeout):
    553                     raise TimeoutError('Failed to connect to %s' %
--> 554                                        self._read_pv.pvname)
    555
    556             ret = self._read_pv.get(as_string=as_string, **kwargs)

TimeoutError: Failed to connect to XF:23ID1-ES{Dly:2-Chan:F}DO:Dly-RB

/opt/conda_envs/collection-2019-2.0-csx/lib/python3.6/site-packages/nslsii/__init__.py:264: UserWarning: This olog is giving errors. This will not be logged.Error:HTTPSConnectionPool(host='xf23id1-log.cs.nsls2.local', port=8181): Read timed out. (read timeout=30)
  'Error:' + str(exc))
In [9]:
tacaswell commented 5 years ago

This looks like a local issue, can we close this?

mrakitin commented 5 years ago

Yes.