search

xpdAcq / mission-control

Releases, Installers, Specs, and more!
0 stars 4 forks source link

option to bypass visualization pipe #165

Closed adelezh closed 5 years ago

adelezh commented 5 years ago

at xpdAn, we would like to have an option to choose only integrate and save data, without visualization. This will be very useful when the visualization pipeline fails or when it is too slow.

start_analysis() start_analysis_noshow()

CJ-Wright commented 5 years ago

Thank you for reporting!

The plan is to separate the data processing from the data visualization via ZMQ, that way each can run at whatever rate they can achieve.

sbillinge commented 5 years ago

to be clear, we will be rolling this out in the 2019 cycle-1 release shortly. It will need to be tested.

The way it will work is that visualization and saving will be in different processes, each subscribed to the stream through ZMQ, so regardless of whether you have viz turned on or off, it will not affect saves. We will also have analysis pipelines running in the same way, so it will be possible to have multiple pipelines running if you want, all in separate processes, all subscribing to the raw stream, and they shouldn't interfere with each other.

S

On Fri, Jan 11, 2019 at 3:45 PM Christopher J. Wright < notifications@github.com> wrote:

Thank you for reporting!

The plan is to separate the data processing from the data visualization via ZMQ, that way each can run at whatever rate they can achieve.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/xpdAcq/mission-control/issues/165#issuecomment-453651156, or mute the thread https://github.com/notifications/unsubscribe-auth/AEDrUSlfOxl7g_HiZy9ffIc_vwmYxoiVks5vCPfMgaJpZM4Z8IxV .

CJ-Wright commented 5 years ago

I think this is taken care of now, since one can decide not to run the viz_server. I'd advise running the viz server on a viz specialized workstation, since if the viz gets slow then the computer can be rebooted without fear.