search

nipype / pydra

Pydra Dataflow Engine
https://nipype.github.io/pydra/
Other
119 stars 57 forks source link

pydraboard #33

Open satra opened 5 years ago

satra commented 5 years ago

realtime monitoring of pydra execution status and messaging receiver.

anibalsolon commented 5 years ago

hey @satra are you thinking something close to tensorboard, or a terminal monitor more like htop?

satra commented 5 years ago

@anibalsolon - to start with it could be a terminal monitor, but yes, the longer term solution for this is something like tensorboard. however, tensorboard currently uses logs in a directory to create its outputs, whereas pydraboard may use sockets to receive realtime messages from different execution processes.

workflow.run(message_listener="http(s)://machine:port"

and then pydraboard will be listening on that port. this could be terminal or eventually a visual interface.

anibalsolon commented 5 years ago

Sounds great, @satra ! Yeah, by tensorboard I actually mean a web interface. Sockets are a good alternative.

I could help on that! Should it be compatible with Windows? To pick a lib to manage the console user interface.

satra commented 5 years ago

@anibalsolon - if you are up for it, we can start planning and creating this with some toy examples.

anibalsolon commented 5 years ago

Yes, definitely!

I guess the simpler ones, with a split and a merge (or whatever the nomenclature is now), might cover a good part of it.

djarecka commented 4 years ago

@anibalsolon - hey, any chances you're joining hackathon?

anibalsolon commented 3 years ago

Hi @djarecka and @satra,

I just saw this lib, and it reminded me of this issue: https://github.com/willmcgugan/rich

Unfortunately, I could not participate actively in the hackathon (and just saw the message here)- would you like to meet at some moment to discuss this feature? I can put some effort into it!

djarecka commented 3 years ago

@anibalsolon - that would be great! Let me know when would you like to chat

anibalsolon commented 3 years ago

@djarecka Surely, would you have some minutes tomorrow? Or would you like to address it next year? Both are fine for me.

djarecka commented 3 years ago

@anibalsolon - yes, we can have a short chat tomorrow, after 2pm ET would work best for me