search

radical-collaboration / hpc-workflows

NSF16514 EarthCube Project - Award Number:1639694
5 stars 0 forks source link

Is it possible to run EnTK locally on summit? In an interactive allocation? #154

Open lsawade opened 2 years ago

lsawade commented 2 years ago

nnodes supports by design another incredible feature for debugging. Since nnodes is run as part of the batch submission, we can run nnodes on Summit with an interactive allocation in the debug queue.

We've found that "the hurdle" of having to run the workflow manager then communicating with mongoDB, then submitting has its advantages, but carries a big drawback when debugging the workflow.

So, what I'm wondering is, is there a way to circumvent the queue? I remember vaguely that we had a discussion about something like this, but I don't remember how the discussion ended.

lsawade commented 2 years ago

I changed the title, because mongodb is not the prohibitor in this case it's just queue time to fix small problems.

andre-merzky commented 2 years ago

I'm afraid we are not able to realistically support this in the very near future. I opened an issue for this.

And, you are right, MongoDB is not the main issue in this context.