search

LSSTDESC / ComputingInfrastructure

Gathering place for CI - Computing and Infrastructure - issues
3 stars 1 forks source link

Test DMstack on NERSC KNL #43

Closed heather999 closed 3 years ago

heather999 commented 7 years ago

Currently building vanilla DMstack v13_0 on Cori KNL. We'll see what happens.

drphilmarshall commented 7 years ago

Good luck, Heather! We are all rooting for you.

heather999 commented 7 years ago

:) Built vanilla v13_0 successfully for Cori-KNL. Working on testing the typical demo code using interactive mode to submit a job on KNL.

drphilmarshall commented 7 years ago

Great! Well done :-) How'd the demo go?

heather999 commented 7 years ago

It went off perfectly fine. I ran using one of the KNL interactive nodes and it completed without error. Then we compare the output detected-sources.txt to the expected results, and the demo's bin/compare exe reported "Ok". I declare success.

Next up - we should test a more complex run. To do that, I need a recipe or to pass this off to someone who runs Twinkles or DC2 runs.. If given instructions, I can run a series of tests if that's helpful.

heather999 commented 7 years ago

@tony-johnson & @SimonKrughoff would you have any recipes available to run a simple, longer, job using DMstack v13? I can introduce the updated obs_lsstSim easily enough so it's an identical version of the code used for current jobs.

drphilmarshall commented 7 years ago

Maybe the WFD Twinkles 1 runs could be good for this test? The early DRs should be pretty low memory consumption.

On Wed, May 31, 2017 at 9:42 AM, Heather Kelly notifications@github.com wrote:

@tony-johnson https://github.com/tony-johnson & @SimonKrughoff https://github.com/simonkrughoff would you have any recipes available to run a simple, longer, job using DMstack v13? I can introduce the updated obs_lsstSim easily enough so it's an identical version of the code used for current jobs.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/LSSTDESC/ComputingInfrastructure/issues/43#issuecomment-305246158, or mute the thread https://github.com/notifications/unsubscribe-auth/AArY9weBllM0MhpvtoSC6u-A4v2OlOswks5r_ZiMgaJpZM4NmgcY .

heather999 commented 7 years ago

@drphilmarshall Maybe :) I just need a basic recipe for how to set up such a job and I can try it out. I'm happy to do it.. I'm also happy to pass this to someone else.. or perhaps what I've done already is "good enough" and we wait to see what happens when we try to use KNL for real.

tony-johnson commented 7 years ago

Hi heather, it would be easy to run some sample jobs using the pipeline on knl. Do you have the stack setup already?

Tony

On Jun 5, 2017 7:27 AM, Heather Kelly notifications@github.com wrote:

@drphilmarshallhttps://github.com/drphilmarshall Maybe :) I just need a basic recipe for how to set up such a job and I can try it out. I'm happy to do it.. I'm also happy to pass this to someone else.. or perhaps what I've done already is "good enough" and we wait to see what happens when we try to use KNL for real.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://github.com/LSSTDESC/ComputingInfrastructure/issues/43#issuecomment-306201396, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AKsjgyuxMZ4ngYKD5FYMAFMteqcVb2oZks5sBBA2gaJpZM4NmgcY.

heather999 commented 7 years ago

Hi @tony-johnson, yes we have a vanilla DMstack v13_0 here: /global/common/cori/contrib/lsst/lsstDM/knl-test The updated obs_lsstSim used for Twinkles/DC2 is also available. There are two setup scripts where you can either use vanilla DMstack v13_0 or v13_0 along with the modified obs_lsstSim.

heather999 commented 3 years ago

I think we've moved on :)