HERA-Team / hera-validation

Archive of formal software pipeline validation tests
http://hera.pbworks.com/w/page/130621356/Validation
0 stars 3 forks source link

Step 4.1.0: End-to-end for H1C IDR3.2 #76

Open r-pascua opened 2 years ago

r-pascua commented 2 years ago

Not even close to ready; just getting it started

r-pascua commented 2 years ago

Happy to change to markdown or reST, but I wonder about making the 4.1.0 directory. As of now, none of the other test directories have sub-directories, so doing this would kind of break that symmetry. Additionally, would we have all of the relevant data for step-4.1.0 live in that directory, or would it only be the readme in there? One alternative I can think of is just updating the existing readme in the step 4 directory so that it has sections for different tests. I imagine it would get quite long after a few iterations of end-to-ends, but we're inevitably going to get bloat somewhere at some point down the line...

steven-murray commented 2 years ago

Hmmm, I'm with you on the symmetry thing. OK, maybe a good readme in 4/ with a ToC would be better.

r-pascua commented 2 years ago

OK, I'll make the changes and a new PR to just merge that, then. I figure the easiest way to get a functional ToC is to use reST—what do you think?

steven-murray commented 2 years ago

Probably -- not sure if its as easy in markdown?

On Tue, Jan 11, 2022 at 5:06 PM r-pascua @.***> wrote:

OK, I'll make the changes and a new PR to just merge that, then. I figure the easiest way to get a functional ToC is to use reST—what do you think?

— Reply to this email directly, view it on GitHub https://urldefense.com/v3/__https://github.com/HERA-Team/hera-validation/pull/76*issuecomment-1010489052__;Iw!!IKRxdwAv5BmarQ!IMQ7eXqqSTYV3gcmAQrVBlNTbsCDOQ4cBYQDmxJZuKzUgrxlmPbTCp_iz21quRX4ovip$, or unsubscribe https://urldefense.com/v3/__https://github.com/notifications/unsubscribe-auth/AAJWRXVNCHQ3AHK6HXN2RH3UVTAXRANCNFSM5LK35J4Q__;!!IKRxdwAv5BmarQ!IMQ7eXqqSTYV3gcmAQrVBlNTbsCDOQ4cBYQDmxJZuKzUgrxlmPbTCp_iz21qucavgmZy$ . You are receiving this because your review was requested.Message ID: @.***>

steven-murray commented 2 years ago

Hey @r-pascua where are we on this? Just want to close it out if possible.

r-pascua commented 2 years ago

Ah, I had totally forgotten about this. Are we just updating the README to tell people which files live where? I'm not even sure on the status of the files that were used in the validation (did they get moved to cold storage or do we still have them sitting around on lustre?). There's also the question of getting a notebook out for 4.1.0 that covers things that were relevant for validation.

steven-murray commented 2 years ago

@r-pascua yeah I agree, we should get a notebook out that compiles all the stuff we did for IDR3 (without re-running of course). We should bring this up next telecon.

steven-murray commented 2 years ago

@r-pascua looks like we let this slip again...