search

LSSTDESC / SprintWeek2020

Meeting repository for the LSST DESC 2020 Sprint Week
Apache License 2.0
2 stars 0 forks source link

[SPRINT] DESC pipeline software unified flow chart #34

Open empEvil opened 3 years ago

empEvil commented 3 years ago

DESC pipeline software unified flow chart

Let's make a flow chart of all DESC codes!

Contacts: @aimalz @empEvil @EiffL Day/Time: Wednesday 7h-11h ET Main communication channel: TBD GitHub repo: https://github.com/LSSTDESC/Pipelines

Goals and deliverable

Resources and skills needed

Detailed description

We have a lot of different codes, that all need to eventually interface, so lets actually try and make a flow chart of how they all fit together. Let's also come up with a more unified schema of flowcharts!

Might be interesting to: @joezuntz

aimalz commented 3 years ago

We're hacking now in DESC #15 @heather999 @m-aguena @mishakb @empEvil @EiffL

m-aguena commented 3 years ago

On today's sprint:

High level flowchart here

Issues created:

PR created:

aimalz commented 3 years ago

I want to follow up about maybe requesting a XWG session for the February collaboration meeting. We made a few far-reaching conclusions (mostly encapsulated by LSSTDESC/Pipelines#25) whose solutions XWG members, conveners, and pipeline scientists need to discuss together:

  1. The pipeline diagrams do not use a common language for inputs/outputs, making it hard for CWGs to identify stakeholders for pipeline and data product decisions.
  2. Many of the pipeline diagrams in the SRM are incomplete or do not correspond to current WG plans, and some WGs have no diagram despite active software development.
  3. The diagrams do not indicate the correspondence between DESC codes and the pipelines enabled by them, which would help with identifying dependencies and highlighting opportunities for WG members to contribute.

Do you think this merits a XWG session, and, if so, would anyone else like to volunteer to help out with organization/preparation @empEvil @heather999 @m-aguena @mishakb @vivianmiranda?

mishakb commented 3 years ago

Hi @aimalz, I think this is a good idea to propose and I am supportive.