cct-datascience / organization

Initial repository for organizing group activities
1 stars 0 forks source link

Summarize what is needed for PEcAn VICE #123

Closed dlebauer closed 4 years ago

dlebauer commented 5 years ago

Gather requirements: what new features might be required in CyVerse?

PEcAn has a framework for remote execution:

KristinaRiemer commented 5 years ago

See additional HackMD notes

julianpistorius commented 5 years ago

@dlebauer can you please review this when you have some time?

dlebauer commented 4 years ago

Definitely ready to get started. A few thoughts:

  1. It isn't clear what problem using pglite solves relative to our current dockerized setup (allowing each user to have their own database? I am not sure what is involved in using pglite, but it isn't clear what the advantage is. I think better to have options to use either a sandbox or a production instance (like welsch) would be sufficient.
  2. CA should be a separate epic, and we should engage the rest of the team in this (e.g. first step is to get into VICE, and then present what we have and the CA proposal to the PEcAn call).
julianpistorius commented 4 years ago

Hi @dlebauer

  1. Yup. You're right about pglite. It would give every user their own database. The idea being that they can start from a clean slate. Especially useful when somebody like Tonantzin wants to reproduce Kristina's work. A dirty database state could cause problems otherwise. Using pglite is relatively straightforward. Another alternative is using the Nomad jobs I made so each person can easily create their own persistent PostgreSQL & Bety setup (the sandbox you mentioned) to which they can then connect from VICE.
  2. Yes, CA should be a separate epic. The reason we bundled them together in the HackMD was to identify how much overlap there is - which is a lot! But getting VICE done first is the right thing to do, and now we know it will also get us most of the way to getting CA done once we start that. It will also help to keep the CA use case in mind when building the VICE app so when we are faced with making implementation choices we can think about which otherwise equivalent choices would make the CA use case easier or harder.

Hope that makes sense. Thanks for the feedback! That was useful.

julianpistorius commented 4 years ago

Moving this to done unless you have anything else to add @dlebauer

dlebauer commented 4 years ago

David will follow up with Tyson about support for integrating the PEcAn application https://hackmd.io/ms-iQBtnQD-MfbMdO6TbjA?view#Steps-required-for-making-a-PEcAn-VICE-app