Team Planning - Wednesday, August 28th

[github-actions[bot]]

This is a LEAP Data and Computation Team weekly standup 🎉🎉🎉! This is a way to share feedback from the past cycle, set goals for the next work cycle and coordinate work with others in the group.

Each member should aim to put down 2-3 goals going into the meeting. We then try to discuss how to best align activities around the group to facilitate collaboration as much as possible.

Expecting responses from all members of @leap-stc/data-and-compute.

Copy and paste the template below, and answer questions as you wish!

Response Template

``` **Thanks I'd like to give 🙌** - So-and-so helped me out a lot with XXX... - Thanks for Jo's work on the XXX... **User Interactions/Concerns** - So and so found a gnarly bug. I have raised an issue here ... - We got some awesome feedback on the new ... feature. **Cycle Review 🔎** - I finished implementing ... - **My goals for the two upcoming weeks 💪** - [ ] A goal/project I need to work on in the next two weeks: - [ ] An issue/project that needs help/coordination from another member **Questions for the group ❓** **My availability for this week 🗓** ```

[norlandrhagen]

User Interactions/Concerns

• Adding eNATL to catalog
• Virtualizarr + PGF
• PGF tests failing

My goals for the two upcoming weeks 💪

• [ ] Merge eNATL
• [ ] Work on Virtualizarr + PGF -> Sammy sees interested
• [ ] s5cmd copy exploration

Questions for the group ❓

• Next feedstocks?

My availability for this week 🗓

• Out Tues, semi-available Weds

[jbusecke]

Thanks I'd like to give 🙌

• @SammyAgrawal for digging into the dataloader issue with Climsim 💪
• @norlandrhagen for digging into PGF+Virtualizarr
• Overall I am super happy with the momentum in this group and very much appreciate everyones initiative and enthusiasm!

Cycle Review 🔎

• The catalog is released!
• Bunch of docs updates:
  • Started a [guide for inheriting from Pangeo Image](Guide for custom image creation) PR. Iterating on this with @dhruvbalwada for SSH access to the hub (e.g. for VS Code).
  • Fleshed out Education Guide

My goals for the two upcoming weeks 💪

- [ ] Outline and focus @SammyAgrawal s plans for the next few months. - [ ] Discuss and outline PGF plans going forward - [ ] Prepping a Seminar for a Clivar Working Group to talk about LEAP as an example for open source communities (with focus on the data). **Questions for the group ❓** - Does somebody have capacity to look into https://github.com/leap-stc/leap-data-management-utils/issues/49? - Please submit suggestions for topics for the LEAP-Pangeo Workshop before the annual meeting (bump from last time). - Trying out reclaim to enable more fine grained control over when people from the team can book time. Please let me know if this works for you. **My availability for this week 🗓** Traveling from Sep 3 - Sep 12 to Germany. Will work remotely, but likely limited availability.

[SammyAgrawal]

Thanks I'd like to give 🙌

• Everyone for always patiently answering my questions! I love how more exposure opens up new unknowns and exciting possibilities. The further I go along, the less I realize I know! And that makes life exciting

User Interactions/Concerns

• Met with Microphysics group. Ideally still want to ponder/ distill feedback but TLDR is:
  • "Open sourcing" your work might be a function of field maturity and timing and microphysics people feel that the motivations to do so are highly unclear. I don't disagree as of yet
  • Orient of "I can work in HPC land or I can work in cloud land. Can someone tell me more about why I should work in cloud land?" when instead my collaborators can just log on to my HPC and we can hash things out together?
  • Infrastructural concerns of "my dataset is my Large eddy simulation, a single run is petabytes. Moving that anywhere seems like a beastly task, and I don't know which stakeholders would benefit from me doing so"

Cycle Review 🔎

• Working on improving CIimsim pipeline. Going to hack away on making a virtual store and comparing
• Learning more about open source software and its history to internally adjust my personal opinion on this stuff. Trying to create an internal "theory of open science" which has kept me away from more day to day stuff.

My goals for the two upcoming weeks 💪

• [ ] I would also love to outline and focus myself for the next few months 😄
• [ ] Continue working on the dask DL stuff (actually using it to train my diffusion model too)
• [ ] coiled + pfg + virtualizarr as discussed

Questions for the group ❓

• Want to meet to gain clarity on some of the async discussion we've been having on the dask stuff My availability for this week 🗓 First week of classes next week, transitioning back down to semester hours? Need to figure that out.

[SammyAgrawal]

Can compile annual meeting suggestions in #19?