Team Planning - Wednesday, August 7th

github-actions[bot] commented 1 month ago

This is a LEAP Data and Computation Team weekly standup 🎉🎉🎉! This is a way to share feedback from the past cycle, set goals for the next work cycle and coordinate work with others in the group.

Each member should aim to put down 2-3 goals going into the meeting. We then try to discuss how to best align activities around the group to facilitate collaboration as much as possible.

Expecting responses from all members of @leap-stc/data-and-compute.

Copy and paste the template below, and answer questions as you wish!

Response Template

``` **Thanks I'd like to give 🙌** - So-and-so helped me out a lot with XXX... - Thanks for Jo's work on the XXX... **User Interactions/Concerns** - So and so found a gnarly bug. I have raised an issue here ... - We got some awesome feedback on the new ... feature. **Cycle Review 🔎** - I finished implementing ... - **My goals for the two upcoming weeks 💪** - [ ] A goal/project I need to work on in the next two weeks: - [ ] An issue/project that needs help/coordination from another member **Questions for the group ❓** **My availability for this week 🗓** ```

jbusecke commented 1 month ago

Thanks I'd like to give 🙌

Thanks to @norlandrhagen @andersy005 for a productive discussion about the Carbonplan/LEAP collaboration
Thanks to @SammyAgrawal for a fun session exploring kbatch yesterday. This seems very promising!

User Interactions/Concerns

Nothing specific from the last few days.

Cycle Review 🔎

Still blocked on getting globus transfers to OSN bucket (Pangeo-Forge for testing) to work. Collaborating with CUIT to unblock
Working on

My goals for the two upcoming weeks 💪

- [ ] Refactor the Docs data guide (this includes better integration of the new data ingestion/catalog [PR](https://github.com/leap-stc/leap-stc.github.io/pull/162) - [ ] Officially release the catalog! **Questions for the group ❓**

My availability for this week 🗓

Fri I have a doctors appointment, limited availability
Mon/Tue WFH
Wed/Thu LEAP

norlandrhagen commented 1 month ago

Thanks I'd like to give 🙌

Chatting with Sammy and Julius in the first DCT meeting.

My goals for the two upcoming weeks 💪

I would like to finish up the eNATL recipe + pyramids.
Figure out how we can write directly to an OSN bucket (staged-recipes did this)

jbusecke commented 1 month ago

Figure out how we can write directly to an OSN bucket (staged-recipes did this)

Something I got from charles a while back.

import s3fs
fs = s3fs.S3FileSystem(
    client_kwargs={'endpoint_url':'https://ncsa.osn.xsede.org'},
    default_cache_type='none',
    default_fill_cache=False,
    use_listings_cache=False,
    key=${{KEY}},
    secret=${{SECRET}},
    )

leap-stc / data-and-compute-team

Team Planning - Wednesday, August 7th #8