weekly checkin meeting 2019-02-06 15:00 EST

pangeo-data / pangeo

Pangeo website + discussion of general issues related to the project.

http://pangeo.io

704 stars 189 forks source link

weekly checkin meeting 2019-02-06 15:00 EST #545

Closed rabernat closed 5 years ago

rabernat commented 5 years ago

We are due for a late weekly checkin meeting tomorrow. Some possible topics

Update on joint call with STAC community (https://github.com/pangeo-data/pangeo-datastore/issues/5)
Progress refactoring cloud-based deployments
Pangeo-related paper writing

What else?

guillaumeeb commented 5 years ago

I won't be available at this time (OK, I'm kind of never available earlier neither), but now that Jupyterhub is on Cheyenne, what about reviving some old proposal by @mrocklin: https://github.com/jupyterhub/batchspawner/issues/101, trying to propose a z2jh guide or alike for HPC? Or zero to Pangeo?

alando46 commented 5 years ago

I'll be joining on the developer call as well. @rabernat what's the method of connection?

Also, Hamed for sure and possibly myself, if I can get time, will be on the earlier STAC call.

Edit:

Is there an issue tracking discussion around refactoring cloud-based deployments?

I'm digging through the weeds of how the pangeo/jupyterhub deployment works and, specifically after reading about how hub: extraConfig: works, am wondering if some of the custom configurations in jupyter_config.py will/should eventually make their way into explicit service/deployment configuration files. I'm certain I'm late to the party on this one, so would be keen to learn from any existing discussions.

kmpaul commented 5 years ago

@alando46 Our weekly meetings take place on https://appear.in/pangeo

And, incidentally, I'm keeping my eye on the roads and the upcoming snowstorm that is supposed to roll through the Boulder area. I'll try to make it if I can.

rsignell-usgs commented 5 years ago

Maybe @rabernat could give an update of zarr progress: for example, where we stand with datasets that update (like forecast model aggregations)

rabernat commented 5 years ago

I'm happy to talk about zarr, although I'm not personally working on that right now. Regarding updating / appending, this is mostly an xarray problem. (Zarr itself supports appending with no problem.) @davidbrochart has been trying some stuff out, and I'd love to hear from him. There is also this xarray PR - https://github.com/pydata/xarray/pull/2706 - which aims to provide the much-requested append feature. I highly encourage anyone interested in that topic to provide feedback on the PR.

davidbrochart commented 5 years ago

I think the PR looks promising, my solution was really a hack. I'm following the PR, I'll give feedback and test it.