Monthly check-in with UK Met Office

[rabernat]

We are thrilled that the UK met office wants to collaborate with pangeo on their analytics platform. @alberto-arribas proposed to have a monthly call to help coordinate development efforts. This issue is to help us organize this monthly call.

[mrocklin]

I'm enthused by this. I'm somewhat busy this week but relatively free after this Thursday.

[jhamman]

In the short term, I'd suggest we find a time in the next week to get a quorum together. Thursday or Friday of this week will work for me.

For recurring monthly meetings, it would be best to pick a fixed time / day. Something like the first Thursday of each month at 4PM GMT / 11AM EST / 8AM PST.

[alberto-arribas]

Thanks guys, we are truly excited about this too.

Copying @niallrobinson @jacobtomlinson from Lab. Any preferences on day of the week time for regular catchups on Pangeo? Being a lazy man, I am happy to go with @jhamman proposal, i.e.

First Thursday of each month at 4PM GMT / 11AM EST / 8AM PST

[jacobtomlinson]

First Thursday of each month at 4PM GMT / 11AM EST / 8AM PST.

I am definitely happy with this. However I am on holiday on the 1st of Feb :).

[mrocklin]

So first Thursday of the month at 4pm GMT and this or next Friday at the same time?

[ogrisel]

I am also interested in attending the meetings if dask and kubernetes are on the agenda. I am fine with both Thursdays and Fridays European afternoons.

[rabernat]

So first Thursday of the month at 4pm GMT and this or next Friday at the same time?

We really need @niallrobinson and @jacobtomlinson to weigh in on whether they are available to meet tomorrow (Friday) or next week. I personally think a brief technical discussion sooner than mid February would be valuable for all involved.

[jacobtomlinson]

@rabernat I can do 2pm GMT today or 4pm GMT Tues-Fri next week. I would imagine @niallrobinson is not available today as he is travelling.

[mrocklin]

I suspect that US West Coasters are still asleep. I recommend that we settle on 4pm GMT Tuesday if that's still available.

[jacobtomlinson]

Sounds good! Speak to you all then.

[rabernat]

Let's be clear: this call is open to anyone interested in collaborating on this project (e.g. @ogrisel). We welcome your involvement!

[pwolfram]

@rabernat, if I understand correctly does "this project" means pangeo with an emphasis on analytics? If I understand correctly I would like to call in if possible. Thanks!

[mrocklin]

I suggest that we figure out a proposed agenda and then people decide their involvement based on that. I think that the original intent was to sync up with the UK Met folks, who have particular interest in deploying cloud-based Jupyter+Dask systems. My guess is that this particular meeting is of interest to @ogrisel but is probably of less interest to @pwolfram .

More broadly though, we should figure out how to better organize. People seem to want to engage across a number of different institutions and I suspect it's not clear from their perspective how to do this. Github communication has been decent so far, but it could be that a regular and somewhat frequent video conversation would help.

[rabernat]

Yes, good point Matt. The call on Tuesday is specific in scope to deployment on cloud with Kubernetes.

We are definitely overdue for a more generally scoped virtual meeting. I think a bit about how to organize and publicize that.

[rabernat]

FYI, I'm not sure I'll be able to make the call today...which is ok, since I don't have much to contribute on kubernetes issues.

[pwolfram]

Same here

[mrocklin]

Ah, sorry. I had forgotten about this. I won't be available until 4:30 or 5:00 if we're still meeting today. I had a family issue arise.

On Jan 23, 2018 10:15 AM, "Phillip J. Wolfram" notifications@github.com wrote:

Same here

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-359821788, or mute the thread https://github.com/notifications/unsubscribe-auth/AASszOJy58dFxZ-BH4sYQWZp28ufu3_lks5tNfeegaJpZM4RerXK .

[jacobtomlinson]

No problem. Perhaps in this case it would be best to postpone until the same time tomorrow?

[mrocklin]

That works well for me. Also pinging @yuvipanda given the probable focus on Kubernetes (although this might be early for US Pacific time).

I suggest that we meet in https://appear.in/dask-dev at 4pm UTC, 11am US Eastern, 8am US Pacific Wednesday 2018-01-24

[yuvipanda]

oooh, I think I can make it (8AM Pacific tomorrow)?

[mrocklin]

Yes

On Tue, Jan 23, 2018 at 2:42 PM, Yuvi Panda notifications@github.com wrote:

oooh, I think I can make it (8AM Pacific tomorrow)?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-359906728, or mute the thread https://github.com/notifications/unsubscribe-auth/AASszC8ghtaiJg1jdNyRza3-AQcIJh9gks5tNjYrgaJpZM4RerXK .

[ogrisel]

I am not sure I am going able to make it today. If it's not the case I would be interested in reading some meeting notes.

[mrocklin]

Notes from meeting: https://docs.google.com/document/d/1kQIiowgJZaabqxmU6dYDgEq9RV3Eo5-61eKWdGI60mQ/edit?usp=sharing

[jreadey]

Re: "fix the HDF5 library to be able to talk to an object store like S3 rather than being hardcoded to only use a POSIX FS" - the HDF Group is developing a HDF5Lib VFD that allows read access from S3. It should be ready for beta testing soon. The VFD ("Virtual File Driver") is low-level plugin that basically maps Posix IO requests to S3 Range GETS.

[rabernat]

This Thursday (March 1) is the first Thursday of the month. Are we still on for a monthly check-in with the Met Office folks?

[mrocklin]

I can attend. Are there things to talk about?

On Mon, Feb 26, 2018 at 12:55 PM, Ryan Abernathey notifications@github.com wrote:

This Thursday (March 1) is the first Thursday of the month. Are we still on for a monthly check-in with the Met Office folks?

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-368589777, or mute the thread https://github.com/notifications/unsubscribe-auth/AASszMrCSNa8L_xl4yd1Ya1KnL9zb8Piks5tYvAKgaJpZM4RerXK .

[alberto-arribas]

Hi,

Yes, it would be good to catch up. What time would it be?

Best, Alberto

On 26 February 2018 at 17:55, Ryan Abernathey notifications@github.com wrote:

This Thursday (March 1) is the first Thursday of the month. Are we still on for a monthly check-in with the Met Office folks?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-368589777, or mute the thread https://github.com/notifications/unsubscribe-auth/AKHB0uUIceBqDQ4QfvMe8LvdYTxXilaTks5tYvAMgaJpZM4RerXK .

[rabernat]

Last time, we did 4PM GMT / 11AM EST / 8AM PST. This works for me.

Some thing we can talk about

• building out the ability to customize docker images (#133); would be great to find someone to work on this
• automation of docker build process (#131)
• design of documentation site (#78)
• community outreach (#121)

[jhamman]

I can also join. A short discussion of how the JADE JupyterHub splash page is configured would be something to add to the list.

[jacobtomlinson]

That should be fine for me.

@jhamman do you mean this page?

[jhamman]

Yes, that's the one. I think we want something similar on the Pangeo Jhub. (see also https://github.com/pangeo-data/pangeo/issues/130#issuecomment-368108812)

[jacobtomlinson]

Sure, it was reasonably straight forward. I'll tell you all about it tomorrow.

[rabernat]

Topic: Pangeo / Met Office Check In Time: Mar 1, 2018 11:00 AM Eastern Time (US and Canada)

Join from PC, Mac, Linux, iOS or Android: https://columbiauniversity.zoom.us/j/719276373

Or iPhone one-tap : US: +14086380968,,719276373# or +16468769923,,719276373# Or Telephone: Dial(for higher quality, dial a number based on your current location): US: +1 408 638 0968 or +1 646 876 9923 or +1 669 900 6833 or +1 877 853 5257 (Toll Free) or +1 855 880 1246 (Toll Free) Argentina: +54 341 512 2188 or +54 822 345 9889 (Toll Free) Meeting ID: 719 276 373 International numbers available: https://columbiauniversity.zoom.us/zoomconference?m=VT4ugMACHDPLUBJWbR9BwZJY84d8IBfK

[rabernat]

Of if people prefer https://appear.in/pangeo, we can do that (no install required, but we can only use the free version).

[jacobtomlinson]

I would prefer appear.in

[rabernat]

Ok, we will do appear.in

[jacobtomlinson]

Are we on for today?

[mrocklin]

I had forgotten about this (we should consider a recurring calendar event). I'm in a Dask standup meeting for the next 20m or so but would love to join a conversation afterwards if people are meeting.

On Thu, Apr 5, 2018 at 10:57 AM, Jacob Tomlinson notifications@github.com wrote:

Are we on for today?

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-378965735, or mute the thread https://github.com/notifications/unsubscribe-auth/AASszGIyJoNl1DxQfLympsVAz288Pci7ks5tljDWgaJpZM4RerXK .

[jacobtomlinson]

Aha! We have a recurring calendar event but perhaps we should invite more then just ourselves 😆.

I'll just hang out in the appear.in room for the next hour, people are welcome to drop in!

[rabernat]

I had forgotten too, but I can join in a bit as well. I'll plan to log in around 11:15. Hopefully Matt will free up around then too.

[mrocklin]

@rabernat and I are in https://appear.in/pangeo

On Thu, Apr 5, 2018 at 11:05 AM, Ryan Abernathey notifications@github.com wrote:

I had forgotten too, but I can join in a bit as well. I'll plan to log in around 11:15. Hopefully Matt will free up around then too.

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-378968602, or mute the thread https://github.com/notifications/unsubscribe-auth/AASszHf96_ipUll-UikYV4Bh5RUp-TSSks5tljK5gaJpZM4RerXK .

[jhamman]

Sorry to have missed today. @kmpaul and I were in the middle of our Pangeo tutorial!

MetOffice folks, see you at EGU next week.

[rabernat]

How did it go Joe?

Is this material in final form? https://github.com/pangeo-data/pangeo-tutorial-sea-2018

[kmpaul]

Yes! I think it went really well. Joe did a great job on the xarray section. We had a full house and had to bring chairs in from the outside to accommodate all of the attendees.

Cheyenne, not surprisingly, went down right at the start of our tutorial, but people were able to do everything on their laptops or on GCE.

The repo is in final form (at least for our tutorial), but we are open to suggestions for how to change it for future tutorials.

On Thu, Apr 5, 2018 at 11:37 AM, Ryan Abernathey notifications@github.com wrote:

How did it go Joe?

Is this material in final form? https://github.com/pangeo-data/pangeo-tutorial-sea-2018

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/pangeo-data/pangeo/issues/76#issuecomment-379017199, or mute the thread https://github.com/notifications/unsubscribe-auth/AK4fg-LxuXPpUhWuM6Q36jlj1TaQnMpKks5tllZngaJpZM4RerXK .

-- Kevin Paul, PhD Project Scientist, Head of I/O & Workflow Applications (IOWA)

The National Center for Atmospheric Research Computational and Information Systems Laboratory 1850 Table Mesa Dr Boulder, CO 80305

Phone: (303) 497-2441 Office: ML460B

[ah-]

Thanks for putting the tutorial notebooks up, those are looking great!

[mrocklin]

Cheyenne, not surprisingly, went down right at the start of our tutorial, but people were able to do everything on their laptops or on GCE.

Hooray for redundant systems!

[jgerardsimcock]

Can Rhodium join on the next call. We've been up and running for a few weeks now on a similar deployment and we'd like to learn and contribute to the effort.

[jhamman]

@jgerardsimcock - by all means, please do join.

[rabernat]

This is happening tomorrow, May 3, at 4PM GMT / 11AM EST / 8AM PST.

What items do we want on the agenda?

[jacobtomlinson]

Initial thoughts:

• Recent helm issues
• Running tutorials at conferences
• Discuss high priority feature requests
• Discuss netCDF-S3