Dask Demo Day 2023-05-18

ncclementi commented 1 year ago

When

Thursday, May 18th, at 10am US Central time (meeting invite below and also on the Dask calendar)

Context

W'd like to solicit 5-10 minute demos that show off ongoing or lesser-known work. I hope to have 3-5 of these during the meeting. Meetings will be recorded and advertised on social. Hopefully, this helps to educate folks on some of the great work people are up to.

If you're interested please respond to this issue with a brief (a couple sentences) description. If you have colleagues who you think should be interested please let them know. If you would like to present but not this month, check out the dates and signup for an upcoming one in this issue https://github.com/dask/community/issues/307

Agenda

Dask Expressions - @rjzamora
deltadask - @MrPowers
ydata-profiling - @fabclmnt
Dask-bigquery - @ncclementi /@j-bennet

Meeting Invite

Topic: Dask Demo Day Thursday, May 18th, at 10am US Central

Please download and import the following iCalendar (.ics) files to your calendar system. Monthly: https://us06web.zoom.us/meeting/tZ0uf-qorT4tGtc673iGO0K1lLAN0XrtJ7DV/ics?icsToken=98tyKuGhrTMpGteQtxmERpx5A4qgb_TztiVajbdeyki2Cgd8MiinOs5jHOJHAsz6

Join Zoom Meeting https://us06web.zoom.us/j/89383035703?pwd=WkRJSzNnRTh4T2R1ZjJuVVdJWlMxQT09

ncclementi commented 1 year ago

Apologies for the delay on this issue, Here is the recording for the May session, thank you all for participating, and special thanks to the speakers!!

@rjzamora, @MrPowers, @miriamspsantos if you all can drop the links of notebooks,/demos or relevant information to your demo in a comment in this issue, that would be great.

https://www.youtube.com/watch?v=tyk7rwR8ifE

martindurant commented 1 year ago

@MrPowers , a couple of answers:

daskberg: https://github.com/martindurant/daskberg (accounted for a range of magic)
@Fokko can comment on how complete dask support is now in pyiceberg. I reckon it's pretty usable, but I haven't tried recently. https://github.com/apache/iceberg/milestone/27

martindurant commented 1 year ago

@ncclementi , happy to talk about my experiences with google authentication.

ncclementi commented 1 year ago

Thanks @martindurant ! most of the discussion was happening here https://github.com/coiled/dask-bigquery/pull/66. I think for now we want to put a pause until we get more user feedback, but feel free to chip in.

MrPowers commented 1 year ago

@martindurant - thanks for the links.

@ncclementi - here are the links from my talk:

Slides: https://docs.google.com/presentation/d/154ozFlSphey-gPXzdZuEP_Lz-NKCqtAt6Dd31R0q9Vk/edit#slide=id.p
Notebook: https://github.com/MrPowers/pydata-examples/blob/main/dask/dask_h2o_benchmarks.ipynb
deltadask: https://github.com/MrPowers/deltadask
dask_deltatable: https://github.com/rajagurunath/dask_deltatable

Really excited to collaborate with the community and brainstorm the best Delta Lake connector library to rally around. I am fine with deltadask or dask_deltatable. We just need a coordinated strategy to build out the reader interfaces and a gameplan on how to implement the writer methods.