search

mrocklin / dask-tutorial

BSD 3-Clause "New" or "Revised" License
17 stars 9 forks source link

Move uber/lyft data somewhere users can get to it #10

Open mrocklin opened 1 year ago

mrocklin commented 1 year ago

@dchudz can I leave this with you? Currently this lives at s3://oss-shared-scratch/mrocklin/nyc-taxi-fhv

mrocklin commented 1 year ago

More generally, @dchudz I think I'd like to leave Notebook 3 to you. There isn't any pedagogical content. We just need to make sure that users can play around with data properly.

dchudz commented 1 year ago

I copied that s3://oss-shared-scratch/mrocklin/nyc-taxi-fhv from oss-shared-scratch to s3://coiled-datasets/mrocklin/ yesterday.

@mrocklin Is there anything you'd want me to prep in this notebook besides making sure df = dd.read_parquet(...) will work for the students?

mrocklin commented 1 year ago

That and that the dashboard works in JLab

On Tue, Nov 8, 2022 at 2:44 PM David Chudzicki @.***> wrote:

I copied that s3://oss-shared-scratch/mrocklin/nyc-taxi-fhv from oss-shared-scratch to s3://coiled-datasets/mrocklin/ yesterday.

@mrocklin https://github.com/mrocklin Is there anything you'd want me to prep in this notebook besides making sure df = dd.read_parquet(...) will work for the students?

— Reply to this email directly, view it on GitHub https://github.com/mrocklin/dask-tutorial/issues/10#issuecomment-1307803210, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACKZTCSCMC4IE3BDB3T5BTWHK3SPANCNFSM6AAAAAAR2WRVEE . You are receiving this because you were mentioned.Message ID: @.***>

dchudz commented 1 year ago

All set for the data.

that the dashboard works in JLab

For that part I think I will need to remind myself about how the dashboard JLab extension is supposed to work, tomorrow.

dchudz commented 1 year ago

Ok, ugh, I see how to use the extension, but it's not working. Probably for expected reasons. Sad. I'll need to work on this later.

dchudz commented 1 year ago

Have to go now, but I'll try changing the scheduler dashboard port tomorrow. Hopefully that works.

mrocklin commented 1 year ago

Have fun!

On Tue, Nov 8, 2022 at 4:39 PM David Chudzicki @.***> wrote:

Have to go now, but I'll try changing the scheduler dashboard port tomorrow. Hopefully that works.

— Reply to this email directly, view it on GitHub https://github.com/mrocklin/dask-tutorial/issues/10#issuecomment-1307933963, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACKZTDGVBWVLT3XLTR7S2DWHLJAXANCNFSM6AAAAAAR2WRVEE . You are receiving this because you were mentioned.Message ID: @.***>