carpentries-lab / python-aos-lesson

Python for Atmosphere and Ocean Scientists
https://carpentries-lab.github.io/python-aos-lesson/
Other
87 stars 49 forks source link

Create a synthetic large dataset? #42

Open DamienIrving opened 3 years ago

DamienIrving commented 3 years ago

For the large data lesson, the instructor downloads and processes a 45GB dataset. It's impractical to require learners to download that dataset, so they don't get any hands on experience with actually processing large data.

A work around might be to simply run an xarray command to duplicate the monthly dataset used in the earlier lessons (e.g. repeat the time axis 500 times) so it's much larger?