m2lines / data-gallery

https://m2lines.github.io/data-gallery/
Apache License 2.0
0 stars 2 forks source link

Setup repository #2

Closed IamShubhamGupto closed 10 months ago

IamShubhamGupto commented 10 months ago
review-notebook-app[bot] commented 10 months ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

IamShubhamGupto commented 10 months ago

Creating the condo-lock file for linux using an M1 Mac Pro seems to be taking too long. Its been running overnight and still not finished

IamShubhamGupto commented 10 months ago

The fix is to not use the default conda environment export, rather manually list the top level dependencies like pandas / xarray. The remaining is automatically figured out by condo-lock

IamShubhamGupto commented 10 months ago

Hey @jbusecke in this PR, ive setup basic tools for the repository. I still need to add some GitHub actions I think but I'll reuse the setup from L96.

Coming to the initial notebooks where we introduce the tools like Xarray and Xgcm, is there a preferred dataset we want to demo this? Currently I can also reuse most of the code from the Pangeo xarray tutorial but that's a bit of duplication. Let me know what you think.

cc @LaureZanna @suryadheeshjith

LaureZanna commented 10 months ago

Thanks @IamShubhamGupto and @suryadheeshjith ! I will let @jbusecke check the PR.

For the dataset: maybe using CM2.6 or some of the OM4 data, might be a good start. @jbusecke @adcroft ?

IamShubhamGupto commented 10 months ago

@LaureZanna @jbusecke The current PR is ready to go in. The notebook is very minimal right now and probably needs a few more iterations. We basically setup all the tools so from the future we only worry about the content displayed in the Jupyter book.

As for working on CM2.6, is there documentation / paper available online as to what each column contains?

I found this for OM4 and I think its a good summary and link to the published paper https://www.gfdl.noaa.gov/om4-0/

LaureZanna commented 10 months ago

@Groundpepper : do you have any recommendation for @suryadheeshjith @IamShubhamGupto re. CM2.6 documentation ?

Groundpepper commented 10 months ago

This pr identifies all cm2.6 variant datasets on leap. There's no documentation for a deeper level of analysis but you may simply use xr.open_dataset(store, engine='zarr') to check variable details for 16 datasets