Closed mmccarty closed 6 years ago
Looks good to me!
Thanks @jlstevens The required changes to intake-xarray
have be merged. We can merge this one now as well.
@mmccarty I've checked out the branch to take a closer look..
It generally looks good although I would recommend making the following three changes before merging:
The line l5.cache[0].get_metadata(urlpath)
prints out quite a bit of info that I don't think is needed elsewhere in the notebook and doesn't help readability. Is there something in particular you wish to draw the reader's attention to here? If not, I would either comment out this line or remove it entirely.
It would be good to add some instructions on how to install the necessary version of intake (including the rasterio plugin). Right now we are using the standard pyviz environment to specify our dependencies and I suspect we will want to specify intake and useful plugins there. What do you think @jbednar ? Otherwise we can start declaring these dependencies in a way that is specific to this project.
Could you clear the notebook of data and metadata? This helps when viewing notebook diffs on github and helps keep the repo size down.
That's all I can think of for now!
conda install -c pyviz pyviz intake intake-xarray
?).@jlstevens I can remove 1. 2. I believe Jim answered. 3. No problem. @jbednar With the default log level in intake, you won't get any output. To get output, users can change the log level. I'll add that to the notebook.
The instructions to get the notebook dependencies would be
conda install -c intake intake intake-xarray
pip install rasterio
Where should these go?
This project should mirror EarthSim's website, so it would be in a new notebook examples/getting-started/index.ipynb. (EarthSim still has index.rst instead of a notebook, but now that index.ipynb is supported we need to update that as I want all docs to be notebooks so that users can explore them in their local copy (and to avoid us having to context-switch between Markdown and .rst).
@jbednar @jlstevens PR updated.
All looks fine to me.
@jbednar @jlstevens Anything else?
You could also strip the metadata from index.ipynb
:-)
@jlstevens done
Hmmm... just broke away a few minutes to play with the intake version updates and got several warnings along the lines of:
/home/jldavid3/anaconda3_2/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility. Expected 96, got 88 return f(*args, **kwds)
and errors:intekes
TypeError: init() got an unexpected keyword argument 'concat_dim'
One of my packages are likely out of sync with what is expected, but I never would have suspected that numpy.dtype would have changed...
@ebo intake-xarray
needs to be updated. I'm going to tag and build a new version so you don't have to install with dev.
On Aug 20 2018 11:53 AM, Mike McCarty wrote:
@ebo
intake-xarray
needs to be update. I'm going to tag and build a new version so you don't have to install with dev.
Ahhh... that makes sense. Sorry I missed the dev instructions. That
said it was probably a decent reminder that it needed to be updated ;-)
I hope to get caught up enough with the current insanity so I can get
back to this.
@mmccarty Given the slow download (at least the first time you run the notebook), it might be worth enabling logging by default until intake offers a download progress bar.
@jlstevens done.
@ebo you will want an updated conda environment.
conda install -c pyviz pyviz
conda install -c intake intake intake-xarray
conda install -c conda-forge rasterio s3fs zarr
Also, make sure you're on xarray 0.10.8.
What happens if you omit "-c conda-forge"?
On Aug 20 2018 1:36 PM, James A. Bednar wrote:
What happens if you omit "-c conda-forge"?
are you talking to me or Mike?
@jbednar Omitted "-c conda-forge" where I could (only zarr
requires it). I've asked the distribution team to add zarr
to the default channel.
@ebo Jim was talking to me. :-)
Right; that was for Mike. Thanks, Mike!
I've tested this notebook and it works with the current set of instructions. Once zarr
is on defaults, we can update the instructions accordingly.
As everything looks good to me now, I'll go ahead and merge.
On Aug 20 2018 2:17 PM, Mike McCarty wrote:
@jbednar Omitted "-c conda-forge" where I could (only
zarr
requires it). I've asked the distribution team to addzarr
to the default channel.@ebo Jim was talking to me. :-)
ahhh... Just checking.
This PR adds Intake to the Walker Lake example. This should not be merged until the PR to add caching to the intake-xarray plugin is merged.