ProjectPythia / kerchunk-cookbook

Project Pythia cookbook for Kerchunk
https://projectpythia.org/kerchunk-cookbook/
Apache License 2.0
9 stars 10 forks source link

Demonstrate utility of kerchunked data #16

Open maxrjones opened 1 year ago

maxrjones commented 1 year ago

As suggested by @martindurant in https://github.com/ProjectPythia/kerchunk-cookbook/pull/15#issue-1578630547, the visualizations at the end of the could be expanded to better demonstrate the utility of kerchunked data relative to using the original archival file format.

@jbednar also mentioned improved visualizations for Pangeo-ML notebooks. A great way to improve the visualizations and demonstrate the utility of kerchunk would be to add a tool for exploring changes through time of the kerchunked datasets, similar to the example in the geoviews homepage, along with some narrative.

Any follow-up thoughts, @martindurant @jbednar or @norlandrhagen?

martindurant commented 1 year ago

I didn't specifically mean "visuals" in the sense of hvPlot et al (although those are certainly very nice), but simple tables of benchmarks or different cuts of the aggregate dataset that could not easily be done with xarray acting on netCDFs alone. For real interactive viz, you normally also have to think about execution environment - so similar to other holoviz problems.