search

google-research / neuralgcm

Hybrid ML + physics model of the Earth's atmosphere
https://neuralgcm.readthedocs.io
Apache License 2.0
666 stars 74 forks source link

Extract Zarr reader into its own package #97

Open alxmrs opened 3 months ago

alxmrs commented 3 months ago

I would love to be able to install NeuralGCM’s Zarr/tfds reader as its own python package.

https://github.com/google-research/neuralgcm/blob/d32e8b6365bd6096a76b531a14df1a27723d5e2c/neuralgcm/reference_code/reader.py#L378

It would be nice to see how this compares to xbatcher in benchmarks. I’d also like to see how well it would work with tile-serving-backed Xarray datasets, like data via Xee.

shoyer commented 3 months ago

Yes, I would love this! This would definitely make sense on its own project, I will see if I can finish up the open source launch :)