search

hytest-org / hytest

https://hytest-org.github.io/hytest/
22 stars 11 forks source link

Move rechunk data and tutorials #256

Closed gzt5142 closed 1 year ago

gzt5142 commented 1 year ago

Relocate in the repo file tree. Test data moved to public S3 bucket rather than keep in the repo.

closes #216

amsnyder commented 1 year ago

@gzt5142 - is this waiting on a review?

gzt5142 commented 1 year ago

@gzt5142 - is this waiting on a review?

This is waiting on the resolution of a bug/problem we seem to be having with writing zarr data in the nebari environment. I think I've got it sorted now... will likely be ready to go on this by the end of today, or perhaps by the end of the week.

gzt5142 commented 1 year ago

OK... I think I'm done here. Tutorial works. To streamline the tutorial, I restricted the input dataset to only 100 gages. Even so, it took 30 minutes to run. just FYI.

gzt5142 commented 1 year ago

@amsnyder , @rsignell-usgs

This was stalled for a while until we figured out some of the libraries re: rechunker, zarr, etc. Seems to go now. Ready to merge in.