bradyrx / esmtools

:octopus: a toolbox for Earth System Model analysis :octopus:
https://esmtools.readthedocs.io/en/latest/
MIT License
27 stars 4 forks source link

create testing.py with ttest and multipletest #71

Closed aaronspring closed 4 years ago

aaronspring commented 4 years ago

Description

Type of change

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. This could point to a cell in the updated notebooks. Or a snippet of code with accompanying figures here.

Checklist (while developing)

Pre-Merge Checklist (final steps)

References

Wilks, D. S. “‘The Stippling Shows Statistically Significant Grid Points’: How Research Results Are Routinely Overstated and Overinterpreted, and What to Do about It.” Bulletin of the American Meteorological Society 97, no. 12 (March 9, 2016): 2263–73. https://doi.org/10/f9mvth.

bradyrx commented 4 years ago

@aaronspring I just modified this directly to clean it up a bit since you're on vacation. Give it a look and let me know what you think before I merge. Was there any reason to write that unstack function and copy values over? Using .values would load into memory which I want to avoid at all costs now so everything is dask-compatible.

Just using the standard .unstack() seems to work.

bradyrx commented 4 years ago

Thanks! This finally encourages me to read the Wilks paper you cited. It seems important. We should also potentially include these things in climpred. Or maybe that's up to user-defined metrics.

aaronspring commented 4 years ago

climpred can just import this from esmtools

bradyrx commented 4 years ago

climpred can just import this from esmtools

Agreed. I am working on porting all standard stats over to esmtools via https://github.com/bradyrx/esmtools/pull/70 that will all be dask compatible. Then we can just have esmtools as a dependency on climpred and call the dask-aware things like rm_trend.