cnellington / Contextualized

An SKLearn-style toolbox for estimating and analyzing models, distributions, and functions with context-specific parameters.
http://contextualized.ml/
GNU General Public License v3.0
65 stars 9 forks source link

Add pvalue helper analyses #182

Closed blengerich closed 1 year ago

blengerich commented 1 year ago

Adds helper analyses for #179

As documented in docs/model-analysis.ipynb, these p-value tests quantify the confidence over bootstrap replicates of the sign of each effect.

There are 3 new functions for pvalues located in contextualized.analysis.pvals:

As the names suggest, these functions measure pvals for each of the 3 types of effects.

To add these pvalue analysis tools, there are also 3 new getters in contextualized.analysis.effects:

review-notebook-app[bot] commented 1 year ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

cnellington commented 1 year ago

The notebooks look great but for some reason the unit tests are failing, and the output log is too big to view in browser which is unusual

blengerich commented 1 year ago

Tests are passing now after merging dev into p-vals.