create stats functions, moved outcome distribution out of equity eval…

[IanAtCredo]

…uator, simplified

Describe your changes

Modularized many equity functions. Added more "stats", removed unnecessary "describe" method (mostly overlapping with dataset fairness)

Issue ticket number and link

Known outstanding issues that are not fully accounted for

Checklist before requesting a review

• [x] I have performed a self-review of my code
• [ ] I have built basic tests for new functionality (particularly new evaluators)
• [ ] If new libraries have been added, I have checked that readthedocs API documentation is constructed correctly
• [ ] Will this be part of a major product update? If yes, please write one phrase about this update.

Extra-mile Checklist

• [ ] I have thought expansively about edge cases and written tests for them

[IanAtCredo]

Looks good, although integration tests are failing in the export phase.

Potentially the removal of the describe method has altered the provided evidences and there is a mismatch between what platform expects and what gets created. 🤔

Yeah, that's what I believe is happening too.

[github-actions[bot]]

Coverage Report

File	Stmts	Miss	Cover	Missing
credoai
__init__.py	3	0	100%
credoai/artifacts
__init__.py	7	0	100%
credoai/artifacts/data
__init__.py	0	0	100%
base_data.py	107	12	89%	55, 155, 158, 173, 180, 187, 191, 195, 199, 211, 214, 221
comparison_data.py	63	13	79%	53, 60, 71, 76, 81, 90, 96, 100, 105, 114, 147, 153, 156
tabular_data.py	40	6	85%	52, 73, 77, 96, 98, 105
credoai/artifacts/model
__init__.py	0	0	100%
base_model.py	36	2	94%	56, 88
classification_model.py	23	0	100%
comparison_model.py	11	0	100%
constants_model.py	2	0	100%
regression_model.py	11	4	64%	43–45, 48
credoai/evaluators
__init__.py	15	0	100%
data_fairness.py	147	12	92%	83–90, 205, 260–261, 287, 311, 334–340, 356
data_profiler.py	34	2	94%	57, 60
deepchecks.py	40	3	92%	113–122
equity.py	113	6	95%	73, 152–154, 225–226
evaluator.py	72	7	90%	67, 70, 89, 115, 135, 180, 187
fairness.py	113	2	98%	115, 228
feature_drift.py	59	1	98%	66
identity_verification.py	112	2	98%	144–145
model_profiler.py	74	11	85%	127–130, 144–147, 181–182, 191–192, 230
performance.py	84	7	92%	103, 124–130
privacy.py	118	4	97%	410, 447–449
ranking_fairness.py	134	14	90%	136–137, 157, 178, 184–185, 382–404, 409–439
security.py	96	1	99%	297
shap.py	87	14	84%	117, 125–126, 136–142, 168–169, 251–252, 282–290
survival_fairness.py	67	50	25%	27–31, 34–46, 51–62, 65–76, 79–97, 100, 103, 106
credoai/evaluators/utils
__init__.py	3	0	100%
fairlearn.py	18	1	94%	93
utils.py	8	1	88%	9
validation.py	81	28	65%	14, 34–35, 37–39, 46, 67–74, 80–86, 89, 95–98, 105, 108, 111, 114–115, 119–121
credoai/governance
__init__.py	1	0	100%
credoai/lens
__init__.py	2	0	100%
lens.py	201	13	94%	53, 195–196, 232–237, 294, 336, 360, 442, 457, 461, 473
pipeline_creator.py	60	12	80%	20–21, 37, 79–91
utils.py	39	28	28%	20–27, 49–52, 71–82, 99, 106–109, 128–135
credoai/modules
__init__.py	3	0	100%
constants_deepchecks.py	2	0	100%
constants_metrics.py	19	0	100%
constants_threshold_metrics.py	3	0	100%
metric_utils.py	24	18	25%	15–30, 34–55
metrics.py	88	13	85%	63, 67, 70–71, 74, 84, 123, 135–140, 178, 185, 187
metrics_credoai.py	135	47	65%	68–69, 73, 93–102, 107–109, 132–160, 176–179, 206, 230–231, 294–296, 372–378, 414–415, 485–486
stats.py	97	50	48%	15–18, 21–26, 29–31, 34–39, 42–56, 59–64, 106, 132–159, 191, 202–217
stats_utils.py	5	3	40%	5–8
credoai/prism
__init__.py	3	0	100%
compare.py	35	2	94%	71, 87
prism.py	36	4	89%	46, 48, 59, 86
task.py	17	2	88%	30, 37
credoai/prism/comparators
__init_.py	0	0	100%
comparator.py	17	3	82%	34, 42, 47
metric_comparator.py	44	2	95%	125, 131
credoai/utils
__init__.py	5	0	100%
common.py	102	33	68%	55, 68–69, 75, 84–91, 102–103, 120–126, 131, 136–141, 152–159, 186
constants.py	2	0	100%
dataset_utils.py	61	35	43%	23, 26–31, 50, 54–55, 88–119
logging.py	55	13	76%	10–11, 14, 19–20, 23, 27, 44, 58–62
model_utils.py	30	11	63%	14–19, 29–30, 35–40
version_check.py	11	1	91%	16
TOTAL	2875	493	83%