Quick fixes for bugs relating to validation of string-containing DFs and default value for empty y_prob

[esherman-credo]

Describe your changes

Change default value for y_prob in fairness.py to None from tuple.

Change variance checking in tabular data with sensitive features to simply check to see that there is more than 1 value for each sensitive group for the outcome. Addresses issue with string-type outcomes (which have no std function)

Issue ticket number and link

https://credo-ai.atlassian.net/browse/DSP-464 https://credo-ai.atlassian.net/browse/DSP-465

Known outstanding issues that are not fully accounted for

N/A

Checklist before requesting a review

• [x] I have performed a self-review of my code
• [ ] I have built basic tests for new functionality (particularly new evaluators)
• [ ] If new libraries have been added, I have checked that readthedocs API documentation is constructed correctly
• [ ] Will this be part of a major product update? If yes, please write one phrase about this update.

Extra-mile Checklist

• [ ] I have thought expansively about edge cases and written tests for them

[github-actions[bot]]

Coverage Report

File	Stmts	Miss	Cover	Missing
credoai
__init__.py	3	0	100%
_version.py	1	0	100%
credoai/artifacts
__init__.py	7	0	100%
credoai/artifacts/data
__init__.py	0	0	100%
base_data.py	117	14	88%	55, 155, 158, 173, 180, 187, 191, 196, 199, 202, 214, 217, 225, 241
comparison_data.py	63	13	79%	53, 60, 71, 76, 81, 90, 96, 100, 105, 114, 147, 153, 156
tabular_data.py	42	6	86%	52, 76, 80, 99, 101, 108
credoai/artifacts/model
__init__.py	0	0	100%
base_model.py	42	2	95%	57, 103
classification_model.py	63	28	56%	78–81, 98–142, 211–214
comparison_model.py	11	0	100%
constants_model.py	5	0	100%
regression_model.py	11	4	64%	41–43, 46
credoai/evaluators
__init__.py	3	0	100%
data_fairness.py	160	13	92%	85–92, 100, 225, 252, 282–294, 411, 446–447
data_profiler.py	61	4	93%	49, 73–74, 93
deepchecks_credoai.py	40	3	92%	113–122
equity.py	113	6	95%	73, 154–156, 227–228
evaluator.py	73	6	92%	68, 71, 90, 116, 185, 192
fairness.py	125	2	98%	111, 260
feature_drift.py	59	1	98%	66
identity_verification.py	112	2	98%	144–145
model_profiler.py	102	32	69%	93–99, 115–128, 156–159, 172–177, 180–212, 254–255, 264–265, 303
performance.py	86	7	92%	103, 124–130
privacy.py	118	4	97%	410, 447–449
ranking_fairness.py	112	14	88%	144–145, 165, 184, 190–191, 387–409, 414–444
security.py	97	1	99%	309
shap_credoai.py	87	14	84%	117, 125–126, 136–142, 168–169, 251–252, 282–290
survival_fairness.py	67	45	33%	34–46, 51–62, 65–76, 79–97, 100, 103, 106
credoai/evaluators/utils
__init__.py	3	0	100%
fairlearn.py	18	1	94%	93
utils.py	34	3	91%	13, 41–42
validation.py	91	27	70%	11–12, 28, 48–49, 51–53, 60, 70, 72, 76–81, 94, 97, 100, 103–104, 121–128, 134–140, 143
credoai/governance
__init__.py	1	0	100%
credoai/lens
__init__.py	2	0	100%
lens.py	206	13	94%	59, 201–202, 238–243, 300, 342, 366, 448, 463, 467, 479
lens_validation.py	76	36	53%	7–8, 45, 48–57, 73, 77, 82–86, 95, 100–103, 130, 133–153, 181–183
pipeline_creator.py	60	12	80%	20–21, 37, 79–91
utils.py	39	28	28%	20–27, 49–52, 71–82, 99, 106–109, 128–135
credoai/modules
__init__.py	3	0	100%
constants_deepchecks.py	2	0	100%
constants_metrics.py	19	0	100%
constants_threshold_metrics.py	3	0	100%
metric_utils.py	24	18	25%	9–24, 28–49
metrics.py	88	13	85%	63, 67, 70–71, 74, 84, 123, 135–140, 178, 185, 187
metrics_credoai.py	189	52	72%	68–69, 73, 93–102, 107–109, 132–160, 176–179, 206, 230–231, 315–321, 397–403, 439–440, 510–511, 559, 663
stats.py	97	50	48%	15–18, 21–26, 29–31, 34–39, 42–56, 59–64, 106, 132–159, 191, 202–217
stats_utils.py	5	3	40%	5–8
credoai/prism
__init__.py	3	0	100%
compare.py	35	2	94%	71, 87
prism.py	36	4	89%	46, 48, 59, 86
task.py	17	2	88%	30, 37
credoai/prism/comparators
__init_.py	0	0	100%
comparator.py	17	3	82%	34, 42, 47
metric_comparator.py	44	2	95%	125, 131
credoai/utils
__init__.py	5	0	100%
common.py	104	33	68%	55, 72–73, 79, 88–95, 106–107, 124–130, 135, 140–145, 156–163, 190
constants.py	2	0	100%
dataset_utils.py	61	35	43%	23, 26–31, 50, 54–55, 88–119
logging.py	55	13	76%	10–11, 14, 19–20, 23, 27, 44, 58–62
model_utils.py	78	48	38%	11–12, 21–26, 38–39, 42–43, 48–53, 69–114, 120–127
version_check.py	15	4	73%	13–17, 23
TOTAL	3212	623	81%