credo-ai / credoai_lens

Credo AI Lens is a comprehensive assessment framework for AI systems. Lens standardizes model and data assessment, and acts as a central gateway to assessments created in the open source community.
https://credoai-lens.readthedocs.io/en/stable/
Apache License 2.0
46 stars 8 forks source link

Error loading library due to updates in most recent fairlearn's version #336

Closed angeliney closed 11 months ago

angeliney commented 11 months ago

Expected Behavior

loading library works successfully

Actual Behavior

Error due to fairlearn updating their API in v0.9.0

[/usr/local/lib/python3.10/dist-packages/credoai/modules/constants_metrics.py](https://localhost:8080/#) in <module>
     58     "gini_coefficient": gini_coefficient_discriminatory,
     59     "matthews_correlation_coefficient": sk_metrics.matthews_corrcoef,
---> 60     "overprediction": fl_metrics._mean_overprediction,
     61     "precision_score": sk_metrics.precision_score,
     62     "roc_auc_score": sk_metrics.roc_auc_score,

AttributeError: module 'fairlearn.metrics' has no attribute '_mean_overprediction'

Steps to Reproduce the Problem

  1. pip install credoai-lens[full]
  2. from credoai.evaluators import ModelFairness, Performance

Specifications

Workaround

Downgrade fairlearn version back to before the changes occur: pip install fairlearn==0.8.0

fabrizio-credo commented 11 months ago

@angeliney, thanks for your interest in Lens. Unfortunately, this package is no longer maintained. I will therefore close this issue.