search

microsoft / responsible-ai-toolbox

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.
https://responsibleaitoolbox.ai/
MIT License
1.37k stars 360 forks source link

Running Dashboards on Azure Databricks #1652

Open achandak33 opened 2 years ago

achandak33 commented 2 years ago

Describe the bug I am trying to run ResponsibleAIDashboard on Azure Databricks Notebook. I have a cluster and I have installed raiwidgets library in the cluster.

When I do this - ResponsibleAIDashboard(rai_insights, cohort_list=cohort_list) , I get the error

ResponsibleAI started at None

Screen Shot 2022-08-18 at 11 19 41 AM

I bet it is a IP and port problem because the tutorial - https://github.com/microsoft/responsible-ai-toolbox/blob/main/notebooks/responsibleaidashboard/responsibleaidashboard-census-classification-model-debugging.ipynb- runs seamlessly on my VM or local.

imatiach-msft commented 2 years ago

hi @achandak33 We only support the explanation and fairness dashboards on Databricks (and only the static view for the explanation dashboard). Since Azure Databricks does not allow us to open ports, we can’t actually allow the user to open a new tab and view the all-in-one ResponsibleAI dashboard with dynamic functionality enabled in Azure Databricks.

Please see related closed issue: https://github.com/microsoft/responsible-ai-toolbox/issues/1488

Also, the Error Analysis dashboard has some initial limited support I’ve added a couple months ago to display on Databricks, but only when using a spark model/dataset. I could help you to try to run it.

See related open issue for Error Analysis Dashboard: https://github.com/microsoft/responsible-ai-toolbox/issues/944

Since that issue was opened I have merged this PR to add support for spark models in a static view of the Error Analysis Dashboard: https://github.com/microsoft/responsible-ai-toolbox/pull/1388

Note we don't publicly advertise it on this repository yet as we still need to support the heatmap, add support for categorical columns, fix some minor issues and test the functionality more.