evidentlyai / evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
https://www.evidentlyai.com/evidently-oss
Apache License 2.0
5.37k stars 596 forks source link

ModuleNotfoundError: No module named 'evidently.report' #307

Open sanram905 opened 2 years ago

sanram905 commented 2 years ago

Hello!

I was trying the example notebook 'metrics_presets.ipynb' and can not load report module. Is it specific to some version of evidently? I have already been using evidently for classification performance, data drift and data quality dashboards, which look great. Now I need the report for getting some performance metrics for custom visualisation, but it wont load evidently.report module.

thanks for your awesome work and would appreciate your help on this issue

Liraim commented 2 years ago

Hi, This is WIP reports, we haven't released it yet. It works on version from sources only for now.

sanram905 commented 2 years ago

Thanks much for prompt response. I tried it with source and it works perfectly well for my use case where I need to run performance reports over subsets of data (group by some category) and get quality metric to further calculate some custom metrics per category. Now I put a table (where cells are color coded based on variable value) and barchart in plotly horizontally in one figure. the code works fine. But when I define it in a widget, the table doesn't get displayed in my dashboard, but the barchart does. I haven't seen the use of go.Table in Evidently source code, is it not supported? Thanks again

Liraim commented 2 years ago

Yes, we don't have support for plotly tables, but you can use simple version of tables from Evidently:


BaseWidgetInfo(
    title="",
    type="table",
    params={"header": ["value", "count"], "data":[['a', 1], ['b', 2]]},
    size=2,
)```
sanram905 commented 2 years ago

Does the Evidently table support color code based on cell value? And how about plotly subplots or multiple yaxis ?? are they supported?