search

evidentlyai / evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
https://www.evidentlyai.com/evidently-oss
Apache License 2.0
5.4k stars 597 forks source link

Multi-output regression metrics #1032

Open rollersteaam opened 8 months ago

rollersteaam commented 8 months ago

Such as in regression models like Multi-task Lasso, where problems are solved jointly, would it be possible/is it planned to evaluate regression metrics jointly? i.e. We can see the effect of (single or multiple) x on multiple dimensions of y. This would mean allowing multiple target columns and multiple prediction columns for regressions.

DonnyWhoLovedBowling commented 7 months ago

Would be very much appreciated! A use-case would be a forecasting model in which many weeks are forecasted and you'd want to monitor short-term forecasting and long-term forecasting.