evidentlyai / evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
https://www.evidentlyai.com/evidently-oss
Apache License 2.0
5.4k stars 598 forks source link

Handle time series data #592

Open eldritchhh opened 1 year ago

eldritchhh commented 1 year ago

Hi, is it possible to use Report and Test with time series data? (eg. using past X values as input for a time series forecasting model that predicts the Y future values)

Thanks in advance for your reply!

0lgaF commented 1 year ago

Hi @eldritchhh ! We do not currently have any special time series-focused metrics, but you can use many of the existing metrics and tests with time series data.

You can pass time series data to Evidently and use all existing presets, tests, and metrics.

However, we did not implement any specific methods related to time series (e.g., autocorrelation lag) yet, so you might find some capabilities lacking. You can also implement custom metrics.