Setting S3 as back store for remote server

evidentlyai / evidently

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

https://www.evidentlyai.com/evidently-oss

Apache License 2.0

5.2k stars 584 forks source link

Setting S3 as back store for remote server #1021

Open snarasimhan1997 opened 6 months ago

snarasimhan1997 commented 6 months ago

Hey, I was wondering if its possible to configure a remote evidently server to use say an s3 bucket for all its metadata and snapshot storage. In this link, it mentioned that the UI server can read snapshots from a remote FS like AWS but it does not mention if we can also write to the FS.

My final solution would look like running the UI server in an EC2 instance connected to an EBS volume. I want my UI server to use this EBS storage (or s3 too) to read and write snapshots. Is this possible?

mike0sv commented 6 months ago

Yes it is possible. If you setup s3 as a storage backend, UI server will upload new snapshots there as well