search

evidentlyai / evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
https://www.evidentlyai.com/evidently-oss
Apache License 2.0
5.36k stars 595 forks source link

KeyError from Typing while importing TestSuite #1277

Open brandoneh opened 2 months ago

brandoneh commented 2 months ago

Hi, first time posting an issue so let me know if there's more info needed.

Evidently version: 0.4.36 Python version: 3.11.0

I'm trying to import TestSuite but keep running into the following issue: image

I have tried installing this fresh and I'm still running into the same issue.

Would anyone be able to help solve this?

Thanks

elenasamuylova commented 2 months ago

Hi @brandoneh,

1. Reproducible example. Could you share the exact code you are running, is this:

pip install evidently
from evidently.test_suite import TestSuite

?

2. Environment. What is your Python environment - e.g. Jupyter notebook, Colab?

brandoneh commented 2 months ago

Hi, I'm running into this problem on Databricks, but am also seeing the issue using vscode, poetry and pyenv locally to replicate it. The commands I've run are as below:

poetry new evidently_test
cd evidently_test
pyenv local 3.11.0
poetry shell
poetry add evidently
python
>> from evidently.test_suite import TestSuite

Let me know if I need to provide or clarify anything else. Thanks

VictorAtIfInsurance commented 1 month ago

I had the same problem in Databricks, and I think the problem is that the latest LTS runtimes 15.4 uses a release candidate of python 3.11.0rc1.

I used a 14.3 LTS runtime instead and it seems to work.

ruteabreu commented 1 month ago

Any news on this issue?