Arize-ai / phoenix

AI Observability & Evaluation
https://docs.arize.com/phoenix
Other
3.89k stars 292 forks source link

[BUG] `client.get_spans_dataframe` is too slow #4083

Open axiomofjoy opened 3 months ago

axiomofjoy commented 3 months ago

From testing by @hamelsmu:

1. client.get_spans_dataframe 22s
2. downloading the SQL Lite DB and reading that into pandas: 1.6s
Here is a notebook comparing both https://gist.github.com/hamelsmu/2ce7636935b6d55c3852e25a445926c8

The remote compute on my local home network. But that shouldn’t matter because in the comparison i’m running scp to download the entire postgres db

RogerHYang commented 3 months ago

fwiw