remove deprecated legacy caching

truera / trulens

Evaluation and Tracking for LLM Experiments

https://www.trulens.org/

MIT License

1.84k stars 161 forks source link

remove deprecated legacy caching #1233

Closed sfc-gh-jreini closed 1 week ago

sfc-gh-jreini commented 1 week ago

Other details that are good to know but need not be announced:

Streamlit deprecated legacy caching. Removing from the leaderboard

sfc-gh-pmardziel commented 1 week ago

Anyone check whether this has any impact on the UI (or maybe what the cache was doing in the first place?)

sfc-gh-jreini commented 1 week ago

Anyone check whether this has any impact on the UI (or maybe what the cache was doing in the first place?)

Tested on the 5k records x 6 feedback set, with minimal change from baseline:

17s -> 19s leaderboard load time
31s -> 37s evaluations page
n/a -> 16s single record

sfc-gh-chu commented 1 week ago

Anyone check whether this has any impact on the UI (or maybe what the cache was doing in the first place?)

@sfc-gh-pmardziel doesn't seem to make an impact on the dashboard since we're not caching anything atm afaik. Not sure why it was there for to begin with