Parallelize groundedness LLM calls for speedup

truera / trulens

Evaluation and Tracking for LLM Experiments

https://www.trulens.org/

MIT License

2.07k stars 181 forks source link

Closed sfc-gh-dhuang closed 3 months ago

sfc-gh-dhuang commented 3 months ago

Items to add to release announcement:

Other details that are good to know but need not be announced:

AFAICS, we don't not really need to make generate_score_and_reasons (LLM calls) sequentially.