Async call of OpenAISimilarityScorer is slower than sync version

citadel-ai / langcheck

Simple, Pythonic building blocks to evaluate LLM applications.

https://langcheck.readthedocs.io/en/latest/index.html

MIT License

186 stars 17 forks source link

Async call of OpenAISimilarityScorer is slower than sync version #166

Open Vela-zz opened 2 days ago

Vela-zz commented 2 days ago

Fixes #160

Although the current code structure can not take the advantage of using Async call, because I see it is not recomended to override the scorer func in subclasses, but at least it would not slower than the sync one.