Can I control the concurrency of calling LLM

explodinggradients / ragas

Supercharge Your LLM Application Evaluations 🚀

https://docs.ragas.io

Apache License 2.0

7.3k stars 746 forks source link

Open jackqdldd opened 1 week ago

jackqdldd commented 1 week ago

My LLM was based on L20 devices, when generate Test Data It was unexpectedly terminated[ Aborted request]，Is it due to too much concurrency？

jackqdldd commented 1 week ago