Hi, We facing issue with llmperf when setting concurrent_users more than 1 user. The code gets stuck and doesnot progress further even after few mins. Attached screenshot below.
After sometime (~5mins) it fails with below error: (we set 2 concurrent users)
We checked even memory and cpu cosumption and we have still 75% available bandwidth to support.
Could someone please help us here to proceed further on this perf testing?
Hi, We facing issue with llmperf when setting concurrent_users more than 1 user. The code gets stuck and doesnot progress further even after few mins. Attached screenshot below.
After sometime (~5mins) it fails with below error: (we set 2 concurrent users)
We checked even memory and cpu cosumption and we have still 75% available bandwidth to support.
Could someone please help us here to proceed further on this perf testing?
Thanks, Nihar