search

ray-project / llmperf

LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
659 stars 113 forks source link

fix issue #63 #64

Open huangdi614 opened 3 months ago

huangdi614 commented 3 months ago

When the number of iterations exceeds max_num_completed_requests, no new requests are added, only the results of historical requests are checked.