search

CentML / flexible-inference-bench

A modular, extensible LLM inference benchmarking framework that supports multiple benchmarking frameworks and paradigms.
Apache License 2.0
5 stars 0 forks source link

small patch #67

Closed johncalesp closed 1 month ago

johncalesp commented 1 month ago

fix sending 1 output token for benchmarking