search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
527 stars 225 forks source link

Nim ci bug fixes #595

Closed debermudez closed 3 months ago

debermudez commented 3 months ago

Collection of fixes for genai-perf to work with NIM