Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
520
stars
225
forks
source link
Draft: WIP: Tokens to TRTLLM backend #650
Open
IzzyPutterman opened 1 month ago
@nv-hwoo Should this be merged to your dev branch?