search

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
520 stars 225 forks source link

Arbitrary Json extra input #683

Closed IzzyPutterman closed 4 weeks ago

IzzyPutterman commented 1 month ago

Enable support for converting a json formatted string provided on the CLI to --extra-inputs and converting it to a dictionary.

Example:

--extra-inputs '{"name": "Winnie the Pooh","favorite food": ["honey", "more honey"]}'

IzzyPutterman commented 1 month ago

Looks like a lot of changes, but its just a big indent :)