Add workaround for missing 'object' field from vLLM OpenAI Completions API response

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

BSD 3-Clause "New" or "Revised" License

527 stars 225 forks source link

Closed matthewkotila closed 2 months ago

matthewkotila commented 2 months ago

Add workaround for missing 'object' field from vLLM OpenAI Completions API response