How to add username/password into client/openai_completion.py when calling triton inference server?

npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

MIT License

176 stars 27 forks source link

Closed zengqingfu1442 closed 8 months ago

zengqingfu1442 commented 8 months ago

It seems that openai_trtllm does not provide username and password arguments which can be provided to triton inference api.

zengqingfu1442 commented 8 months ago

/close