How to add username/password into client/openai_completion.py when calling triton inference server?

npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend

MIT License

155 stars 25 forks source link

Closed zengqingfu1442 closed 6 months ago

zengqingfu1442 commented 6 months ago

It seems that openai_trtllm does not provide username and password arguments which can be provided to triton inference api.

zengqingfu1442 commented 6 months ago

/close