search

npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend
MIT License
176 stars 27 forks source link

Fix dynamic length of stop words. (#50) #51

Closed Raphael-Jin closed 4 months ago