search

npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend
MIT License
155 stars 25 forks source link

Update to use axum 0.7 and enhance telemetry #20

Closed npuichigo closed 8 months ago