search

npuichigo / openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend
MIT License
176 stars 27 forks source link

Propagate opentelemetry context to triton inference server for better tracing #25

Closed npuichigo closed 8 months ago