search

NetEase-Media / grps_trtllm

【grps接入trtllm】通过接入TensorRT-LLM以及Tokenizers.cpp实现纯c++版本高性能LLM服务，兼容OpenAI接口协议，支持chat和function call模式，支持ai agent。
Apache License 2.0
46 stars 1 forks source link

issues

Newest
Newest Most commented Recently updated Oldest Least commented Least recently updated