hpcaitech / EnergonAI

Large-scale model inference.
Apache License 2.0
630 stars 90 forks source link

Link TensorRT as backend for single device execution #82

Closed dujiangsu closed 2 years ago