vectorch-ai / ScaleLLM

A high-performance inference system for large language models, designed for production environments.
https://docs.vectorch.com/
Apache License 2.0
317 stars 24 forks source link

[feat] added cuda 11.8 devel image to build cpp release image #194

Closed guocuimi closed 1 month ago