vectorch-ai / ScaleLLM

A high-performance inference system for large language models, designed for production environments.
https://docs.vectorch.com/
Apache License 2.0
377 stars 28 forks source link

[fix] use the pybind11 from libtorch and fix model download issue. #167

Closed guocuimi closed 5 months ago