vectorch-ai / ScaleLLM

A high-performance inference system for large language models, designed for production environments.
https://docs.vectorch.com/
Apache License 2.0
316 stars 23 forks source link

install cpython shared lib in manylinux docker image #215

Closed guocuimi closed 3 weeks ago

guocuimi commented 1 month ago

Without python shared lib, we can't link Python as an embedded environment in ScaleLLM.