Introducing a ring attention mechanism for handling long contexts

vectorch-ai / ScaleLLM

A high-performance inference system for large language models, designed for production environments.

https://docs.vectorch.com/

Apache License 2.0

317 stars 24 forks source link

Open guocuimi opened 2 months ago