[Feature Request] Efficiency improvement solution :VLLM

camel-ai / camel

🐫 CAMEL: Finding the Scaling Law of Agents. A multi-agent framework. https://www.camel-ai.org

https://www.camel-ai.org

Apache License 2.0

5.39k stars 660 forks source link

Closed Wendong-Fan closed 2 months ago

Wendong-Fan commented 3 months ago

[X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
[ ] Consider asking first in a Discussion.

Study on efficiency improvement solutions and integrate necessary solutions

VLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

No response

No response

ocss884 commented 3 months ago

VLLM in #448