search

SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
MIT License
7.98k stars 415 forks source link

请问能和vllm共同使用吗 #202

Open yadandan opened 5 months ago

yadandan commented 5 months ago

如题