search

mMrBun / AIPC

Apache License 2.0
56 stars 20 forks source link

请问可以支持调用本地模型吗？ #23

Closed Teryua closed 3 months ago

Teryua commented 3 months ago

现在给地址是默认去hf或者modelscope下载权重，请问怎么样给本地地址就能用vllm推理起来？

mMrBun commented 3 months ago

@Teryua 请查看README中的介绍，模型路径可以写本地路径