Open liucheny opened 6 months ago
yes, you can. Need update your AnyOpenLLM. 我在知乎写了文章讲解如何运行这个框架,你可以试试看呢。 https://zhuanlan.zhihu.com/p/693251608
yes, you can. Need update your AnyOpenLLM. 我在知乎写了文章讲解如何运行这个框架,你可以试试看呢。 https://zhuanlan.zhihu.com/p/693251608
消失了,佬,可以再发个嘛
I think the author make some script there, but just not in the README.
You can simply call codellama, or probably setup VLLM but that requires some additional efforts.