search

dandelionsllm / pandallm

Panda项目是于2023年5月启动的开源海外中文大语言模型项目，致力于大模型时代探索整个技术栈，旨在推动中文自然语言处理领域的创新和合作。
Apache License 2.0
1.06k stars 91 forks source link

llama.cpp support #3

Closed lucasjinreal closed 1 year ago

lucasjinreal commented 1 year ago

would consider support llama.cpp?

SparkJiao commented 1 year ago

Yes, we will consider supporting some inference tools. But currently there is not a clear date for release.

Thanks for your suggestions very much!