search

foldl / chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU)
MIT License
409 stars 34 forks source link

提供python调用方式 #3

Closed wzg-zhuo closed 7 months ago

wzg-zhuo commented 9 months ago

参考chatglm.cpp，能否支持python推理

wzg-zhuo commented 9 months ago

能否提供chatllm_pybind.cpp,_C.py,init.py等文件，谢谢

foldl commented 9 months ago

I will do it after later. Stay tuned.

wzg-zhuo commented 9 months ago

ok thx

foldl commented 8 months ago

Here we go: https://github.com/foldl/chatllm.cpp/blob/master/docs/binding.md

foldl commented 8 months ago

Here a Chatbot web demo:

https://github.com/foldl/chatllm.cpp/blob/master/bindings/chatllm_st.py