RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.13k stars 82 forks source link

Upgrade GGML to commit 755be56 #139

Closed marty1885 closed 9 months ago

marty1885 commented 9 months ago

Hi,

This PR upgrades GGML to the last commit before them switching to GGUF. This should being some slight performance upgrade to rwkv.cpp and serve as a intermediate step before implementing GGUF support.

marty1885 commented 9 months ago

Wait. Closing. I based on a very of version...