search

nat / openplayground

An LLM playground you can run on your laptop
MIT License
6.22k stars 483 forks source link

Add rwkv.cpp support (RWKV is a 100% RNN Language Model) #74

Open BlinkDL opened 1 year ago

BlinkDL commented 1 year ago

RWKV Raven 7B Gradio Demo: https://huggingface.co/spaces/BlinkDL/Raven-RWKV-7B

Use rwkv.cpp for CPU INT4 / INT8: https://github.com/saharNooby/rwkv.cpp

Github project: https://github.com/BlinkDL/ChatRWKV

Sample code using rwkv pip package: https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_more.py

Please let me know if you have any questions :)