search

RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.13k stars 82 forks source link

Support RWKV v5 #143

Closed Chen0x00 closed 8 months ago

Chen0x00 commented 8 months ago

When is it expected to be supported? Thx

saharNooby commented 8 months ago

Hi! I'm working on it currently. Can't provide any estimates, since IDK how complicated it will be to support v5 in ggml.