RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.4k stars 92 forks source link

Add robust automatic testing #33

Closed saharNooby closed 1 year ago

saharNooby commented 1 year ago

Currently, rwkv.cpp is tested manually before I push something. This is obviously not optimal. All functionality should have tests, especially Q4_1_O which is prone to breaking.