RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.13k stars 82 forks source link

Python API restructurization & code style improvements #130

Closed saharNooby closed 10 months ago

saharNooby commented 10 months ago

Breaking changes for end users: Python API files (rwkv_cpp_model.py, rwkv_cpp_shared_library.py) were moved from ./rwkv to ./python/rwkv_cpp; you may need to change the paths/package names in your code.

Some notable internal changes: