search

RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.37k stars 90 forks source link

Any support for OpenBLAS? #121

Open raymond-infinitecode opened 1 year ago

raymond-infinitecode commented 1 year ago

Hi RWKV team, as original GGML has support for OpenBlas, is there any directives we could set to enable the compilation for it ?

saharNooby commented 1 year ago

Hi! I think you can try adding -DRWKV_OPENBLAS=ON to CMake build command, the flag is defined here. It may or may not work -- I did not test it. If it does not work, please report it here.

chymian commented 1 year ago

@raymond-infinitecode did you get it up & running?