RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.37k stars 90 forks source link

Compilation issue on Mac #82

Closed mudler closed 1 year ago

mudler commented 1 year ago

Hi :wave:

First of all, amazing project :)

Let me clarify, I don't have a Mac to double test this - and our CI doesn't seems to catch this bug. I'm the author of LocalAI, and people are reporting since the last rwkv.cpp release that compilation broke with Mac https://github.com/go-skynet/LocalAI/issues/411 , any chance you can reproduce this locally?

Thanks!

LoganDark commented 1 year ago

Yes, the issue is the new stat stuff. My PR fixes this https://github.com/saharNooby/rwkv.cpp/blob/a8ebb07d2501dcb6fd544177022421660537030f/rwkv.cpp#L20-L36 but until @saharNooby is online to merge, you can try to apply that as a solution.