RWKV / rwkv.cpp

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
MIT License
1.4k stars 92 forks source link

Move graph building into its own function #69

Closed LoganDark closed 1 year ago

LoganDark commented 1 year ago

step towards #50 and loading models from memory among other things

I will probably not implement full mmap support but I was thinking about things like loading models from memory and realized that it would be useful to have this in its own function

LoganDark commented 1 year ago

image

Nice

saharNooby commented 1 year ago

@LoganDark I prefer to check notifications in my own pace, so if I'm taking too long to review/answer (sorry for that) there is nothing to be done besides waiting :(

LoganDark commented 1 year ago

@LoganDark I prefer to check notifications in my own pace, so if I'm taking too long to review/answer (sorry for that) there is nothing to be done besides waiting :(

oh, sorry