-
Hi I am the dev of https://github.com/BlinkDL/ChatRWKV and it is a RNN (so faster and saves VRAM) that can match transformer performance (and already scaled to 14B params. more to come).
Let me kno…
-
I would love to have a tutorial on how to add an existing model from candle examples.
For example, I want to add clip, starcoder and rwkv, to name a few.
-
```
In file included from /usr/ports/misc/koboldcpp/work/koboldcpp-1.57.1/gpttype_adapter.cpp:29:
/usr/ports/misc/koboldcpp/work/koboldcpp-1.57.1/./otherarch/rwkv_v3.cpp:1379:9: error: cannot initia…
-
As the title, and beyond the title, is there any way to implementation rwkv llava, minicpm-v, internml-composer-v or qwen-v ?
-
RWKV 5 model can not run on gen 12 iGPU
(RWKV-py310) a770@RPLP-A770:~/ouyang/rwkv/models$ python generate_rwkv5.py --repo-id-or-model-path /home/a770/ouyang/rwkv/models/rwkv-5-world/
/home/a770/.…
-
-
**Is your feature request related to a problem? Please describe.**
Your Seq2SeqSharp project already support LSTMs. Please consider to implement the RWKV large language "linear attention" idea into y…
-
I have tried adding the missing Dll for rwkv.dll but then shows as missing is there anything wrong I have done? i downloaded the rwkv.dll form https://github.com/saharNooby/rwkv.cpp/releases/tag/maste…
-
This error occurs when running CRWKV.ONNX.Test.
```
Input Model Name (RWKV_32_2560_16.onnx): RWKV-4-Raven-3B-v11-Eng99-Other1-20230425-ctx4096_32_2560_16.bin
Loading...
Unhandled exception. Micr…
-
RWKV 5 supported vLLM？LMdeploy？TGI？Fastllm？FasterTransformer？
What should I do to get the inference performance？like throughput, token latency and latency？