-
EnvironmentError( OSError: models/rwkv-4-raven does not appear to have a file named config.json. Checkout ‘https://huggingface.co/models/rwkv-4-raven/None’ for available files.
-
- Verbose
- Repetition problems
- Hallucination of answers
For Role Play, this might be partly usable but there are better alternatives like Mistral 0.2 DPO Q5 M and MythoMax, etc on Llama. I thi…
-
I need to use **tokenizer.json** in my project, how should I create it?
-
It is an impressive extension of WKV from unidirectional to bidirectional. However, the current WKV is still limited to 1D sequences. I believe the relative bias |t-i|/T can be extended to (|x-i|/H + …
-
Hi, thanks for your work :)
Now, I'm wondering how can I finetune RWKV given a pretrained model.
I know that there is one repo (https://github.com/Blealtan/RWKV-LM-LoRA ) using LoRA for finetuning. …
-
Linux OS 22.04
1. convert RWKV model to INT4
model = AutoModelForCausalLM.from_pretrained(model_path,
load_in_4bit=True,
…
-
Hi, I did the following simple test for RWKV6, but it shows the following error.
Have you met this before?
could you share me your detailed python,cuda,torch version?
```python
model = RWKV6…
-
**问题描述 / Problem Description**
用简洁明了的语言描述这个问题 / Describe the problem in a clear and concise manner.
![image](https://github.com/chatchat-space/Langchain-Chatchat/assets/147698475/63df3417-5eb1-474d-…
-
用RWKV-LM-main\RWKV-v4neo来微调rwkv4的时候,运行出错,cuda就在Ubuntu系统目录Usr/local/cuda/下。还是找不到
-
支持world模型吗? 我没看到有world词表: https://github.com/ssbuild/rwkv_finetuning/tree/dev/tools/rwkv4_infer