-
目前计划添加的数据:
- [Uncheatable Eval](https://github.com/Jellyfish042/uncheatable_eval):使用最新的动态数据测试 LLM 性能,包含 RWKV
- [RULER_RWKV](https://github.com/Ojiyumm/RULER_RWKV):RWKV 模型的 [RULER](https://arxiv.org/…
-
Hello, can the WKV acceleration module be tracked/scripted by torch.onnx.export? I'm having trouble converting the.pth model to.onnx.
-
Any plans on supporting RWKV v6?
-
您好,我想请问detection的所提供的mask_rcnn_vrwkv_adapter_base_fpn_1x_coco.py等模型在哪里使用了VRWKV结构?在我理解代码过程中,发现VRWKV_Adapter除了继承VRWKV外,好像并没有再使用VRWKV其中的计算方式,比如InteractionBlock中的交互方式采用MSDeformAttn而非RWKV的计算方法。如果我的理解有误,还请您…
-
我尝试了我所有设备包括 v100/a100/L40S 的设备 ,都无法正常跑通 RWKV-v5
/demo-training-prepare.sh (可能是设备比较老旧)
最接近的一次出现了如下错误:
```
RWKV_MY_TESTING x060
Using /root/.cache/torch_extensions/py310_cu116 as PyTorch extens…
-
### 🚀 The feature, motivation and pitch
Linear attention allows for longer context and faster inference. The eagle model has a 2T checkpoint soon.
### Alternatives
NA
### Additional context
_No r…
-
DepCheck Error: Traceback (most recent call last): File "E:\ruanjian\0000/backend-python/dep_check.py", line 4, in raise ImportError("setuptools>=70.0.0 is not supported") ImportError: setuptools>=70…
-
Not sure if this RNN counts as a LLM, but if so would be nice to have it, let me know what needs to be done with packaging.
https://www.rwkv.com/
-
https://github.com/JL-er/RWKV-PEFT/blob/e07c091a4b2813b5653d17117ea080cd74606f02/src/dataset.py#L106
It seems global_rank, real_epoch, world_size, devices is unavailable in MyDataset's self.
-
Pitch 108
TimeDiff 37568
Length 46778
Velocity 128
Total: 84582