search

jianzhnie / LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
https://jianzhnie.github.io/llmtech/
Apache License 2.0
557 stars 62 forks source link

Would you support RWKV? #57

Open xiaol opened 1 year ago

xiaol commented 1 year ago

as you see , RWKV world transformer version is here, https://github.com/xiaol/Huggingface-RWKV-World/tree/main

and some refs: https://osk6ppi3hr.feishu.cn/docx/ZlqkdTHD7owXpFxXvMyct0Jrn1d

RWKV is far beyond efficiency and you can use RWKV runner as a good reference. https://github.com/josStorer/RWKV-Runner

jianzhnie commented 1 year ago

RWKV model is on planing