yuunnn-w / RWKV_Pytorch

This is an inference framework for the RWKV large language model implemented purely in native PyTorch. The official native implementation is overly complex and lacks extensibility. Let's join the flexible PyTorch ecosystem and open-source it together!
GNU General Public License v3.0
112 stars 7 forks source link

GPU speedup #6

Closed uniartisan closed 6 months ago

WuTianyi321 commented 6 months ago

很强,用cuda性能实测提升接近十倍