Try out RWKV model - Githubissues

Francesco215 / Language_CA

Algorithm that generates text in a way inspired by morphogenesis

9 stars 3 forks source link

Try out RWKV model #18

Open Francesco215 opened 1 year ago

Francesco215 commented 1 year ago

The RWKV model is a linear trasnformer that can be used as an RNN, it reaches perfomances comparable with traditional transformers while being much more efficent