can you give some data examples about training chinese model

Blealtan / RWKV-LM-LoRA

RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

Apache License 2.0

405 stars 41 forks source link

can you give some data examples about training chinese model #3

Closed ZTurboX closed 1 year ago

ZTurboX commented 1 year ago

can you give some data examples about training chinese model?

Blealtan commented 1 year ago

我也没有自己训过只是写了个实现给大家玩。。可以试试belle之类的数据？