The Reimplementation of RWKV.
RWKVを再現実装し、その性能を確かめます。 https://github.com/BlinkDL/RWKV-LM
# clone project
git clone https://github.com/Geson-anko/RWKV-ReImpl.git
cd RWKV-ReImpl
# install pytorch according to instructions
# https://pytorch.org/get-started/
# install requirements
pip install -r requirements.txt
Train model with default configuration
# train on CPU
python src/train.py trainer=cpu
# train on GPU
python src/train.py trainer=gpu
Train model with chosen experiment configuration from configs/experiment/
python src/train.py experiment=experiment_name.yaml
You can override any parameter from command line like this
python src/train.py trainer.max_epochs=20 data.batch_size=64