Share persistent values among processes

muupan commented 5 years ago

so that BatchNormalization etc can be safely shared among processes. This is required by #477

I'll remove [WIP] once I confirm that this enables training with batch normalization.

Add chainerrl.misc.namedpersistent, a function that mimics https://github.com/chainer/chainer/pull/6788
Modify chainerrl.misc.async_.extract_params_as_shared_arrays and chainerrl.misc.async_.set_shared_params so that not only parameters but also persistent values are shared among processes.
Add code that checks if all the extracted values are used, and fix a bug in test found by the check.

muupan commented 5 years ago

I confirmed that this enabled training with batch normalization and actor-learner parallelism, so I removed [WIP].

muupan commented 5 years ago

/test

pfn-ci-bot commented 5 years ago

Successfully created a job for commit 4aaf766:

muupan commented 5 years ago

/test

pfn-ci-bot commented 5 years ago

Successfully created a job for commit b82b710:

chainer / chainerrl