Upgrade d3rlpy

[takuma-sony]

Hi, I'm the author of d3rlpy. I see this repo using d3rlpy. Recently, I've made a major change to d3rlpy including some interface changes. I'd like to give a heads-up. The quick solution is to pin d3rlpy version to 1.1.1. Thanks!

[aiueola]

Hi @takuma-sony,

Thank you so much for sharing the updates on d3rlpy! I will first pin d3rlpy version to 1.1.1, and will then check compatibility with the latest version of d3rlpy. Thanks!

[aiueola]

[For those who have issues installing the package from pip]

We are currently working on updating the dependency as discussed above, but meanwhile, the temporal solution is to use scope-rl==0.1.3 and d3rlpy==1.1.1 on Python 3.9.

(1) for Mac (and perhaps for Windows as well)

1-0. Install Python 3.9 if necessary.

1-1. Setup virtual env.

pip install virtualenv
virtualenv -p python3.9 scope-venv

1-2. Upgrade pip, setuptools, and wheel.

pip install --upgrade pip
pip install --upgrade pip setuptools wheel

2-2. Install Cython and numpy to meet the d3rlpy's dependency.

pip install Cython==0.29.36
pip install numpy

2-3. Install SCOPE-RL.

pip install scope-rl==0.1.3

(2) for Colab

2-1. Install Python 3.9.

!sudo apt-get install python3.9

2-2. Setup venv.

!pip3 install virtualenv
!virtualenv -p python3.9 scope-venv
!source /content/scope-venv/bin/activate
!sudo apt-get install python3.9-distutils

2-3. Install SCOPE-RL.

!pip3 install scope-rl==0.1.3

[aiueola]

[Working log]

We are working on upgrading scope-rl to reflect recent changes in d3rlpy in the d3rlpy branch.

PR #18

• [x] upgrade scope-rl source code for compatibility
• [x] update quickstart examples to reflect changes
• [ ] (tune hyperparameters of models used in quickstarts)
• [x] update documentation to reflect changes

---

• [x] some minor fix (policy heads and plots)
• [x] update appendix of the preprint

[aiueola]

[Upgrade]

scope-rl==0.2.1, which is compatible with d3rlpy==2.0.4, is now available! 🎉

• Release note: https://github.com/hakuhodo-technologies/scope-rl/releases/tag/0.2.1
• PyPI: https://pypi.org/project/scope-rl/0.2.1/

[takuma-sony]

Thanks for the update!