openai / spinningup

An educational resource to help anyone learn deep reinforcement learning.
https://spinningup.openai.com/
MIT License
10.18k stars 2.23k forks source link

Running SpinningUp on Windows 11 with Windows Subsystem for Linux v2 (Success) #404

Open horseathesource opened 11 months ago

horseathesource commented 11 months ago

I succeeded in running Spinning Up on Windows 11 via WSL 2. The procedure linked in the official page (https://github.com/openai/spinningup/issues/23) did not work for me. Also, it is not necessary to use Xming X Window server anymore.

This is what I did:

1) From Microsoft Store, install: Windows Subsystem for Linux 2) From Microsoft Store, install: Ubuntu 3) Launch Ubuntu to finish installation and configuration 4) From Ubuntu command line: sudo apt update, then sudo apt full-upgrade 5) sudo apt install x11-apps 6) sudo apt install octave (via this step the packets necessary for the rendering parts are installed) 7) Download Miniconda3 Linux 64 bit (most recent one) from here https://docs.conda.io/projects/miniconda/en/latest/miniconda-other-installer-links.html (it's a .sh file) 8) Copy the Miniconda installer in a Linux path (e. g. under /home) 9) From Linux command line, install Miniconda with "bash [filename].sh" 10) Close and reopen Ubuntu terminal 11) conda create -n spinningup python=3.6 12) conda activate spinningup 13) conda install -c conda-forge mpi4py mpich 14) pip install opencv-python==3.4.13.47 (more recent versions might not work) 15) sudo apt-get update && sudo apt-get install libopenmpi-dev 16) sudo mkdir /usr/lib/dri (these 3 steps are necessary if a file_not_found error occurs) 17) sudo ln -s /usr/lib/x86-64-linux-gnu/dri/swrast-dri.so /usr/lib/dri/ 18) sudo ln -s /usr/lib/x86-64-linux-gnu/dri/radeonsi-dri.so /usr/lib/dri/ 19) git clone https://github.com/openai/spinningup.git 20) cd spinningup 21) pip install -e . 22) Follow the steps in "Check your install" from https://spinningup.openai.com/en/latest/user/installation.html

if Uninstall and Reinstall: