[doc] Instructions for installing on Windows 10

[canbooo]

I have successfully installed and tested spinningup on Windows 10 within an Anaconda environment. Because of the suggestion in the docs, I wanted to share my experience. Following steps were necessary to make it work:

• Remove torch==1.3.1 from requirements and install the latest pytorch as described on their site. This may not be necessary but pip could not find a suitable torch==1.3.1
• mpi4py works with Microsoft MPI on Windows as discussed here so I installed it instead.
• I already had it but installing gym[box2d] requires Visual C++ 1.14 or higher. The easiest way to make it work is by installing the build tools and getting the C++ tools on the navigation menu under workload.

After these steps, I am able to run the installation test example, plot the results and animate. I am now starting to fiddle around and so far, everything looks sweet. I did not attempt anything with MuJoCo though. Thanks for this repo.

[k3KAW8Pnf7mkmdSMPHz27]

Some minor additions

• torch==1.3.1 can be circumvented by conda install pytorch=1.3.1 (if this specific version is needed for something?)
• I needed to install swig through conda as well, e.g., conda install -c anaconda swig

[k3KAW8Pnf7mkmdSMPHz27]

Also, same as https://github.com/openai/spinningup/issues/117 ?

[k3KAW8Pnf7mkmdSMPHz27]

Perhaps someone can write up a nice and easy way of going about it?

There are also

• https://medium.com/@sayanmndl21/install-openai-gym-with-box2d-and-mujoco-in-windows-10-e25ee9b5c1d5
• https://towardsdatascience.com/how-to-install-openai-gym-in-a-windows-environment-338969e24d30

etc. that describes how to get mujuco working as well.

I can't really try this on a pristine system until earliest next week (assuming I can get hold of a mujuco trial license).

[canbooo]

Also, same as #117 ?

Not exactly as i don't make use of WSL aka Windows subsystem for Linux.