Fall 2017 Deep RL Final Project

Final Project Assignment

You can check style with pylint --disable=locally-disabled,fixme src.

Our dependencies require Python 3.5 (and assume appropriate GPU drivers have already been installed).

conda create -y -n gpu-py3.5 python=3.5 anaconda
source activate gpu-py3.5
conda install -y gcc # prereq for numpy upgrade
conda upgrade -y numpy # upgraded numpy is a prereq for gym
pip install tensorflow-gpu # or tensorflow for CPU only
pip install -r requirements.txt

Installing OpenAI baselines

git clone https://github.com/openai/baselines.git
cd baselines
sudo apt-get install mpich  # see Mac OS version below
env MPICC=/usr/bin/mpicc pip install mpi4py # see Mac OS version below
pip install -e .
cd ..

## Mac OS
brew install mpich
env MPICC=/usr/local/Cellar/mpich/3.2_3/bin/mpicc pip install mpi4py
# (if that fails, use 'sudo find / -name mpicc' to find where MPICC is located + substitute accordingly)

Train PPO agent

cd src
python run_atari_ppo.py [--max_timesteps=1]