search

spragunr / deep_q_rl

Theano-based implementation of Deep Q-learning
BSD 3-Clause "New" or "Revised" License
1.08k stars 348 forks source link

No output files on Mac #1

Closed AndersonTaylor closed 9 years ago

AndersonTaylor commented 9 years ago

I finally got it (what appears to be) up and running... and it creates a data/ directory, but it never
populates any files in the folder.

Output:

python ale_run.py --exp_pref data
RL-Glue Version 3.04, Build 909
RL-Glue is listening for connections on port=4096
RL-Glue Python Experiment Codec Version: 2.02 (Build 738)
    Connecting to 127.0.0.1 on port 4096...
    RL-Glue :: Experiment connected.
RL-Glue Python Agent Codec Version: 2.02 (Build 738)
    Connecting to 127.0.0.1 on port 4096...
     Agent Codec Connected
    RL-Glue :: Agent connected.

(then it just hangs, can't tell if it's doing anything or not)

Not sure if you have any idea what might be going wrong, but thought I'd check. Thanks.

spragunr commented 9 years ago

Here is what I see when I run the script: 

RL-Glue Version 3.04, Build 909
RL-Glue is listening for connections on port=4096
A.L.E: Arcade Learning Environment (version 0.4)
[Powered by Stella]
Use -help for help screen.
Warning: couldn't load settings file: ./stellarc
Game console created:
  ROM file:  /home/spragunr/neural_rl_libraries/roms/breakout.bin
  Cart Name: Breakout - Breakaway IV (1978) (Atari)
  Cart MD5:  f34f08e5eb96e500e851a80be3277a56
  Display Format:  AUTO-DETECT ==> NTSC
  ROM Size:        2048
  Bankswitch Type: AUTO-DETECT ==> 2K

Running ROM file...
Random Seed: Time
Game will be controlled through RL-Glue.
RL-Glue Python Experiment Codec Version: 2.02 (Build 738)
    Connecting to 127.0.0.1 on port 4096...
    RL-Glue :: Experiment connected.
Initializing ALE RL-Glue ...
    RL-Glue :: Environment connected.
Using gpu device 0: GeForce GTX 780 Ti
RL-Glue Python Agent Codec Version: 2.02 (Build 738)
    Connecting to 127.0.0.1 on port 4096...
     Agent Codec Connected
    RL-Glue :: Agent connected.

From your output it appears that ALE is not starting. Did you compile it with RLGlue support? If not you need to edit the makefile to enable the USE_RLGLUE flag.

The ale_run.py script is designed to streamline the process of starting all of the necessary processes. While you are getting things running you might try starting each one independently. That could make it easier to see where things are going wrong.

I've only run this code under Ubuntu flavors of Linux. If this is an OSX-related problem, I probably won't be able to help you out.

AndersonTaylor commented 9 years ago

Thanks, I'm new to ALE / RL_Glue.
Didn't know about USE_RLGLUE flag.

Looks like I still got a couple more things to iron out, but that helps gets me on my way... Appreciate the help!