Hi kuz,
Thank for great code for DQN.
It's very helpful to study deeply for DQN.
I'm trying to run this code in docker environment but it failed after returns below messages.
I think it happens because docker is not supporting qt library.
Is that possible to turn off to display process on screen and just save images such as gif?
root@b04d950e403d:~/DeepLearning/DeepMind-Atari-Deep-Q-Learner# ./run_gpu breakout
-framework alewrap -game_path /root/DeepLearning/DeepMind-Atari-Deep-Q-Learner/roms/ -name DQN3_0_1_breakout_FULL_Y -env breakout -env_params useRGB=true -agent NeuralQLearner -agent_params lr=0.00025,ep=1,ep_end=0.1,ep_endt=replay_memory,discount=0.99,hist_len=4,learn_start=50000,replay_memory=1000000,update_freq=4,n_replay=1,network="convnet_atari3",preproc="net_downsample_2x_full_y",state_dim=7056,minibatch_size=32,rescale_r=1,ncols=1,bufferSize=512,valid_size=500,target_q=10000,clip_delta=1,min_reward=-1,max_reward=1 -steps 50000000 -eval_freq 250000 -eval_steps 125000 -prog_freq 10000 -save_freq 125000 -actrep 4 -gpu 0 -random_starts 30 -pool_frms type="max",size=2 -seed 1 -threads 4
Unable to connect X11 server (continuing with -nographics)
Torch Threads: 4
Using GPU device id: 0
Torch Seed: 1
CUTorch Seed: 1791095845
Playing: breakout
Creating Agent Network from convnet_atari3
nn.Sequential {
[input -> (1) -> (2) -> (3) -> (4) -> (5) -> (6) -> (7) -> (8) -> (9) -> (10) -> (11) -> output]
(1): nn.Reshape(4x84x84)
(2): nn.SpatialConvolution(4 -> 32, 8x8, 4,4, 1,1)
(3): nn.Rectifier
(4): nn.SpatialConvolution(32 -> 64, 4x4, 2,2)
(5): nn.Rectifier
(6): nn.SpatialConvolution(64 -> 64, 3x3)
(7): nn.Rectifier
(8): nn.Reshape(3136)
(9): nn.Linear(3136 -> 512)
(10): nn.Rectifier
(11): nn.Linear(512 -> 4)
}
Convolutional layers flattened output size: 3136
Set up Torch using these options:
eval_steps 125000
seed 1
name DQN3_0_1_breakout_FULL_Y
verbose 2
network
pool_frms table: 0x413352f8
saveNetworkParams false
gpu 1
eval_freq 250000
tensorType torch.FloatTensor
env_params table: 0x41335320
steps 50000000
prog_freq 10000
agent_params table: 0x41335230
save_versions 0
framework alewrap
agent NeuralQLearner
threads 4
actrep 4
random_starts 30
game_path /root/DeepLearning/DeepMind-Atari-Deep-Q-Learner/roms/
save_freq 125000
env breakout
Iteration .. 0
qlua: not loading module qtgui (running with -nographics)
qlua: qtwidget window functions will not be usable (running with -nographics)
qtwidget window functions will not be usable (running with -nographics)
qlua: not loading module qtuiloader (running with -nographics)
qlua: /root/torch/install/share/lua/5.1/image/init.lua:1448: attempt to index global 'qtuiloader' (a nil value)
stack traceback:
[C]: in function '__index'
/root/torch/install/share/lua/5.1/image/init.lua:1448: in function 'window'
/root/torch/install/share/lua/5.1/image/init.lua:1399: in function 'display'
train_agent.lua:98: in main chunk
root@b04d950e403d:~/DeepLearning/DeepMind-Atari-Deep-Q-Learner#
Hi kuz, Thank for great code for DQN. It's very helpful to study deeply for DQN.
I'm trying to run this code in docker environment but it failed after returns below messages.
I think it happens because docker is not supporting qt library. Is that possible to turn off to display process on screen and just save images such as gif?