Open Bleyddyn opened 7 years ago
I added a pull request with partially working code: https://github.com/openai/baselines/pull/122
Were you or anyone able to create a fully working enjoy.py for acktr?
@phuongho43 I haven't looked at this in a long time. You can have a look at the latest version of my script at: https://github.com/Bleyddyn/baselines/blob/master/baselines/acktr/enjoy_acktr.py
I just tried it and it does look like it's running. However the render option doesn't work, so I can't watch what it's doing, just see the average scores.
I added logger.configure() to run_atari.py then trained a model.
I copied make_model.pkl and one of the checkpoint files to the acktr directory then tried to write something like one of the deepq enjoy scripts so I could see how my model was playing.
Below is my code and the error messages I'm seeing.
Any suggestions would be appreciated.
$ python3 ./enjoy_breakout.py [2017-08-24 14:23:27,095] Making new env: BreakoutNoFrameskip-v4 2017-08-24 14:23:27.282739: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use SSE4.2 instructions, but these are available on your machine and could speed up CPU computations. 2017-08-24 14:23:27.282776: W tensorflow/core/platform/cpu_feature_guard.cc:45] The TensorFlow library wasn't compiled to use AVX instructions, but these are available on your machine and could speed up CPU computations. Use async eigen decomp updating 34 eigenvalue/vectors projecting 12 gradient matrices 2017-08-24 14:23:31.711684: I tensorflow/core/common_runtime/simple_placer.cc:697] Ignoring device specification /job:localhost/replica:0/task:0/device:CPU:0 for node 'fifo_queue_Close_1' because the input edge from 'fifo_queue' is a reference connection and already has a device field set to /job:localhost/replica:0/task:0/device:GPU:0 2017-08-24 14:23:31.711727: I tensorflow/core/common_runtime/simple_placer.cc:697] Ignoring device specification /job:localhost/replica:0/task:0/device:CPU:0 for node 'fifo_queue_Close' because the input edge from 'fifo_queue' is a reference connection and already has a device field set to /job:localhost/replica:0/task:0/device:GPU:0 2017-08-24 14:23:31.711745: I tensorflow/core/common_runtime/simple_placer.cc:697] Ignoring device specification /job:localhost/replica:0/task:0/device:CPU:0 for node 'cond_1/fifo_queue_enqueue' because the input edge from 'cond_1/fifo_queue_enqueue/Switch' is a reference connection and already has a device field set to /job:localhost/replica:0/task:0/device:GPU:0 2017-08-24 14:23:31.711778: I tensorflow/core/common_runtime/simple_placer.cc:697] Ignoring device specification /job:localhost/replica:0/task:0/device:CPU:0 for node 'cond_2/fifo_queue_Size' because the input edge from 'cond_2/fifo_queue_Size/Switch' is a reference connection and already has a device field set to /job:localhost/replica:0/task:0/device:GPU:0 2017-08-24 14:23:31.711792: I tensorflow/core/common_runtime/simple_placer.cc:697] Ignoring device specification /job:localhost/replica:0/task:0/device:CPU:0 for node 'cond_2/cond/fifo_queue_Dequeue' because the input edge from 'cond_2/cond/fifo_queue_Dequeue/Switch' is a reference connection and already has a device field set to /job:localhost/replica:0/task:0/device:GPU:0 Failed to load model checkpoint
Mac OS X 10.9.5 Python 3.6.2 baselines is up-to-date Tensorflow 1.3.0