RosenblockChainers / Unity_RL

【進化計算と強化学習の本3】の"Unityで強化学習を始めよう 〜ML-AgentsでCartPole作成〜"で用いたコードを公開しています.
Other
0 stars 0 forks source link

I can't save .bytes file! Plz help #2

Open gustn72 opened 6 years ago

gustn72 commented 6 years ago

Hello I am following this Unity example. In training process, few seconds later, it show "list index out of range" error I think the error is about "freeze_graph.py", saving bytes files

Please help me

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): I do not modify any of the source code OS Platform and Distribution (e.g., Linux Ubuntu 16.04): MacOS High Sierra 10.13.6

TensorFlow installed from (source or binary): source (pip3) TensorFlow version (use command below): 1.10.1 Python version: 3.6 **Bazel version N CUDA/cuDNN version N _ GPU model and memory

Unity_RL git:(master) ✗ python3 python/run_hill_climbing.py /Users/wsl/Unity_RL/python/test.app --run_id=11 --train

/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: compiletime version 3.5 of module 'tensorflow.python.framework.fast_tensor_util' does not match runtime version 3.6 return f(*args, **kwds) CrashReporter: initialized Mono path[0] = '/Users/wsl/Unity_RL/python/test.app/Contents/Resources/Data/Managed' Mono config path = '/Users/wsl/Unity_RL/python/test.app/Contents/MonoBleedingEdge/etc' PlayerConnection initialized from /Users/wsl/Unity_RL/python/test.app/Contents/Resources/Data (debug = 0) PlayerConnection initialized network socket : 0.0.0.0 55054 Multi-casting "[IP] 192.168.43.65 [Port] 55054 [Flags] 2 [Guid] 1965391316 [EditorId] 2137687650 [Version] 1048832 [Id] OSXPlayer(WSLs-MBP) [Debug] 0 [PackageName] OSXPlayer" to [225.0.0.222:54997]... Started listening to [0.0.0.0:55054] PlayerConnection already initialized - listening to [0.0.0.0:55054] INFO:unityagents: 'CartPoleAcademy' started successfully! Unity Academy name: CartPoleAcademy Number of Brains: 1 Number of External Brains : 1 Lesson number : 0 Reset Parameters :

Unity brain name: CartPoleBrain Number of Visual Observations (per agent): 0 Vector Observation space type: continuous Vector Observation space size (per agent): 4 Number of stacked Vector Observation: 1 Vector Action space type: discrete Vector Action space size (per agent): 2 Vector Action descriptions: Left, Right Unity Academy name: CartPoleAcademy Number of Brains: 1 Number of External Brains : 1 Lesson number : 0 Reset Parameters :

Unity brain name: CartPoleBrain Number of Visual Observations (per agent): 0 Vector Observation space type: continuous Vector Observation space size (per agent): 4 Number of stacked Vector Observation: 1 Vector Action space type: discrete Vector Action space size (per agent): 2 Vector Action descriptions: Left, Right 2018-09-13 11:13:43.954012: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA Successfully saved: ./models/11/model-0.cptk iteration: 0, num_episode: 5, step: 562, total_reward: 111.4, best_total_reward: 111.4 iteration: 10, num_episode: 55, step: 5932, total_reward: 64.2, best_total_reward: 316.0 iteration: 20, num_episode: 105, step: 10519, total_reward: 8.0, best_total_reward: 316.0 iteration: 30, num_episode: 155, step: 23525, total_reward: 7.4, best_total_reward: 452.2 Successfully saved: ./models/11/model-31.cptk ./models/11/test_11.bytes Traceback (most recent call last): File "python/run_hill_climbing.py", line 51, in main() File "python/run_hill_climbing.py", line 44, in main trainer.train() File "/Users/wsl/Unity_RL/python/hill_climbing/trainer.py", line 127, in train export_graph(self.model_path, self.env_name, self.run_id) File "/Users/wsl/Unity_RL/python/common/save_utils.py", line 42, in export_graph filename_tensor_name="save/Const:0") File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/tools/freeze_graph.py", line 254, in freeze_graph checkpoint_version=checkpoint_version) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/tools/freeze_graph.py", line 128, in freeze_graph_with_def_protos var_list=var_list, write_version=checkpoint_version) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 1281, in init self.build() File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 1293, in build self._build(self._filename, build_save=True, build_restore=True) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 1330, in _build build_save=build_save, build_restore=build_restore) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 756, in _build_internal saveables = self._ValidateAndSliceInputs(names_to_saveables) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 663, in _ValidateAndSliceInputs for converted_saveable_object in self.SaveableObjectsForOp(op, name): File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 637, in SaveableObjectsForOp variable, "", name) File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/training/saver.py", line 121, in init self.handle_op = var.op.inputs[0] File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow/python/framework/ops.py", line 2001, in getitem return self._inputs[i] IndexError: list index out of range

file list checkpoint model-31.cptk.data-00000-of-00001 model-0.cptk.data-00000-of-00001 model-31.cptk.index model-0.cptk.index model-31.cptk.meta model-0.cptk.meta raw_graph_def.pb

bakanaouji commented 6 years ago

Thank you for your post.

This problem seems to occur when tensorflow version is 1.9.0 or higher. https://github.com/tensorflow/tensorflow/issues/22029

I fixed the version of tensorflow in python/requirement.txt. Would you downgrade the version of tensorflow to 1.8.0 or lower and try again?