Closed WenmuZhou closed 7 years ago
solivr
commented
7 years ago This error means the characters in your dataset are not in the Alphabet you use for training. In train.py change the Params initialisation from alphabet=Alphabet.LETTERS_EXTENDED to alphabet=Alphabet.DIGITS_ONLY, since you are trying to predict digits only.
WenmuZhou
commented
7 years ago thank you, I have do as what you said, however, there are a other error meet:
2017-10-16 15:58:02.246092: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.268062: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.269625: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.280289: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.280635: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.282343: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.322491: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.322800: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.322828: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.324898: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.325334: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446616: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446787: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446808: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446828: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446817: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446797: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.446955: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447040: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447075: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447081: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447112: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447145: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447134: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447228: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447180: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447179: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447330: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447285: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447334: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447278: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447186: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447280: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447283: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447194: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447337: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447492: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447279: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.447611: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.448845: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.449556: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.449789: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.450228: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.487013: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.487400: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.487464: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.487549: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.490027: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.501678: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.501847: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.501847: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.501849: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.502332: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.502333: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.502343: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.505142: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.509276: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.509302: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.509477: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.511169: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.520897: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.690360: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.697146: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.743673: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.765662: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.774970: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.783451: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.791520: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819496: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819584: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819633: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819641: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819761: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819767: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819809: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819945: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.820029: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.819992: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.820112: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.820212: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.820234: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.820325: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.820404: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.823365: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.823604: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.823763: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.823814: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.824375: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.825137: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.826381: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.827524: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.827879: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.828516: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] 2017-10-16 15:58:02.830745: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]]
Traceback (most recent call last):
File "train.py", line 88, in
│ └ <tensorflow.python.client.session.Session object at 0x7f78f140a518>
└ <tensorflow.python.training.saver.Saver object at 0x7f78f1dd2f28>File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/saver.py", line 1560, in restore {self.saver_def.filename_tensor_name: save_path}) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 895, in run run_metadata_ptr) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1124, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1321, in _do_run options, run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1340, in _do_call raise type(e)(node_def, op, message) │ │ └ 'Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60]\n\t [[Node: save/Assign_9 = Assign[T=D... │ └ <tf.Operation 'save/Assign_9' type=Assign> └ name: "save/Assign_9" op: "Assign" input: "deep_bidirectional_lstm/fully_connected/weights/Adam" input: "save/RestoreV2_9" attr ... tensorflow.python.framework.errors_impl.InvalidArgumentError: Assign requires shapes of both tensors to match. lhs shape= [512,11] rhs shape= [512,60] [[Node: save/Assign_9 = Assign[T=DT_FLOAT, _class=["loc:@deep_bidirectional_lstm/fully_connected/weights"], use_locking=true, validate_shape=true, _device="/job:localhost/replica:0/task:0/gpu:0"](deep_bidirectional_lstm/fully_connected/weights/Adam, save/RestoreV2_9/_7)]] [[Node: save/RestoreV2_96/_138 = _SendT=DT_FLOAT, client_terminated=false, recv_device="/job:localhost/replica:0/task:0/gpu:0", send_device="/job:localhost/replica:0/task:0/cpu:0", send_device_incarnation=1, tensor_name="edge_346_save/RestoreV2_96", _device="/job:localhost/replica:0/task:0/cpu:0"]]
Caused by op 'save/Assign_9', defined at:
File "train.py", line 88, in
solivr
commented
7 years ago I'll have a look at it, I may have an idea where it comes from. In the meantime, could you please paste the content of the json file (should be in your_exported_dir/model_params.json) ?
solivr
commented
7 years ago Try first to remove the old export_dir. It looks like tensorflow tried to reload the previous model, and you got this error since the new Alphabet is shorter than the previous one (hence the shape error).
WenmuZhou
commented
7 years ago this is the model_params:
{"csv_delimiter": " ", "output_model_dir": "./models", "learning_rate": 0.001, "eval_batch_size": 128, "_blank_label_symbol": "$", "alphabet": "0123456789$", "input_shape": [32, 100], "csv_files_train": "./data/train.csv", "_alphabet_codes": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10], "alphabet_decoding": "0123456789$", "blank_label_code": 10, "evaluate_every_epoch": 5, "train_batch_size": 128, "optimizer": "adam", "gpu": "3", "learning_decay_steps": 5000, "n_epochs": 30, "_alphabet_decoding_codes": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10], "_nclasses": 11, "_keep_prob_dropout": null, "learning_decay_rate": 0.95, "csv_files_eval": "./data/val.csv", "save_interval": 5000.0 }
solivr
commented
7 years ago The Alphabet looks fine, so try to remove ./models (or the files related to this experiment within ./models) and run the script again.
WenmuZhou
commented
7 years ago the script is running correct， but ,there are not some information about accuracy and loss shown
solivr
commented
7 years ago You should be able to see it in tensorboard, also with the intermediate predictions in the TEXT tab.
solivr
commented
7 years ago Pull the last update and you'll see the loss, CER and accuracy (https://github.com/solivr/tf-crnn/commit/ca60e9f790f12cf04df08ebcf23856fd3d68bf71).
solivr
commented
7 years ago I'm closing this issue for now, feel free to reopen it if you still encounter problems.
when I run this code in the ubuntu16.04 with tensorflow 1.3, I meet the flow error, the dataset I used is mnist. Traceback (most recent call last): File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1327, in _do_call return fn(*args) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1306, in _run_fn status, run_metadata) File "/usr/lib/python3.5/contextlib.py", line 66, in exit next(self.gen) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/errors_impl.py", line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) tensorflow.python.framework.errors_impl.OutOfRangeError: RandomShuffleQueue '_3_prepared_batch_queue/random_shuffle_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: prepared_batch_queue = QueueDequeueManyV2[component_types=[DT_STRING, DT_FLOAT, DT_INT32, DT_STRING], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](prepared_batch_queue/random_shuffle_queue, prepared_batch_queue/n)]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 686, in _trainmodel , loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss]) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 518, in run run_metadata=run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 862, in run run_metadata=run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 818, in run return self._sess.run(*args, *kwargs) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 972, in run run_metadata=run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 818, in run return self._sess.run(args, **kwargs) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 895, in run run_metadata_ptr) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1124, in _run feed_dict_tensor, options, run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1321, in _do_run options, run_metadata) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1340, in _do_call raise type(e)(node_def, op, message) tensorflow.python.framework.errors_impl.OutOfRangeError: RandomShuffleQueue '_3_prepared_batch_queue/random_shuffle_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: prepared_batch_queue = QueueDequeueManyV2[component_types=[DT_STRING, DT_FLOAT, DT_INT32, DT_STRING], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](prepared_batch_queue/random_shuffle_queue, prepared_batch_queue/n)]]
Caused by op 'prepared_batch_queue', defined at: File "train.py", line 97, in
image_summaries=True))
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 241, in train
loss = self._train_model(input_fn=input_fn, hooks=hooks)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 628, in _train_model
input_fn, model_fn_lib.ModeKeys.TRAIN)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 499, in _get_features_and_labels_from_input_fn
result = self._call_input_fn(input_fn, mode)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 585, in _call_input_fn
return input_fn(**kwargs)
File "/data1/zj/tf-crnn/src/data_handler.py", line 37, in input_fn
name='prepared_batch_queue')
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/input.py", line 1220, in shuffle_batch
name=name)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/input.py", line 791, in _shuffle_batch
dequeued = queue.dequeue_many(batch_size, name=name)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/data_flow_ops.py", line 457, in dequeue_many
self._queue_ref, n=n, component_types=self._dtypes, name=name)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/gen_data_flow_ops.py", line 1342, in _queue_dequeue_many_v2
timeout_ms=timeout_ms, name=name)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py", line 767, in apply_op
op_def=op_def)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 2630, in create_op
original_op=self._default_original_op, op_def=op_def)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 1204, in init
self._traceback = self._graph._extract_stack() # pylint: disable=protected-access
OutOfRangeError (see above for traceback): RandomShuffleQueue '_3_prepared_batch_queue/random_shuffle_queue' is closed and has insufficient elements (requested 128, current size 0) [[Node: prepared_batch_queue = QueueDequeueManyV2[component_types=[DT_STRING, DT_FLOAT, DT_INT32, DT_STRING], timeout_ms=-1, _device="/job:localhost/replica:0/task:0/cpu:0"](prepared_batch_queue/random_shuffle_queue, prepared_batch_queue/n)]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "train.py", line 97, in
image_summaries=True))
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 241, in train
loss = self._train_model(input_fn=input_fn, hooks=hooks)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 686, in _trainmodel
, loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss])
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 534, in exit
self._close_internal(exception_type)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 569, in _close_internal
self._sess.close()
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 811, in close
self._sess.close()
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 908, in close
ignore_live_threads=True)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/coordinator.py", line 389, in join
six.reraise(*self._exc_info_to_raise)
File "/usr/lib/python3/dist-packages/six.py", line 686, in reraise
raise value
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/queue_runner_impl.py", line 238, in _run
enqueue_callable()
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1235, in _single_operation_run
target_list_as_strings, status, None)
File "/usr/lib/python3.5/contextlib.py", line 66, in exit
next(self.gen)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/errors_impl.py", line 466, in raise_exception_on_not_ok_status
pywrap_tensorflow.TF_GetCode(status))
tensorflow.python.framework.errors_impl.InvalidArgumentError: Expect 2 fields but have 1 in record 0
[[Node: csv_reading_op = DecodeCSV[OUT_TYPE=[DT_STRING, DT_STRING], field_delim=";", use_quote_delim=true, _device="/job:localhost/replica:0/task:0/cpu:0"](file_reading_op:1, csv_reading_op/record_defaults_0, csv_reading_op/record_defaults_1)]]
and when I change the csv_delimiter in train.py from ';' to ' ' , the error become that:
Invalid argument: All labels must be nonnegative integers, batch: 0 labels: -1,-1,-1,-1,-1,-1,-1 2017-10-16 15:02:48.615988: W tensorflow/core/framework/op_kernel.cc:1192] Invalid argument: All labels must be nonnegative integers, batch: 0 labels: -1,-1,-1,-1,-1,-1,-1 [[Node: CTCLoss = CTCLoss[ctc_merge_repeated=true, ignore_longer_outputs_than_inputs=true, preprocess_collapse_repeated=false, _device="/job:localhost/replica:0/task:0/cpu:0"](deep_bidirectional_lstm/transpose_time_major/_713, str2code_conversion/StringSplit, str2code_conversion/hash_table_Lookup, Cast_3/_791)]] Traceback (most recent call last): File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1327, in _do_call return fn(*args) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1306, in _run_fn status, run_metadata) File "/usr/lib/python3.5/contextlib.py", line 66, in exit next(self.gen) File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/errors_impl.py", line 466, in raise_exception_on_not_ok_status pywrap_tensorflow.TF_GetCode(status)) tensorflow.python.framework.errors_impl.InvalidArgumentError: All labels must be nonnegative integers, batch: 0 labels: -1,-1,-1,-1,-1,-1,-1 [[Node: CTCLoss = CTCLoss[ctc_merge_repeated=true, ignore_longer_outputs_than_inputs=true, preprocess_collapse_repeated=false, _device="/job:localhost/replica:0/task:0/cpu:0"](deep_bidirectional_lstm/transpose_time_major/_713, str2code_conversion/StringSplit, str2code_conversion/hash_table_Lookup, Cast_3/_791)]] [[Node: code2str_conversion/chars_conversion/Shape/_733 = _HostRecv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/gpu:0", send_device="/job:localhost/replica:0/task:0/cpu:0", send_device_incarnation=1, tensor_name="edge_1842_code2str_conversion/chars_conversion/Shape", tensor_type=DT_INT32, _device="/job:localhost/replica:0/task:0/gpu:0"]()]]
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "train.py", line 97, in
image_summaries=True))
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 241, in train
loss = self._train_model(input_fn=input_fn, hooks=hooks)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 686, in _trainmodel
, loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss])
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 518, in run
run_metadata=run_metadata)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 862, in run
run_metadata=run_metadata)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 818, in run
return self._sess.run(*args, *kwargs)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 972, in run
run_metadata=run_metadata)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/training/monitored_session.py", line 818, in run
return self._sess.run(args, **kwargs)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 895, in run
run_metadata_ptr)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1124, in _run
feed_dict_tensor, options, run_metadata)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1321, in _do_run
options, run_metadata)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 1340, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: All labels must be nonnegative integers, batch: 0 labels: -1,-1,-1,-1,-1,-1,-1
[[Node: CTCLoss = CTCLoss[ctc_merge_repeated=true, ignore_longer_outputs_than_inputs=true, preprocess_collapse_repeated=false, _device="/job:localhost/replica:0/task:0/cpu:0"](deep_bidirectional_lstm/transpose_time_major/_713, str2code_conversion/StringSplit, str2code_conversion/hash_table_Lookup, Cast_3/_791)]]
[[Node: code2str_conversion/chars_conversion/Shape/_733 = _HostRecv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/gpu:0", send_device="/job:localhost/replica:0/task:0/cpu:0", send_device_incarnation=1, tensor_name="edge_1842_code2str_conversion/chars_conversion/Shape", tensor_type=DT_INT32, _device="/job:localhost/replica:0/task:0/gpu:0"]()]]
Caused by op 'CTCLoss', defined at: File "train.py", line 97, in
image_summaries=True))
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 241, in train
loss = self._train_model(input_fn=input_fn, hooks=hooks)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 630, in _train_model
model_fn_lib.ModeKeys.TRAIN)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/estimator/estimator.py", line 615, in _call_model_fn
model_fn_results = self._model_fn(features=features, **kwargs)
File "/data1/zj/tf-crnn/src/model.py", line 272, in crnn_fn
time_major=True)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/ctc_ops.py", line 152, in ctc_loss
ignore_longer_outputs_than_inputs=ignore_longer_outputs_than_inputs)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/ops/gen_ctc_ops.py", line 168, in _ctc_loss
name=name)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/op_def_library.py", line 767, in apply_op
op_def=op_def)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 2630, in create_op
original_op=self._default_original_op, op_def=op_def)
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/ops.py", line 1204, in init
self._traceback = self._graph._extract_stack() # pylint: disable=protected-access
InvalidArgumentError (see above for traceback): All labels must be nonnegative integers, batch: 0 labels: -1,-1,-1,-1,-1,-1,-1 [[Node: CTCLoss = CTCLoss[ctc_merge_repeated=true, ignore_longer_outputs_than_inputs=true, preprocess_collapse_repeated=false, _device="/job:localhost/replica:0/task:0/cpu:0"](deep_bidirectional_lstm/transpose_time_major/_713, str2code_conversion/StringSplit, str2code_conversion/hash_table_Lookup, Cast_3/_791)]] [[Node: code2str_conversion/chars_conversion/Shape/_733 = _HostRecv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/gpu:0", send_device="/job:localhost/replica:0/task:0/cpu:0", send_device_incarnation=1, tensor_name="edge_1842_code2str_conversion/chars_conversion/Shape", tensor_type=DT_INT32, _device="/job:localhost/replica:0/task:0/gpu:0"]()]]