I updated the AML.ipynb based on what we did today. I also refined it and add some helper functions to make it clean and readable. Moreover, I expanded it to three pipelines, and it works and learns. Updates to 1016788290 from 37897783314 after 500 iterations.
However, there is a warning that says, "WARNING:tensorflow:Gradients do not exist for variables ['Variable:0', 'Variable:0', 'Variable:0', 'Variable:0', 'Variable:0', 'Variable:0'] when minimizing the loss".
It may be due to the vanishing gradient problem and by adding the LSTM layers it disappears!
The warning was due to a typo inside the feedforward helper function.
fc3 = tf.reshape(Zc1_3, [-1, n_cnn_filters4])
instead of
fc3 = tf.reshape(Zc3_3, [-1, n_cnn_filters4])
I updated the AML.ipynb based on what we did today. I also refined it and add some helper functions to make it clean and readable. Moreover, I expanded it to three pipelines, and it works and learns. Updates to 1016788290 from 37897783314 after 500 iterations.
However, there is a warning that says, "WARNING:tensorflow:Gradients do not exist for variables ['Variable:0', 'Variable:0', 'Variable:0', 'Variable:0', 'Variable:0', 'Variable:0'] when minimizing the loss". It may be due to the vanishing gradient problem and by adding the LSTM layers it disappears!