alexander34ro / AML-Replicating-Novel-Deep-Learning-with-CNN-and-Bi-Directional-LSTM-for-Improved-Index-Prediction

Apache License 2.0
0 stars 0 forks source link

Copy the content of Pipeline section in AML_debug.ipynb to AML.ipynb and make sure it works the same #12

Closed ariansajina closed 3 years ago

amir-souri commented 3 years ago

I updated the AML.ipynb based on what we did today. I also refined it and add some helper functions to make it clean and readable. Moreover, I expanded it to three pipelines, and it works and learns. Updates to 1016788290 from 37897783314 after 500 iterations.

However, there is a warning that says, "WARNING:tensorflow:Gradients do not exist for variables ['Variable:0', 'Variable:0', 'Variable:0', 'Variable:0', 'Variable:0', 'Variable:0'] when minimizing the loss". It may be due to the vanishing gradient problem and by adding the LSTM layers it disappears!

amir-souri commented 3 years ago

The warning was due to a typo inside the feedforward helper function. fc3 = tf.reshape(Zc1_3, [-1, n_cnn_filters4]) instead of fc3 = tf.reshape(Zc3_3, [-1, n_cnn_filters4])

Thank you guys for finding it