I am using the architecture on a different dataset for a research project and I noticed that there is sometimes a dense region in my final predictions after 60 epochs. The points in the dense region are mainly coming from the low level prediction (Y_primary).
Q1: Is it an expected behavior that occur when training the model?
Q2: Does it disappear with more epochs?
I saw that you change the alpha weights during the training by augmenting them.
Q3: Did you try by starting with higher weights and decrease them over time?
Q4: Can this last suggestion solve the problem mentioned above?
Hi, thank you for sharing your work.
I am using the architecture on a different dataset for a research project and I noticed that there is sometimes a dense region in my final predictions after 60 epochs. The points in the dense region are mainly coming from the low level prediction (Y_primary). Q1: Is it an expected behavior that occur when training the model? Q2: Does it disappear with more epochs?
I saw that you change the alpha weights during the training by augmenting them. Q3: Did you try by starting with higher weights and decrease them over time? Q4: Can this last suggestion solve the problem mentioned above?
Example or the problem:
Thanks in advance.