LSTM based sequential model seems to fit data really well on first epoch, but validation accuracy doesn't improve after first epoch and even loss halts improving after second epoch. I tried different optimizer paramters like lr, l2, etc., but it doesn't improve beyond certain point.
LSTM based sequential model seems to fit data really well on first epoch, but validation accuracy doesn't improve after first epoch and even loss halts improving after second epoch. I tried different optimizer paramters like lr, l2, etc., but it doesn't improve beyond certain point.
@maciejkula Any idea how can improve that?