lr_scheduler doesn't work in your code

[archersama]

ReduceLROnPlateau should monitor a parameter like val_loss to reduce lr

[moein-shariatnia]

It is monitoring that in lr_scheduler.step(valid_loss.avg).