When train.accumulation_steps > 1 it causes the first accumulation_steps steps to try to log the same thing as self.global_step is still 0.
[2021-10-27 08:35:47,478][neptune.new.internal.operation_processors.async_operation_processor][ERROR] - Error occurred during asynchronous operation processing: X-coordinates (step) must be strictly increasing for series attribute: train/acc. Invalid point: 0.0
When
train.accumulation_steps> 1 it causes the firstaccumulation_stepssteps to try to log the same thing asself.global_stepis still 0.