Whenever a fresh connection attempt is done, update the timestamp

[hannesm]

/cc @reynir -- but this should not have any starvation effect (indeed, the retry / connection logic should previously be more eager to attempt further connections).

[reynir]

Thanks! This looks good. I don't think this is a cause of any issues people have observed, but this is more correct.