The problem is that running this in every PR will run it quite often - which leads to certain target servers rate-limiting us / the github runners. This is very likely the reason why we are seeing 403 errors more often lately - for URLs which seem to work just fine otherwise.
If we just remove the linkcheck from each PR and instead run it on a schedule, for example weekly, then we should be much better off.
The problem is that running this in every PR will run it quite often - which leads to certain target servers rate-limiting us / the github runners. This is very likely the reason why we are seeing 403 errors more often lately - for URLs which seem to work just fine otherwise.
If we just remove the linkcheck from each PR and instead run it on a schedule, for example weekly, then we should be much better off.