A 403 response means the server understands the request but refuses to fulfill it.
The link works fine with a browser, so the maintainers of Toptal likely are blocking any user agents that are not web browsers.
Ie. this command returns 403
wget https://www.toptal.com/robotics/introduction-to-robot-operating-system
and this command returns 200
wget --user-agent="Chrome/58.0.3029.110" https://www.toptal.com/robotics/introduction-to-robot-o perating-system
We're not going to spoof user agents, especially not just to check if a link is live. Therefore I suggest we treat links that get 403 responses as live.
Description
The
docs.ymlworkflow is failing because the following link returns a403 Forbiddenrepsonse when the link checker requests the website.https://www.toptal.com/robotics/introduction-to-robot-operating-system
A 403 response means the server understands the request but refuses to fulfill it. The link works fine with a browser, so the maintainers of Toptal likely are blocking any user agents that are not web browsers.
Ie. this command returns 403
wget https://www.toptal.com/robotics/introduction-to-robot-operating-systemand this command returns 200wget --user-agent="Chrome/58.0.3029.110" https://www.toptal.com/robotics/introduction-to-robot-o perating-systemWe're not going to spoof user agents, especially not just to check if a link is live. Therefore I suggest we treat links that get 403 responses as live.
Verification