Open bwbroersma opened 2 days ago
UA='Mozilla/5.0 (compatible; HumanWithCurl/0.1; +https://github.com/internetstandards/Internet.nl/issues/1451)'; curl -sSfA "$UA" 'https://internet.nl/halloffame/hosters/' \ | xmllint --html --xmlout - 2>/dev/null \ | xmlstarlet sel -t -m '/html/body/main/div/article/div/ul/li/a' -c 'string(@href)' -n \ | xargs -n1 curl -sSfA "$UA" -m10 -o /dev/null -w '%{url} %{http_code} %{redirect_url}\n' \ | awk '$2 != 200 && substr($3, 0, length($1)) != $1{print}'
https://prolocation.nl 301 https://www.prolocation.net/ https://nederhost.nl 301 http://www.nederhost.nl/ https://vimexx.nl 301 https://www.vimexx.nl/ https://www.vevida.com 301 https://www.yourhosting.nl/?red_url=www.vevida.com/ https://bhosted.nl 301 https://www.bhosted.nl/ https://bit.nl 301 https://www.bit.nl/ curl: (28) Connection timed out after 10000 milliseconds https://cloudwebservices.nl 000
Proposal for HoF hosters update:
Proposal for HoF hosters update: