internetstandards / Internet.nl

Internet standards compliance test suite
https://internet.nl
164 stars 36 forks source link

Update HoF hosters #1451

Open bwbroersma opened 2 days ago

bwbroersma commented 2 days ago
UA='Mozilla/5.0 (compatible; HumanWithCurl/0.1; +https://github.com/internetstandards/Internet.nl/issues/1451)';
curl -sSfA "$UA" 'https://internet.nl/halloffame/hosters/' \
| xmllint --html --xmlout - 2>/dev/null \
| xmlstarlet sel -t -m '/html/body/main/div/article/div/ul/li/a' -c 'string(@href)' -n \
| xargs -n1 curl -sSfA "$UA" -m10 -o /dev/null -w '%{url} %{http_code} %{redirect_url}\n' \
| awk '$2 != 200 && substr($3, 0, length($1)) != $1{print}'
https://prolocation.nl 301 https://www.prolocation.net/
https://nederhost.nl 301 http://www.nederhost.nl/
https://vimexx.nl 301 https://www.vimexx.nl/
https://www.vevida.com 301 https://www.yourhosting.nl/?red_url=www.vevida.com/
https://bhosted.nl 301 https://www.bhosted.nl/
https://bit.nl 301 https://www.bit.nl/
curl: (28) Connection timed out after 10000 milliseconds
https://cloudwebservices.nl 000 

Proposal for HoF hosters update: