Open mattgodbolt opened 5 years ago
Quick investigation:
ubuntu@ip-172-30-2-129:~$ telnet localhost 80
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
GET /robots.txt HTTP/1.1
Host: foo.bar.baz.godbolt.org
HTTP/1.1 200 OK
Server: nginx/1.15.9
Date: Sun, 10 Mar 2019 03:58:32 GMT
Transfer-Encoding: chunked
Connection: keep-alive
X-Powered-By: Express
Cache-Control: public, max-age=30, must-revalidate
40
User-agent: *
Sitemap: https://godbolt.org/sitemap.xml
Disallow:
0
looks like from the nodes themselves, getting these requests are OK. I wonder whether it's an authentication thing https cloudfront <-> ALB (which has the same issues the browser has with browser<->cloudfront.
Hitting https://sx-baidu.cn.godbolt.org/robots.txt (and ignoring the security errors about the cert being invalid) :