Requests for non-existent JS

mccalluc commented 2 years ago

For example:

2022/03/22 13:27:05 [error] 14#14: *16969 open() "/app/app/static/public/vendors.6dd299e67c383cb98c2a.js" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /static/public/vendors.6dd299e67c383cb98c2a.js HTTP/1.1", host: "portal.hubmapconsortium.org", referrer: "https://portal.hubmapconsortium.org/browse/dataset/9e9ccb2dd633440df0b8ec966f28edb6"

What's going on?

NGINX/docker being flakey and not seeing static assets?
Users somehow having stale HTML which requests stale JS?
Have we every seen this in our own interactions with portal?
Would it be worth looking at bundles from previous releases to see if the referenced JS is just old?

time stamps

``` 2022/03/22 13:27:05 2022/03/22 13:27:04 2022/03/22 08:53:29 2022/03/21 11:05:31 2022/03/21 06:01:23 2022/03/21 06:01:22 2022/03/21 05:58:01 2022/03/21 05:58:00 2022/03/21 01:44:32 2022/03/20 23:38:00 2022/03/20 23:37:55 2022/03/20 19:12:14 2022/03/20 09:03:01 2022/03/20 09:03:00 2022/03/20 07:53:30 2022/03/20 06:18:18 2022/03/20 06:18:17 2022/03/20 03:57:27 2022/03/20 03:57:26 2022/03/20 01:37:31 2022/03/20 01:37:30 2022/03/19 23:55:52 2022/03/19 23:55:51 2022/03/19 23:55:50 2022/03/19 22:28:23 2022/03/19 12:16:49 2022/03/19 10:57:44 2022/03/19 08:12:26 2022/03/19 00:55:00 2022/03/19 00:54:59 2022/03/19 00:43:38 2022/03/19 00:43:37 2022/03/18 22:19:40 2022/03/18 22:19:39 2022/03/18 22:19:38 2022/03/18 22:05:49 2022/03/18 20:23:13 2022/03/18 19:23:46 2022/03/18 19:23:45 2022/03/18 19:23:44 2022/03/17 13:52:04 2022/03/16 08:33:54 ```

paths

``` /static/public/0.2ac8de34605e73c96656.js /static/public/0.64249a5f9d0fb3222603.js /static/public/1.2ac8de34605e73c96656.js /static/public/1.64249a5f9d0fb3222603.js /static/public/11.2ac8de34605e73c96656.js /static/public/14.2ac8de34605e73c96656.js /static/public/14.64249a5f9d0fb3222603.js /static/public/16.2ac8de34605e73c96656.js /static/public/2.2ac8de34605e73c96656.js /static/public/23.2ac8de34605e73c96656.js /static/public/27.2ac8de34605e73c96656.js /static/public/3.2ac8de34605e73c96656.js /static/public/39.a50b99f2f1911f368293.js /static/public/4.2ac8de34605e73c96656.js /static/public/43.2e1e7b7ba5a23b1d8dfc.js /static/public/5.2ac8de34605e73c96656.js /static/public/6.2ac8de34605e73c96656.js /static/public/7.2ac8de34605e73c96656.js /static/public/8.2ac8de34605e73c96656.js /static/public/main.2ac8de34605e73c96656.js /static/public/main.2e1e7b7ba5a23b1d8dfc.js /static/public/main.64249a5f9d0fb3222603.js /static/public/main.6dd299e67c383cb98c2a.js /static/public/main.a24e346d2d2401492ee8.js /static/public/main.d4ed359fceda1c38f875.js /static/public/vendors.2ac8de34605e73c96656.js /static/public/vendors.2e1e7b7ba5a23b1d8dfc.js /static/public/vendors.64249a5f9d0fb3222603.js /static/public/vendors.6dd299e67c383cb98c2a.js /static/public/vendors.a24e346d2d2401492ee8.js /static/public/vendors.d4ed359fceda1c38f875.js ```

mccalluc commented 2 years ago

One possibility: A bot is collecting HTML, but render (and JS fetch) happens later. Discussion.

Checking the IP:

$ whois 172.18.0.3
% IANA WHOIS server
% for more information on IANA, visit http://www.iana.org
% This query returned 1 object

inetnum:      172.16.0.0 - 172.31.255.255
organisation: IANA
status:       assigned

remarks:      http://www.iana.org/go/rfc1918

changed:      1994-03
source:       IANA

I'm not sure what the environment this runs in looks like, but this address may represent the gateway... not sure if it's possible to get more information.

mccalluc commented 2 years ago

One idea: Could we put the bundles under a directory named by the release version? If that wouldn't be hard to engineer, that would let us easily determine if this is coming from old, cached HTML.

mccalluc commented 2 years ago

New error in log, only occurs once: Maybe a client isn't constructing the url correctly?

2022-06-10 20:04:27.286,portal.hubmapconsortium.org,"2022/06/10 20:04:27 [error] 15#15: *6315 open() ""/app/app/static/public/'+ne(e)+'"" failed (2: No such file or directory), client: 172.18.0.8, server: , request: ""GET /static/public/'+ne(e)+' HTTP/1.1"", host: ""portal.hubmapconsortium.org""",ClgKHwobMTc4MDkxMDcwMzcwOnBvcnRhbC11aS1sb2dzEAISNRoYAgYqB7EtAAAAAAfMUd8ABio6N3AAAADSIAEo6ond+ZQwMJak3/mUMDgEQMcHSOAKUI4HEAIYAQ==

hubmapconsortium / portal-ui

Requests for non-existent JS #2519