search

ukwa / ukwa-services

Deployment configuration for all UKWA services stacks.
Apache License 2.0
4 stars 5 forks source link

Update webrenderer to 2.3.2 #82

Closed anjackson closed 2 years ago

anjackson commented 2 years ago

Update the access-time webrenderer to 2.2.x, and set RUN_BEHAVIOURS=false, to speed up rendering of cards etc.

anjackson commented 2 years ago

Weird. Failed with...

access_website_webrender.1.v7i59ta8bi9c@dev2    | Navigating to http://www.bl.uk/...
access_website_webrender.1.v7i59ta8bi9c@dev2    | http://www.bl.uk/ - Rendering web page as PNG...
access_website_webrender.1.v7i59ta8bi9c@dev2    | We got an error, but lets continue and render what we get.
access_website_webrender.1.v7i59ta8bi9c@dev2    |  TimeoutError: Navigation timeout of 60000 ms exceeded
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at /app/node_modules/puppeteer/lib/cjs/puppeteer/common/LifecycleWatcher.js:106:111
access_website_webrender.1.v7i59ta8bi9c@dev2    | http://www.bl.uk/ - Rendering screenshot as JPEG...
access_website_webrender.1.v7i59ta8bi9c@dev2    | http://www.bl.uk/ - Rendering PDF...
access_website_webrender.1.v7i59ta8bi9c@dev2    | Attempting to POST data for har:http://www.bl.uk/ with warcPrefix null
access_website_webrender.1.v7i59ta8bi9c@dev2    | Error: Got status code 307 when POSTing record for har:http://www.bl.uk/!
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at ClientRequest.<anonymous> (/app/warcPoster.js:65:29)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at Object.onceWrapper (node:events:646:26)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at ClientRequest.emit (node:events:526:28)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at HTTPParser.parserOnIncomingClient (node:_http_client:618:27)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at HTTPParser.parserOnHeadersComplete (node:_http_common:128:17)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at Socket.socketOnData (node:_http_client:482:22)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at Socket.emit (node:events:526:28)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at addChunk (node:internal/streams/readable:315:12)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at readableAddChunk (node:internal/streams/readable:289:9)
access_website_webrender.1.v7i59ta8bi9c@dev2    |     at Socket.Readable.push (node:internal/streams/readable:228:10
anjackson commented 2 years ago

Okay, that was down to WARCPROX = false being mis-interpreted as true! Now runs, but no timestamp is being passed in.

anjackson commented 2 years ago

Added target_date support, now seems to run well and is significantly faster.

anjackson commented 2 years ago

Now tagging and building 2.3.0 with target_date support.

anjackson commented 2 years ago

Okay, also worked on updating dependencies, so now at 2.3.2. Looks like the annoying proxy-settings bug was fixed.

anjackson commented 2 years ago

Okay, deployed on dev and that is WAY faster. ~10 seconds than >30 seconds.

anjackson commented 2 years ago

This can be included in the next website access stack deployment.