search

VirtuBox / nginx-ee

Automated Nginx compilation with HTTP/3 and additional modules support. Compatible with WordOps, EasyEngine & Plesk
https://virtubox.github.io/nginx-ee/
MIT License
199 stars 58 forks source link

cron.daily nginx-ee started failing #106

Closed ampersand-et closed 3 years ago

ampersand-et commented 3 years ago

The cron.daily started failing in the last week or so. Didn't have time to get to it until today.

No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.2 LTS
Release:    20.04
Codename:   focal
nginx version: nginx/1.19.6 (VirtuBox Nginx-ee)
built by gcc 9.3.0 (Ubuntu 9.3.0-17ubuntu1~20.04) 
built with OpenSSL 1.1.1i  8 Dec 2020
TLS SNI support enabled
configure arguments: --add-module=../naxsi/naxsi_src --with-cc-opt='-m64 -march=native -mtune=native -DTCP_FASTOPEN=23 -g -O3 -fstack-protector-strong -flto -ffat-lto-objects -fuse-ld=gold --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wimplicit-fallthrough=0 -fcode-hoisting -Wp,-D_FORTIFY_SOURCE=2 -gsplit-dwarf' --with-ld-opt='-lrt -ljemalloc -Wl,-z,relro -Wl,-z,now -fPIC -flto -ffat-lto-objects' --prefix=/usr/share --conf-path=/etc/nginx/nginx.conf --http-log-path=/var/log/nginx/access.log --error-log-path=/var/log/nginx/error.log --lock-path=/var/lock/nginx.lock --pid-path=/var/run/nginx.pid --http-client-body-temp-path=/var/lib/nginx/body --http-fastcgi-temp-path=/var/lib/nginx/fastcgi --http-proxy-temp-path=/var/lib/nginx/proxy --http-scgi-temp-path=/var/lib/nginx/scgi --http-uwsgi-temp-path=/var/lib/nginx/uwsgi --modules-path=/usr/share/nginx/modules --build='VirtuBox Nginx-ee' --with-file-aio --with-threads --with-http_v2_hpack_enc --with-http_v2_module --with-http_ssl_module --with-pcre-jit --with-http_stub_status_module --with-http_realip_module --with-http_auth_request_module --with-http_addition_module --with-http_gzip_static_module --with-http_gunzip_module --with-http_mp4_module --with-http_sub_module --add-module=../ngx_http_substitutions_filter_module --add-module=../srcache-nginx-module --add-module=../ngx_http_redis --add-module=../redis2-nginx-module --add-module=../memc-nginx-module --add-module=../ngx_devel_kit --add-module=../set-misc-nginx-module --add-module=../ngx_http_auth_pam_module --add-module=../nginx-module-vts --add-module=../ipscrubtmp/ipscrub --add-module=../incubator-pagespeed-ngx-latest-stable --add-module=../echo-nginx-module --add-module=../headers-more-nginx-module --add-module=../ngx_cache_purge --add-module=../ngx_brotli --with-zlib=../zlib-cf --with-openssl-opt='enable-ec_nistp_64_gcc_128 enable-tls1_3 no-ssl3-method -march=native -ljemalloc' --sbin-path=/usr/sbin/nginx

nginx-ee.log

Warning: apt-key output should not be parsed (stdout is not a terminal)
OK
Reading package lists...
Building dependency tree...
Reading state information...
autoconf is already the newest version (2.69-11.1).
automake is already the newest version (1:1.16.1-4ubuntu6).
autotools-dev is already the newest version (20180224.1).
dpkg-dev is already the newest version (1.19.7ubuntu3).
git is already the newest version (1:2.25.1-1ubuntu3).
gnupg is already the newest version (2.2.19-3ubuntu2).
libbsd-dev is already the newest version (0.10.0-1).
libbz2-1.0 is already the newest version (1.0.8-2).
libbz2-dev is already the newest version (1.0.8-2).
libgmp-dev is already the newest version (2:6.2.0+dfsg-4).
libgoogle-perftools-dev is already the newest version (2.7-1ubuntu2).
libreadline-dev is already the newest version (8.0-4).
libtool is already the newest version (2.4.6-14).
gnupg2 is already the newest version (2.2.19-3ubuntu2).
libbz2-ocaml is already the newest version (0.6.0-10build1).
libbz2-ocaml-dev is already the newest version (0.6.0-10build1).
libgeoip-dev is already the newest version (1.6.12-6build1).
libjemalloc-dev is already the newest version (5.2.1-1ubuntu1).
build-essential is already the newest version (12.8ubuntu1.1).
libbrotli-dev is already the newest version (1.0.7-6ubuntu0.1).
libpam0g-dev is already the newest version (1.3.1-5ubuntu4.1).
libperl-dev is already the newest version (5.30.0-9ubuntu0.2).
perl is already the newest version (5.30.0-9ubuntu0.2).
software-properties-common is already the newest version (0.98.9.3).
tar is already the newest version (1.30+dfsg-7ubuntu0.20.04.1).
uuid-dev is already the newest version (2.34-0.1ubuntu9.1).
libssl-dev is already the newest version (1.1.1i-1+ubuntu20.04.1+deb.sury.org+4).
libgd-dev is already the newest version (2.3.0-2+ubuntu20.04.1+deb.sury.org+1).
libpcre3-dev is already the newest version (2:8.44-2+ubuntu20.04.1+deb.sury.org+1).
libxml2-dev is already the newest version (2.9.10+dfsg-5+ubuntu20.04.1+deb.sury.org+3).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
### downloading additionals modules ###
Cloning into '/usr/local/src/ngx_http_redis'...
Already up to date.
Already up to date.
Already up to date.
Already up to date.
Already up to date.
Already up to date.
Already up to date.
Already up to date.
Already up to date.
From https://github.com/masonicboom/ipscrub
 * branch            master     -> FETCH_HEAD
Already up to date.
Already up to date.
Already up to date.
### additionals modules downloaded ###
### git pull zlib-cf ###
fatal: not a git repository (or any of the parent directories): .git
### cloning zlib-cf ###
fatal: destination path '/usr/local/src/zlib-cf' already exists and is not an empty directory.
### make distclean ###
rm -f *.o *.lo *~ \
   example minigzip examplesh minigzipsh \
   example64 minigzip64 \
   infcover \
   libz.* foo.gz so_locations \
   _match.s maketree contrib/infback9/*.o
rm -rf objs
rm -f *.gcda *.gcno *.gcov
rm -f contrib/infback9/*.gcda contrib/infback9/*.gcno contrib/infback9/*.gcov
cp -p zconf.h.in zconf.h
rm -f Makefile zlib.pc configure.log
### configure zlib-cf ###
Checking for gcc...
Checking for shared library support...
Building shared library libz.so.1.2.8 with gcc.
Checking for off64_t... Yes.
Checking for fseeko... Yes.
Checking for strerror... Yes.
Checking for unistd.h... Yes.
Checking for stdarg.h... Yes.
Checking whether to use vs[n]printf() or s[n]printf()... using vs[n]printf().
Checking for vsnprintf() in stdio.h... Yes.
Checking for return value of vsnprintf()... Yes.
Checking for attribute(visibility) support... Yes.
Checking for CRC and SSE4.2 support ... Yes
Checking for PCLMUL support ... Yes
--2021-02-05 06:52:55--  https://raw.githubusercontent.com/pagespeed/ngx_pagespeed/master/scripts/build_ngx_pagespeed.sh
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.124.133
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.124.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 27171 (27K) [text/plain]
Saving to: ‘build_ngx_pagespeed.sh’

     0K .......... .......... ......                          100% 51.2M=0.001s

2021-02-05 06:52:55 (51.2 MB/s) - ‘build_ngx_pagespeed.sh’ saved [27171/27171]

Detected debian-based distro.
Operating system dependencies are all set.
Downloading ngx_pagespeed...
--2021-02-05 06:52:55--  https://github.com/apache/incubator-pagespeed-ngx/archive/latest-stable.zip
Resolving github.com (github.com)... 140.82.114.3
Connecting to github.com (github.com)|140.82.114.3|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://codeload.github.com/apache/incubator-pagespeed-ngx/zip/latest-stable [following]
--2021-02-05 06:52:55--  https://codeload.github.com/apache/incubator-pagespeed-ngx/zip/latest-stable
Resolving codeload.github.com (codeload.github.com)... 140.82.114.9
Connecting to codeload.github.com (codeload.github.com)|140.82.114.9|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [application/zip]
Saving to: ‘/tmp/tmp.xKI8Ox3VuI/ngx_pagespeed-latest-stable.zip’

     0K .......... .......... .......... .......... .......... 1.50M
    50K .......... .......... .......... .......... .......... 3.08M
   100K .......... .......... .......... .......... .........  54.2M=0.05s

2021-02-05 06:52:55 (2.97 MB/s) - ‘/tmp/tmp.xKI8Ox3VuI/ngx_pagespeed-latest-stable.zip’ saved [153203]

Extracting ngx_pagespeed...
Downloading PSOL binary...
--2021-02-05 06:52:55--  https://dl.google.com/dl/page-speed/psol/1.13.35.2-x64.tar.gz
Resolving dl.google.com (dl.google.com)... 2607:f8b0:400b:809::200e, 172.217.1.174
Connecting to dl.google.com (dl.google.com)|2607:f8b0:400b:809::200e|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 18740791 (18M) [application/x-tar]
Saving to: ‘1.13.35.2-x64.tar.gz’

     0K .......... .......... .......... .......... ..........  0% 1.62M 11s
#----removed download progress---#
 18300K .                                                     100% 2963G=1.0s

2021-02-05 06:52:57 (17.9 MB/s) - ‘1.13.35.2-x64.tar.gz’ saved [18740791/18740791]

Extracting PSOL...

ngx_pagespeed is ready to be built against nginx.
When running ./configure:
  Give ./configure the following arguments:
    --add-module=/usr/local/src/incubator-pagespeed-ngx-latest-stable

If this is for integration with an already-built nginx, make sure
to include any other arguments you originally passed to
./configure.  You can see these with 'nginx -V'.

gzip: stdin: unexpected end of file
/bin/tar: Child returned status 1
/bin/tar: Error is not recoverable: exiting now
mv: cannot stat '/usr/local/src/nginx-': No such file or directory
ampersand-et commented 3 years ago

I think the error might of been self inflicted unless someone fixed something in the last day or two.

I was having a number of unwanted random bots coming from Amazon AWS that seemed to be scraping files daily and if individually banned them a new AWS ip would appear doing the same thing so I just blacklisted AWS EC2 from the webserver thinking I was fine as I didn't use anything related to AWS. After a couple days I figured out I took out part of Lets encrypt's renewal process as it comes from AWS servers.

Anyways, I removed the ban and figured another way to stop the bad bots which fixed Lets Encrypt and coincidentally nginx-ee cron has also stopped chirping at me at its next scheduled run.

Cheers