rockdaboot / mget

Multithreaded metalink/file/website downloader (like Wget) and C library
GNU Lesser General Public License v3.0
114 stars 19 forks source link

Failing tests #28

Closed hypriot closed 9 years ago

hypriot commented 9 years ago

Hi,

with Ubuntu 14.04 I installed the prerequisites as follows:

apt-get install autoconf autogen automake libtool gtk-doc-tools xsltproc gettext zlib1g-dev liblzma-dev libbz2-dev libgnutls-dev libidn2-0-dev flex libssl-dev

The I did ./autogen.sh, ./configure, make, make check.

Make check did run successful except for test:

PASS: test
PASS: test-mget-1
PASS: test-restrict-ascii
PASS: test-i-http
FAIL: test-i-https
PASS: test-np
PASS: test--spider-r
PASS: test-meta-robots
PASS: test-idn-robots
PASS: test-idn-meta
PASS: test-idn-cmd
PASS: test-iri
PASS: test-iri-percent
PASS: test-iri-list
PASS: test-iri-forced-remote
PASS: test-auth-basic
PASS: test-parse-html
PASS: test-parse-rss
PASS: test--page-requisites
PASS: test--accept
PASS: test-k
make[4]: Entering directory `/tmp/mget/tests'
make[4]: Nothing to be done for `all'.
make[4]: Leaving directory `/tmp/mget/tests'
============================================================================
Testsuite summary for mget 0.1.8
============================================================================
# TOTAL: 21
# PASS:  20
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0
============================================================================
See tests/test-suite.log
Please report to mget-bugs@googlegroups.com
============================================================================
make[3]: *** [test-suite.log] Error 1
make[3]: Leaving directory `/tmp/mget/tests'
make[2]: *** [check-TESTS] Error 2
make[2]: Leaving directory `/tmp/mget/tests'
make[1]: *** [check-am] Error 2
make[1]: Leaving directory `/tmp/mget/tests'
make: *** [check-recursive] Error 1

As the test only fails for https I think I might have installed a wrong prerequisite... what do you think?

hypriot commented 9 years ago

Well - missed that there is another project - "git clone http://github.com/rockdaboot/libpsl" - that gives me the libpsl lib... as I couldn't find it in the repos of my distribution and it was recommending libssl-dev instead I thought that was the way to go...

hypriot commented 9 years ago

Well - after compiling and installing the libpsl library without a problem - I not only have one but many errors. :(

Summary of ./configure:

configure: Summary of build options:

  Version:           0.1.8
  Host OS:           linux-gnu
  Install prefix:    /usr/local
  Compiler:          gcc -std=gnu99 -std=gnu99
  CFlags:            -g -std=gnu99 -pedantic -fPIC -Wall -Wstrict-prototypes -Wold-style-definition -Wmissing-prototypes -Wwrite-strings -Wformat=2 -Wformat -Wformat-security -Wsign-compare -Wextra -D_FORTIFY_SOURCE=2 -Wcast-align -O2
  LDFlags:           -fPIE -pie -Wl,--as-needed -ffunction-sections
  Libs:              -lidn2 -lbz2 -llzma -lz -lpsl -lgnutls -lpthread
  SSL support:       yes
  GZIP compression:  yes
  BZIP2 compression: yes
  LZMA compression:  yes
  IDNA support:      IDNA 2008 (libidn2)
  PSL support:       yes
  Tests:             Valgrind testing not enabled

Test results:

make  check-TESTS
make[2]: Entering directory `/tmp/mget/tests'
make[3]: Entering directory `/tmp/mget/tests'
FAIL: test
FAIL: test-mget-1
FAIL: test-restrict-ascii
FAIL: test-i-http
FAIL: test-i-https
FAIL: test-np
FAIL: test--spider-r
FAIL: test-meta-robots
FAIL: test-idn-robots
FAIL: test-idn-meta
FAIL: test-idn-cmd
FAIL: test-iri
FAIL: test-iri-percent
FAIL: test-iri-list
FAIL: test-iri-forced-remote
FAIL: test-auth-basic
FAIL: test-parse-html
FAIL: test-parse-rss
FAIL: test--page-requisites
FAIL: test--accept
FAIL: test-k
make[4]: Entering directory `/tmp/mget/tests'
make[4]: Nothing to be done for `all'.
make[4]: Leaving directory `/tmp/mget/tests'
============================================================================
Testsuite summary for mget 0.1.8
============================================================================
# TOTAL: 21
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  21
# XPASS: 0
# ERROR: 0
============================================================================
See tests/test-suite.log
Please report to mget-bugs@googlegroups.com
============================================================================
make[3]: *** [test-suite.log] Error 1
make[3]: Leaving directory `/tmp/mget/tests'
make[2]: *** [check-TESTS] Error 2
make[2]: Leaving directory `/tmp/mget/tests'
make[1]: *** [check-am] Error 2
make[1]: Leaving directory `/tmp/mget/tests'
make: *** [check-recursive] Error 1

What is the problem here?

hypriot commented 9 years ago

Allright - my bad. Forgot to do a ldconfig.

But still I am back where I started. The HTTPS test still fails.

hypriot commented 9 years ago

My test-suite.log looks like this:

agrant@rpi-image-builder:/tmp/mget$ cat tests/test-suite.log
======================================
   mget 0.1.8: tests/test-suite.log
======================================

# TOTAL: 21
# PASS:  20
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: test-i-https
==================

resolving localhost:0...
has 127.0.0.1:0
try to listen on 127.0.0.1:0...
insecure listen on 127.0.0.1:36204...
try to listen on 127.0.0.1:0...
secure listen on 127.0.0.1:56087...
  Testing ' ../../src/mget --ca-certificate=.././certs/x509-ca.pem -i urls.txt 2>&1'
Failed to open ~/.mgetrc
GnuTLS server init
GnuTLS server init done
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
ERROR: The certificate is not trusted.
ERROR: The certificate has expired.
GnuTLS: Error in the certificate.
Server handshake failed (-9)
GnuTLS Server: A TLS packet with unexpected length was received.
Failed to get connection (104)
head_first=0 deferred=0 iri=https://localhost:56087/page1.html
[0] Downloading 'https://localhost:56087/page1.html' ...
head_first=0 deferred=0 iri=https://localhost:56087/page2.html
[1] Downloading 'https://localhost:56087/page2.html' ...
[0] Failed to download
[1] Failed to download
Missing expected file .test_14476/page1.html [--ca-certificate=.././certs/x509-ca.pem -i urls.txt]
rockdaboot commented 9 years ago

I am sorry for the inconvenience. ERROR: The certificate has expired. I saw it yesterday evening... my test certificate is outdated :-( I'll create a new one tomorrow (no time right now)... until than, please try to ignore the test failure (it shows that the cert testing works ;-)

rockdaboot commented 9 years ago

I just pushed new certs to branch 'develop'. I guess I have to make a new release... it's a while since the last one. Feel free to ask questions on the mailing list or directly open an isssue on github.

hypriot commented 9 years ago

Thanks for replying so fast.