search

JuliaLang / julia

The Julia Programming Language
https://julialang.org/
MIT License
45.46k stars 5.46k forks source link

Test failures and crashes with 0.6.0 #23115

Closed lfam closed 7 years ago

lfam commented 7 years ago

Running the test suite of Julia 0.6.0, we saw several test failures and errors. The full output of the test suite is copied below (including versioninfo()).

The libgit2 test failures seem to go away when using libgit2 0.25.1 instead of 0.26.0, but I'm not sure yet what the problem is.

Do you think these test failures could indicate real problems, or are they spurious?

Please let me know what other information I can provide.

$ env JULIA_TEST_MAXRSS_MB=10000 HOME=/tmp /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/bin/julia --check-bounds=yes --startup-file=no -e "Base.runtest
s([\"all\"], max(Sys.CPU_CORES, 8))"
Test (Worker)              | Time (s) | GC (s) | GC % | Alloc (MB) | RSS (MB)
WARNING: Method definition ambig(Any, Integer) in module Test9Main_ambiguous at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/ambiguous.jl:7 overwritten at /gnu/stor
e/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/ambiguous.jl:85.
        From worker 2:  Skipping Base.<|
        From worker 2:  Skipping Base.active_repl
        From worker 2:  Skipping Base.active_repl_backend
        From worker 2:  Skipping Base.<|
        From worker 2:  Skipping Base.active_repl
        From worker 2:  Skipping Base.active_repl_backend
ambiguous (2)              |    5.46  |  0.27  |  4.9 | 39.13      | 231.93
linalg/givens (17)         |   24.38  |  0.61  |  2.5 | 275.19     | 242.72
linalg/pinv (16)           |   35.88  |  0.97  |  2.7 | 834.22     | 346.95
linalg/special (8)         |   48.22  |  0.87  |  1.8 | 582.25     | 251.52
linalg/schur (7)           |   48.50  |  0.85  |  1.8 | 666.94     | 265.63
linalg/svd (11)            |   56.92  |  0.87  |  1.5 | 564.80     | 260.13
linalg/generic (8)         |   33.68  |  0.25  |  0.7 | 302.23     | 277.00
linalg/uniformscaling (7)  |   33.83  |  0.30  |  0.9 | 407.13     | 320.52
linalg/hessenberg (8)      |   14.55  |  0.13  |  0.9 | 176.96     | 295.94
linalg/lapack (12)         |   97.06  |  1.35  |  1.4 | 1398.99    | 285.15
linalg/conjarray (8)       |    3.80  |  0.02  |  0.4 | 34.90      | 298.19
linalg/tridiag (13)        |  107.56  |  1.65  |  1.5 | 1809.29    | 330.27
linalg/symmetric (16)      |   74.07  |  0.64  |  0.9 | 891.73     | 380.45
linalg/bunchkaufman (10)   |  117.52  |  1.09  |  0.9 | 1095.93    | 277.06
linalg/eigen (9)           |  118.15  |  1.15  |  1.0 | 1234.60    | 296.09
linalg/rowvector (7)       |   45.50  |  0.32  |  0.7 | 454.94     | 333.14
linalg/bidiag (14)         |  128.23  |  1.65  |  1.3 | 1575.76    | 346.30
sparse/spqr (14)           |   15.84  |  0.37  |  2.3 | 128.18     | 348.36
sparse/umfpack (9)         |   27.35  |  0.14  |  0.5 | 199.72     | 304.25
strings/search (9)         |    2.58  |  0.00  |  0.0 | 16.32      | 306.96
strings/util (9)           |    1.39  |  0.02  |  1.2 |  9.25      | 307.11
strings/io (9)             |    2.52  |  0.02  |  0.7 | 34.60      | 311.30
linalg/arnoldi (12)        |   55.74  |  0.57  |  1.0 | 643.48     | 338.54
unicode/UnicodeError (12)  |    0.08  |  0.00  |  0.0 |  0.29      | 338.54
strings/types (9)          |    2.64  |  0.02  |  0.6 | 19.84      | 311.50
strings/basic (14)         |   11.69  |  0.15  |  1.2 | 150.08     | 348.36
unicode/utf8 (9)           |    3.20  |  0.36  | 11.3 | 930.43     | 314.91
unicode/utf8proc (12)      |    7.45  |  0.09  |  1.2 | 47.61      | 344.36
dates/query (12)           |    1.58  |  0.00  |  0.0 | 11.12      | 344.36
dates/adjusters (9)        |    4.42  |  0.03  |  0.8 | 41.48      | 317.53
linalg/lu (17)             |  141.27  |  1.68  |  1.2 | 1682.91    | 348.21
dates/rounding (17)        |    1.54  |  0.00  |  0.0 |  8.67      | 350.30
dates/types (17)           |    2.13  |  0.02  |  1.1 | 14.14      | 350.61
dates/accessors (14)       |   13.68  |  1.44  | 10.5 | 3478.80    | 348.36
linalg/cholesky (2)        |  167.07  |  1.30  |  0.8 | 1488.05    | 309.98
dates/conversions (2)      |    1.71  |  0.00  |  0.0 | 13.06      | 310.36
dates/arithmetic (14)      |   12.62  |  0.13  |  1.0 | 121.50     | 348.36
sparse/cholmod (7)         |   56.97  |  0.88  |  1.5 | 475.48     | 360.45
WARNING: Method definition f265a(Any) in module Test58Main_worlds at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/worlds.jl:12 overwritten at /gnu/store/26g8sbh008y
b1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/worlds.jl:17.
dates/ranges (9)           |   23.12  |  0.29  |  1.3 | 424.46     | 369.61
linalg/diagonal (15)       |  186.59  |  1.87  |  1.0 | 1838.90    | 344.81
worlds (7)                 |    3.89  |  0.04  |  1.0 | 30.77      | 360.45
dates/periods (12)         |   26.69  |  0.44  |  1.7 | 202.50     | 344.36
keywordargs (9)            |    3.34  |  0.02  |  0.6 | 14.21      | 369.79
char (9)                   |    1.86  |  0.02  |  1.1 | 16.77      | 371.84
triplequote (9)            |    0.03  |  0.00  |  0.0 |  0.28      | 371.84
intrinsics (9)             |    0.51  |  0.00  |  0.0 |  3.36      | 371.88
WARNING: Method definition f() in module JLCall14301 at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:3384 overwritten at /gnu/store/26g8sbh008yb1k17cw1y660i
ynmbavp6-julia-0.6.0/share/julia/test/core.jl:3394.
linalg/qr (4)              |  198.14  |  2.69  |  1.4 | 3049.29    | 396.99
dates/io (17)              |   29.68  |  0.19  |  0.6 | 191.54     | 356.41
iobuffer (17)              |    5.10  |  0.00  |  0.0 | 15.84      | 363.13
inference (14)             |   20.85  |  0.15  |  0.7 | 135.02     | 367.69
WARNING: Method definition test(Type{Tuple{V<:Union{Tuple{Int64, Int64}, Tuple{Int32, Int32}, Tuple{UInt64, UInt64}, Tuple{UInt32, UInt32}, Tuple{Int64, Int64, Int64}, Tuple{Int32, Int32, Int3
2}, Tuple{UInt64, UInt64, UInt64}, Tuple{UInt32, UInt32, UInt32}, Tuple{Int64, Int64, Int64, Int64}, Tuple{Int32, Int32, Int32, Int32}, Tuple{UInt64, UInt64, UInt64, UInt64}, Tuple{UInt32, UIn
t32, UInt32, UInt32}}, I<:Union{Int64, Int32, UInt64, UInt32}}}) in module Test26Main_subtype at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/subtype.jl:1093 overwr
itten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/subtype.jl:1094.
subtype (7)                |   16.54  |  0.22  |  1.3 | 276.27     | 414.63
WARNING: Method definition f10178(X) in module Test21Main_staged at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/staged.jl:219 overwritten at /gnu/store/26g8sbh008y
b1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/staged.jl:224.
WARNING: Method definition g10178(Any) in module Test21Main_staged at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/staged.jl:221 overwritten at /gnu/store/26g8sbh00
8yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/staged.jl:226.
staged (17)                |    2.34  |  0.02  |  1.0 | 14.02      | 363.34
tuple (17)                 |    4.61  |  0.05  |  1.1 | 41.48      | 365.75
hashing (4)                |   13.31  |  0.11  |  0.9 | 109.34     | 404.73
reduce (17)                |   12.14  |  0.11  |  0.9 | 107.28     | 387.20
printf (12)                |   35.93  |  0.17  |  0.5 | 199.98     | 347.36
WARNING: static parameter T does not occur in signature for bad_tvars at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4526.
The method will not be callable.
linalg/lq (11)             |  171.85  |  1.71  |  1.0 | 3838.02    | 393.94
WARNING: Method definition (::Type{Test67Main_core.A16424})(Any, Any) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4729 overwri
tten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4734.
WARNING: Method definition (::Type{Test67Main_core.B16424{T}})(Any) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4749 overwritt
en at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4753.
dict (9)                   |   37.12  |  0.33  |  0.9 | 349.53     | 385.58
WARNING: Method definition (::Type{Test67Main_core.C16424{T, S}})(Any, Any) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4761 o
verwritten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4766.
WARNING: Method definition (::Type{Test67Main_core.C16424{T, S} where S where T})(T, S) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/co
re.jl:4761 overwritten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4766.
WARNING: Method definition (::Type{Test67Main_core.D16424{T<:Real, S<:T<:Real}})(Any, Any) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test
/core.jl:4776 overwritten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4781.
WARNING: Method definition (::Type{Test67Main_core.D16424{T, S} where S<:T where T<:Real})(Array{S<:T<:Real, 1}, Array{T<:Real, 1}) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y
660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4776 overwritten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4781.
WARNING: Method definition (::Type{Test67Main_core.T20999})(Array{T, N} where N where T<:Real) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/
test/core.jl:4792 overwritten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4796.
WARNING: Method definition (::Type{Test67Main_core.T20999})(Any) in module Test67Main_core at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4792 overwritten
at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/core.jl:4796.
core (2)                   |   55.65  | 10.27  | 18.5 | 5040.32    | 701.75
intfuncs (11)              |    2.51  |  0.01  |  0.4 | 15.84      | 396.78
simdloop (9)               |    3.10  |  0.02  |  0.7 | 24.53      | 385.71
linalg/matmul (6)          |  243.16  |  2.29  |  0.9 | 3340.12    | 327.48
vecelement (2)             |   14.95  |  0.09  |  0.6 | 92.95      | 701.75
copy (6)                   |    4.94  |  0.02  |  0.3 | 32.76      | 328.19
random (17)                |   26.59  |  0.47  |  1.8 | 252.94     | 400.37
reducedim (4)              |   39.34  |  0.61  |  1.5 | 372.89     | 411.52
functional (17)            |    8.03  |  0.09  |  1.1 | 72.36      | 405.96
fastmath (6)               |   11.08  |  0.06  |  0.5 | 65.69      | 336.12
path (6)                   |    3.57  |  0.02  |  0.6 | 15.42      | 350.03
operators (17)             |    7.13  |  0.07  |  1.0 | 83.60      | 413.77
parse (17)                 |    8.17  |  0.07  |  0.8 | 64.21      | 420.23
loading (17)               |    0.61  |  0.03  |  4.3 |  4.21      | 420.26
bigint (17)                |    3.89  |  0.03  |  0.8 | 35.03      | 424.68
blas (11)                  |   46.92  |  0.73  |  1.6 | 528.90     | 442.54
bigfloat (17)              |    0.49  |  0.00  |  0.0 |  3.84      | 424.70
ccall (6)                  |   16.95  |  0.08  |  0.5 | 84.85      | 359.08
        From worker 6:         [stdio passthrough ok]
math (2)                   |   44.87  |  0.94  |  2.1 | 1258.60    | 701.75
linalg/dense (5)           |  293.41  |  3.50  |  1.2 | 3789.25    | 399.24
iterators (4)              |   52.80  |  0.41  |  0.8 | 370.96     | 413.70
spawn (6)                  |   26.08  |  0.08  |  0.3 | 83.00      | 361.63
statistics (17)            |   30.06  |  0.41  |  1.4 | 310.43     | 440.69
version (6)                |    4.28  |  0.06  |  1.4 | 69.39      | 374.01
numbers (15)               |  125.32  |  1.64  |  1.3 | 1509.89    | 451.63
pollfd (6)                 |    5.10  |  0.25  |  4.9 | 13.39      | 374.07
mpfr (15)                  |    5.10  |  0.06  |  1.2 | 27.94      | 456.13
read (5)                   |   24.98  |  0.56  |  2.2 | 310.27     | 458.05
mmap (4)                   |   16.01  |  9.25  | 57.7 | 49.57      | 413.71
floatapprox (4)            |    2.45  |  0.00  |  0.0 | 19.41      | 413.71
socket (5)                 |    4.14  |  0.02  |  0.5 | 22.58      | 458.05
sparse/sparse (13)         |  223.35  | 41.85  | 18.7 | 1428.78    | 418.87
abstractarray (12)         |  105.67  |  1.23  |  1.2 | 1010.83    | 417.84
regex (13)                 |    1.07  |  0.00  |  0.0 |  6.87      | 418.87
datafmt (4)                |   10.92  |  0.12  |  1.1 | 106.64     | 413.71
float16 (12)               |    2.50  |  0.03  |  1.3 | 15.62      | 420.42
file (2)                   |   42.23  |  4.19  |  9.9 | 46.27      | 701.75
combinatorics (13)         |    2.30  |  0.03  |  1.1 | 13.56      | 418.87
sysinfo (4)                |    1.19  |  0.03  |  2.3 | 12.51      | 413.71
env (12)                   |    0.96  |  0.00  |  0.0 |  5.59      | 421.17
mod2pi (4)                 |    0.66  |  0.00  |  0.0 |  4.41      | 413.71
rounding (2)               |    1.53  |  0.00  |  0.0 |  9.78      | 701.75
euler (12)                 |    2.12  |  0.06  |  2.8 | 31.46      | 428.81
reflection (5)             |   14.52  |  0.15  |  1.0 | 135.36     | 460.11
offsetarray (14)           |  132.54  |  1.48  |  1.1 | 1192.71    | 495.83
complex (15)               |   24.04  |  0.18  |  0.7 | 137.63     | 478.52
lineedit (2)               |    7.96  |  0.08  |  1.1 | 71.74      | 701.75
replcompletions (12)       |    8.86  |  0.39  |  4.4 | 67.67      | 429.05
goto (12)                  |    0.05  |  0.00  |  0.0 |  0.27      | 429.05
llvmcall (12)              |    0.55  |  0.00  |  0.0 |  2.67      | 429.05
llvmcall2 (12)             |    0.05  |  0.00  |  0.0 |  0.24      | 429.05
resolve (17)               |   35.81  |  2.17  |  6.1 | 2439.37    | 505.95
sets (15)                  |    7.71  |  0.06  |  0.8 | 52.39      | 480.75
meta (15)                  |    1.09  |  0.03  |  3.0 |  5.76      | 484.07
grisu (12)                 |    4.20  |  0.03  |  0.7 | 32.69      | 429.05
stacktraces (15)           |    3.87  |  0.03  |  0.8 | 28.11      | 486.47
sparse/sparsevector (16)   |  244.96  |  1.90  |  0.8 | 1664.31    | 472.65
profile (12)               |    8.29  |  0.09  |  1.0 | 56.50      | 431.62
base64 (14)                |    0.55  |  0.00  |  0.0 |  2.31      | 507.70
repl (5)                   |   24.61  |  0.23  |  0.9 | 208.87     | 473.89
docs (16)                  |    9.98  |  0.17  |  1.7 | 139.99     | 472.65
Warning: threaded loop executed in order
markdown (12)              |   10.36  |  0.12  |  1.1 | 80.27      | 433.44
show (4)                   |   34.92  |  0.32  |  0.9 | 271.51     | 432.83
serialize (14)             |   10.80  |  0.15  |  1.4 | 93.93      | 510.01
i18n (14)                  |    0.03  |  0.00  |  0.0 |  0.07      | 510.01
sorting (11)               |   94.39  |  0.53  |  0.6 | 532.89     | 444.80
broadcast (6)              |   58.12  |  0.50  |  0.9 | 606.16     | 374.07
test (2)                   |   27.62  |  0.15  |  0.5 | 108.01     | 701.75
libdl (11)                 |    1.03  |  0.00  |  0.0 |  4.39      | 447.24
threads (16)               |   11.60  |  0.34  |  2.9 | 93.34      | 477.59
workspace (14)             |    5.96  |  0.00  |  0.0 | 10.76      | 510.04
intset (11)                |    6.26  |  0.03  |  0.5 | 28.90      | 447.27
int (6)                    |    8.55  |  0.05  |  0.6 | 44.28      | 379.12
error (6)                  |    1.95  |  0.03  |  1.3 |  7.78      | 381.36
cartesian (6)              |    0.01  |  0.00  |  0.0 |  0.05      | 381.36
asmvariant (6)             |    0.04  |  0.00  |  0.0 |  0.10      | 381.36
osutils (6)                |    0.04  |  0.00  |  0.0 |  0.25      | 381.36
inline (14)                |    6.28  |  0.00  |  0.0 |  4.95      | 510.46
enums (12)                 |   15.18  |  0.23  |  1.5 | 166.51     | 443.57
WARNING: Method definition f(Tuple{Vararg{Int64, N}}, AbstractArray{T, N}) in module Test58Main_specificity at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/specific
ity.jl:87 overwritten at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/specificity.jl:93.
iostream (14)              |    0.53  |  0.04  |  7.2 |  3.02      | 510.46
specificity (12)           |    0.17  |  0.00  |  0.0 |  0.88      | 443.68
checked (2)                |   11.92  |  0.12  |  1.0 | 54.56      | 701.75
floatfuncs (16)            |   11.41  |  0.15  |  1.3 | 128.50     | 489.27
boundscheck (11)           |   13.66  |  0.00  |  0.0 |  2.52      | 447.27
arrayops (7)               |  190.08  |  2.75  |  1.4 | 1811.71    | 572.80
nullable (17)              |   51.88  |  0.48  |  0.9 | 390.88     | 522.82
channels (6)               |   15.42  |  1.61  | 10.4 | 455.07     | 558.50
dsp (12)                   |   17.14  |  0.44  |  2.6 | 314.56     | 461.06
WARNING: readuntil(IO,AbstractString) will perform poorly with a long string
misc (5)                   |   44.25  |  2.06  |  4.7 | 1418.72    | 543.63
WARNING: readuntil(IO,AbstractString) will perform poorly with a long string
WARNING: readuntil(IO,AbstractString) will perform poorly with a long string
examples (2)               |   26.56  |  0.69  |  2.6 | 628.06     | 701.75
fft (14)                   |   32.36  |  0.88  |  2.7 | 565.71     | 536.65
bitarray (9)               |  185.25  |  2.60  |  1.4 | 2752.79    | 487.18
sparse/higherorderfns (10) |  300.80  |  2.71  |  0.9 | 3549.06    | 425.82
ranges (13)                |   99.47  |  4.51  |  4.5 | 7130.23    | 453.54
subarray (8)               |  410.52  |  9.36  |  2.3 | 5678.40    | 710.36
linalg/triangular (3)      |  531.20  | 13.73  |  2.6 | 9086.70    | 706.64
        From worker 1:  compile: Test Failed
  Expression: (Base.Test.ismatch_warn)("ERROR: LoadError: Declaring __precompile__(false) is not allowed in files that are being precompiled.\nStacktrace:\n [1] __precompile__", (Base.Test.rea
dstring)(#107#fname))
Stacktrace:
 [1] macro expansion at ./test.jl:433 [inlined]
 [2] (::Test26Main_compile.##1#13)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/compile.jl:256
compile: Test Failed
  Expression: (Base.Test.ismatch_warn)("ERROR: LoadError: break me\nStacktrace:\n [1] error", (Base.Test.readstring)(#167#fname))
Stacktrace:
 [1] macro expansion at ./test.jl:433 [inlined]
 [2] (::Test26Main_compile.##1#13)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/compile.jl:335
compile: Error During Test
  Got an exception of type LoadError outside of a @test
  LoadError: open: permission denied (EACCES)
  Stacktrace:
   [1] uv_error at ./libuv.jl:68 [inlined]
   [2] open(::String, ::UInt16, ::UInt16) at ./filesystem.jl:81
   [3] touch(::String) at ./file.jl:248
   [4] (::Test26Main_compile.##1#13)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/compile.jl:532
   [5] withenv(::Test26Main_compile.##1#13, ::Pair{String,Void}, ::Vararg{Pair{String,Void},N} where N) at ./env.jl:157
   [6] macro expansion at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/testdefs.jl:18 [inlined]
   [7] macro expansion at ./test.jl:860 [inlined]
   [8] macro expansion at ./util.jl:378 [inlined]
   [9] macro expansion at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/testdefs.jl:17 [inlined]
   [10] anonymous at ./<missing>:?
   [11] runtests(::String, ::Bool) at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/testdefs.jl:21
   [12] (::##45#51)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:103
   [13] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:103
   [14] cd(::##40#46, ::String) at ./file.jl:70
  while loading /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/compile.jl, in expression starting on line 17
        From worker 1:  Worker 2 failed running test backtrace:
Some tests did not pass: 20 passed, 1 failed, 0 errored, 1 broken.backtrace: Test Failed
  Expression: have_backtrace
Stacktrace:
 [1] record(::Base.Test.DefaultTestSet, ::Base.Test.Fail) at ./test.jl:568
 [2] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:160
 [3] cd(::##40#46, ::String) at ./file.jl:70
Worker 14 failed running test replutil:
Some tests did not pass: 166 passed, 1 failed, 0 errored, 0 broken.replutil: Test Failed
  Expression: contains(err_str, "Cannot raise an integer x to a negative power -n")
Stacktrace:
 [1] record(::Base.Test.DefaultTestSet, ::Base.Test.Fail) at ./test.jl:568
 [2] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:160
 [3] cd(::##40#46, ::String) at ./file.jl:70
Worker 15 failed running test libgit2:
Some tests did not pass: 391 passed, 2 failed, 0 errored, 0 broken.libgit2: Test Failed
  Expression: startswith(sprint(show, e), "GitError(Code:ENOTFOUND, Class:OS, Failed to resolve path")
Stacktrace:
 [1] record(::Base.Test.DefaultTestSet, ::Base.Test.Fail) at ./test.jl:568
 [2] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:160
 [3] cd(::##40#46, ::String) at ./file.jl:70
libgit2: Test Failed
  Expression: err.msg == "Invalid Content-Type: text/plain"
   Evaluated: "invalid Content-Type: text/plain" == "Invalid Content-Type: text/plain"
Stacktrace:
 [1] record(::Base.Test.DefaultTestSet, ::Base.Test.Fail) at ./test.jl:568
 [2] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:160
 [3] cd(::##40#46, ::String) at ./file.jl:70
Worker 4 failed running test cmdlineargs:
Some tests did not pass: 133 passed, 2 failed, 2 errored, 0 broken.cmdlineargs: Test Failed
  Expression: contains(bt, "include_from_node1")
Stacktrace:
 [1] record(::Base.Test.DefaultTestSet, ::Base.Test.Fail) at ./test.jl:568
 [2] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:160
 [3] cd(::##40#46, ::String) at ./file.jl:70
cmdlineargs: Test Failed
  Expression: contains(bt, "include_from_node1(::String) at $(joinpath(".", "loading.jl"))")
Stacktrace:
 [1] record(::Base.Test.DefaultTestSet, ::Base.Test.Fail) at ./test.jl:568
 [2] (::##40#46)() at /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl:160
 [3] cd(::##40#46, ::String) at ./file.jl:70
cmdlineargs: Error During Test
  Test threw an exception of type ErrorException
  Expression: length(lno.captures) == 1
  type Void has no field captures
cmdlineargs: Error During Test
  Test threw an exception of type ErrorException
  Expression: parse(Int, lno.captures[1]) > 0
  type Void has no field captures
compile: Error During Test
  Test threw an exception of type Base.Test.TestSetException
  Expression: compile
  Some tests did not pass: 84 passed, 2 failed, 1 errored, 0 broken.

Test Summary:           |     Pass  Fail  Error   Broken     Total
  Overall               | 21627577     6      3  1311352  22938938
    ambiguous           |       51                              51
    linalg/givens       |     1552                            1552
    linalg/pinv         |      232                             232
    linalg/special      |      942                             942
    linalg/schur        |      300                             300
    linalg/svd          |      244                             244
    linalg/generic      |      206                             206
    linalg/uniformscaling |      247                             247
    linalg/hessenberg   |       40                              40
    linalg/lapack       |      628                             628
    linalg/conjarray    |       10                              10
    linalg/tridiag      |      843                             843
    linalg/symmetric    |     1386                            1386
    linalg/bunchkaufman |     2519                            2519
    linalg/eigen        |      381                             381
    linalg/rowvector    |      135                             135
    linalg/bidiag       |     1592                            1592
    sparse/spqr         |       53                              53
    sparse/umfpack      |      137                             137
    strings/search      |      549                             549
    strings/util        |      341                             341
    strings/io          |    12536                           12536
    linalg/arnoldi      |       76                              76
    unicode/UnicodeError |        1                               1
    strings/types       |     8905                            8905
    strings/basic       |    26976                           26976
    unicode/utf8        |  1048595                         1048595
    unicode/utf8proc    |      765                             765
    dates/query         |      988                             988
    dates/adjusters     |     3147                            3147
    linalg/lu           |     1149                            1149
    dates/rounding      |      157                             157
    dates/types         |      167                             167
    dates/accessors     |  7723858                         7723858
    linalg/cholesky     |     2104                            2104
    dates/conversions   |      159                             159
    dates/arithmetic    |      312                             312
    sparse/cholmod      |      359                             359
    dates/ranges        |   348530                          348530
    linalg/diagonal     |     1140                            1140
    worlds              |       61                              61
    dates/periods       |      316                             316
    keywordargs         |      109                             109
    char                |     1707                            1707
    triplequote         |       28                              28
    intrinsics          |       29                              29
    linalg/qr           |     3054                            3054
    dates/io            |      241                             241
    iobuffer            |      135                             135
    inference           |      167                             167
    subtype             |   337157                    15    337172
    staged              |       48                              48
    tuple               |      382                             382
    hashing             |    14453                           14453
    reduce              |      235                             235
    printf              |      596                             596
    linalg/lq           |     1360                            1360
    dict                |   134165                          134165
    core                |    35531                           35531
    intfuncs            |     4137                            4137
    simdloop            |      207                             207
    linalg/matmul       |      527                             527
    vecelement          |      533                             533
    copy                |      312                             312
    random              |   200711                          200711
    reducedim           |      461                             461
    functional          |       61                              61
    fastmath            |      790                             790
    path                |      208                    12       220
    operators           |       59                              59
    parse               |     1094                            1094
    loading             |       23                              23
    bigint              |     2391                            2391
    blas                |      486                             486
    bigfloat            |       24                              24
    ccall               |     3852                            3852
    math                |   551275                          551275
    backtrace           |       20     1               1        22
    linalg/dense        |     6324                            6324
    iterators           |      916                             916
    spawn               |      107                     4       111
    statistics          |      357                             357
    version             |   124465                          124465
    numbers             |  1477170                         1477170
    pollfd              |      344                             344
    mpfr                |      702                             702
    read                |     2071                            2071
    mmap                |      131                             131
    floatapprox         |       49                              49
    socket              |       77                              77
    sparse/sparse       |     1518                            1518
    abstractarray       |     2465                            2465
    regex               |       34                              34
    datafmt             |       83                              83
    float16             |      124                             124
    file                |      804                             804
    combinatorics       |       44                              44
    sysinfo             |        2                               2
    env                 |       61                              61
    mod2pi              |        9                               9
    rounding            |      327                             327
    euler               |       12                              12
    reflection          |      275                             275
    offsetarray         |      726                             726
    complex             |     1094                            1094
    lineedit            |      175                             175
    replcompletions     |      268                     2       270
    goto                |       13                              13
    llvmcall            |       13                              13
    llvmcall2           |        6                               6
    resolve             |     2648                            2648
    sets                |      216                             216
    meta                |       36                              36
    grisu               |      683                             683
    stacktraces         |       42                              42
    sparse/sparsevector |     8163                            8163
    profile             |        7                               7
    replutil            |      166     1                       167
    base64              |        9                               9
    repl                |      113                             113
    docs                |      193                             193
    markdown            |      210                             210
    show                |      146                             146
    serialize           |       90                              90
    i18n                |        2                               2
    sorting             |     4864                            4864
    broadcast           |      306                             306
    test                |      201                    14       215
    libdl               |      198                             198
    threads             |   190563                          190563
    workspace           |        1                               1
    intset              |      148                             148
    int                 |    10138                           10138
    error               |       28                              28
    cartesian           |        2                               2
    asmvariant          |        3                               3
    osutils             |       21                              21
    inline              |       23                              23
    enums               |       79                              79
    iostream            |       21                              21
    specificity         |      100                             100
    checked             |     1211                            1211
    floatfuncs          |      122                             122
    boundscheck         |                                 No tests
    arrayops            |     1556                            1556
    nullable            |    98030                           98030
    channels            |      187                             187
    dsp                 |      365                             365
    misc                |  1279536                         1279536
    examples            |       22                              22
    fft                 |     2026                            2026
    bitarray            |   892433                          892433
    sparse/higherorderfns |     6377                   584      6961
    libgit2             |      391     2                       393
    ranges              |  6981911               1310720   8292631
    subarray            |      200                             200
    cmdlineargs         |      133     2      2                137
    linalg/triangular   |    33634                           33634
    compile             |                     1                  1
    distributed         |                                 No tests
    FAILURE
Error in testset backtrace:
Test Failed
  Expression: have_backtrace
Error in testset replutil:
Test Failed
  Expression: contains(err_str, "Cannot raise an integer x to a negative power -n")
Error in testset libgit2:
Test Failed
  Expression: startswith(sprint(show, e), "GitError(Code:ENOTFOUND, Class:OS, Failed to resolve path")
Error in testset libgit2:
Test Failed
  Expression: err.msg == "Invalid Content-Type: text/plain"
   Evaluated: "invalid Content-Type: text/plain" == "Invalid Content-Type: text/plain"
Error in testset cmdlineargs:
Test Failed
  Expression: contains(bt, "include_from_node1")
Error in testset cmdlineargs:
Test Failed
  Expression: contains(bt, "include_from_node1(::String) at $(joinpath(".", "loading.jl"))")
Error in testset cmdlineargs:
Error During Test
  Test threw an exception of type ErrorException
  Expression: length(lno.captures) == 1
  type Void has no field captures
Error in testset cmdlineargs:
Error During Test
  Test threw an exception of type ErrorException
  Expression: parse(Int, lno.captures[1]) > 0
  type Void has no field captures
Error in testset compile:
Error During Test
  Test threw an exception of type Base.Test.TestSetException
  Expression: compile
  Some tests did not pass: 84 passed, 2 failed, 1 errored, 0 broken.
ERROR: LoadError: Test run finished with errors
while loading /gnu/store/26g8sbh008yb1k17cw1y660iynmbavp6-julia-0.6.0/share/julia/test/runtests.jl, in expression starting on line 29
ERROR: A test has failed. Please submit a bug report (https://github.com/JuliaLang/julia/issues)
including error messages above and the output of versioninfo():
Julia Version 0.6.0
Commit 903644385b* (2017-06-19 13:05 UTC)
Platform Info:
  OS: Linux (x86_64-unknown-linux-gnu)
  CPU: Intel(R) Xeon(R) CPU @ 2.50GHz
  WORD_SIZE: 64
  BLAS: libopenblas (NO_LAPACK NO_LAPACKE DYNAMIC_ARCH NO_AFFINITY Sandybridge)
  LAPACK: liblapack
  LIBM: libopenlibm
  LLVM: libLLVM-3.8.1 (ORCJIT, ivybridge)

Stacktrace:
 [1] runtests(::Array{String,1}, ::Int64) at ./interactiveutil.jl:670
vtjnash commented 7 years ago

libgit2

It looks like they changed some of their error handling, which impacts the tests. It's usually best to stick with whichever version is bundled with Julia.

backtrace, cmdlineargs, replutil

these seem generally consistent with having a buggy libunwind installed, or missing debug info (don't run strip)

compile

looks like a bug in the test (we assume pwd() can be used as scratch space, but it should be using tmpdir())

lfam commented 7 years ago

these seem generally consistent with having a buggy libunwind installed, or missing debug info (don't run strip)

We are using libunwind-1.1-julia2, with a matching SHA512 sum to the one found in deps/checksums/libunwind-1.1-julia2.tar.gz/sha512. The libunwind binaries are not stripped.

vtjnash commented 7 years ago

You can strip libunwind, just don't strip anything related to Julia.

lfam commented 7 years ago

We aren't stripping any of the Julia binaries either.

lfam commented 7 years ago

I was mistaken. Julia's debug symbols are not stripped, but libunwind's are. I know you said it shouldn't matter but I'm going to try not stripping them anyways.

lfam commented 7 years ago

Should I file another bug for the failures in backtrace, cmdlineargs, and replutil? I don't think we came to a resolution regarding those tests.

tkelman commented 7 years ago

Can you provide reproduction steps?

lfam commented 7 years ago

I can provide two different methods of reproducing the issues, based on Guix. Either option is more involved for you than I'd like, but I'm not sure of a better way to debug issues that could involve Julia's dependency graph.

If you think that these test failures are just a consequence of stripping debug symbols from parts of the Julia dependency graph, then we'll just fix that on our end. Does Julia need non-stripped dependencies to run correctly? Or just for the test suite?

So, I can offer a 'Guix pack', which is like an app bundle. It would consist of the bit-for-bit identical run-time dependency graph of our Julia build.

Or, I can give instructions on building Julia from the relevant Guix Git revision, plus our patches.

vtjnash commented 7 years ago

The primary files that must not be stripped are located at usr/lib/julia/sys*.so. However, it is acceptable to replace the debug info with a .gnu_debuglink section indicating a separate file with split debug info. It is also preferable to make the dwarf sections available for usr/lib/libjulia*.so, as this will improve the results of the included backtrace and profile libraries, but it's less essential.