Closed vtjnash closed 3 years ago
SummationByPartsOperators: bisect says #39980. It looks like it's exposing some bad cases in codegen around union types, causing us to try to load the type tag of a null pointer. To see the function in question:
using SummationByPartsOperators
code_llvm(SummationByPartsOperators.var"#periodic_derivative_coefficients#15", (Type{Float32}, Val{:serial}, Int, typeof(SummationByPartsOperators.periodic_derivative_coefficients), SummationByPartsOperators.Holoborodko2008, Int, Int))
Documenter is now hanging (https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-05/27/Documenter.1.7.0-DEV-ed5cc4ec67.log)
SPICE is still failing: https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-05/27/SPICE.1.7.0-DEV-3159a81977.log
And also seeing a GC corruption issue with OpenQuantumBase. Possibly similar? https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-05/27/OpenQuantumBase.1.7.0-DEV-ed5cc4ec67.log
(SummationByPartsOperators is fixed)
As anticipated, there is many packages that failed from statistical errors last night (https://github.com/JuliaCI/NanosoldierReports/blob/master/pkgeval/by_date/2021-06/03/report.md). @JeffBezanson could you help look into some of these others:
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/SplittablesBase.1.7.0-DEV-9f32653992.log split off to https://github.com/JuliaLang/julia/issues/41157
julia: /workspace/srcdir/src/intrinsics.cpp:287: llvm::Value* emit_unboxed_coercion(jl_codectx_t&, llvm::Type*, llvm::Value*): Assertion `to->isIntOrPtrTy() || to->isFloatingPointTy()' failed.
signal (6): Aborted
in expression starting at /home/pkgeval/.julia/packages/SplittablesBase/AEQKX/test/test_halve.jl:83
gsignal at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
abort at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
unknown function (ip: 0x7fee0a7a240e)
__assert_fail at /lib/x86_64-linux-gnu/libc.so.6 (unknown line)
emit_unboxed_coercion at /workspace/srcdir/src/intrinsics.cpp:287
emit_unbox at /workspace/srcdir/src/intrinsics.cpp:353
typed_store at /workspace/srcdir/src/cgutils.cpp:1495
emit_builtin_call at /workspace/srcdir/src/codegen.cpp:2984
emit_call at /workspace/srcdir/src/codegen.cpp:3691
emit_expr at /workspace/srcdir/src/codegen.cpp:4508
emit_ssaval_assign at /workspace/srcdir/src/codegen.cpp:4159
emit_stmtpos at /workspace/srcdir/src/codegen.cpp:4401 [inlined]
emit_function at /workspace/srcdir/src/codegen.cpp:7186
jl_emit_code at /workspace/srcdir/src/codegen.cpp:7559
jl_emit_codeinst at /workspace/srcdir/src/codegen.cpp:7604
jl_compile_workqueue at /workspace/srcdir/src/codegen.cpp:7706
_jl_compile_codeinst at /workspace/srcdir/src/jitlayers.cpp:127
jl_generate_fptr at /workspace/srcdir/src/jitlayers.cpp:350
jl_compile_method_internal at /workspace/srcdir/src/gf.c:1977
jl_compile_method_internal at /workspace/srcdir/src/gf.c:2243 [inlined]
_jl_invoke at /workspace/srcdir/src/gf.c:2236 [inlined]
jl_invoke at /workspace/srcdir/src/gf.c:2251
recursive_vcat at /home/pkgeval/.julia/packages/SplittablesBase/AEQKX/src/testing.jl:79
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/XUnit.1.7.0-DEV-9f32653992.log (causing many others)
RROR: LoadError: type TaskLocalRNG has no field seed
PR: https://github.com/RelationalAI-oss/XUnit.jl/pull/13
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/ADCME.1.7.0-DEV-9f32653992.log StackOverflow in subtyping
random booleans: Test Failed at /home/pkgeval/.julia/packages/DynamicHMC/lYo0t/test/test-NUTS.jl:53
Expression: rand(RNG′) == rand(RNG)
Evaluated: 0.39075600772334507 == 0.39075600772334496
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/Faker.1.7.0-DEV-9f32653992.log (fixed in https://github.com/neomatrixcode/Faker.jl/pull/22)
Faker: Error During Test at /home/pkgeval/.julia/packages/Faker/F3W9Y/test/runtests.jl:4
Got exception outside of a @test
LoadError: MethodError: Cannot `convert` an object of type Random.TaskLocalRNG to an object of type Random.MersenneTwister
Closest candidates are:
convert(::Type{T}, !Matched::T) where T at essentials.jl:218
Random.MersenneTwister(::Any) at /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/RNGs.jl:143
Random.MersenneTwister(::Any, !Matched::Any, !Matched::Any, !Matched::Any, !Matched::Any, !Matched::Any, !Matched::Any, !Matched::Any, !Matched::Any, !Matched::Any) at /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/RNGs.jl:90
Stacktrace:
[1] seed(seed::Int64)
@ Faker ~/.julia/packages/Faker/F3W9Y/src/base.jl:5
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/Ferrite.1.7.0-DEV-9f32653992.log incorrect usage of Random.seed (https://github.com/Ferrite-FEM/Ferrite.jl/issues/351)
Grid, DofHandler, vtk: Test Failed at /home/pkgeval/.julia/packages/Ferrite/y7a78/test/test_grid_dofhandler_vtk.jl:86
Expression: chomp(readline(csio)) == sha
Evaluated: "ecd41621c0ac245869fd86e0286f6932270e657e" == "ffc30e94099ee7b4107b67702e80ae050430b6b9"
Stacktrace:
[1] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:445 [inlined]
[2] macro expansion
@ ~/.julia/packages/Ferrite/y7a78/test/test_grid_dofhandler_vtk.jl:86 [inlined]
[3] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[4] top-level scope
@ ~/.julia/packages/Ferrite/y7a78/test/test_grid_dofhandler_vtk.jl:12
~~https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/FileTrees.1.7.0-DEV-9f32653992.log GC-related badness and segfaulting?~~ access to internal state through a corrupt ccall (https://github.com/JuliaData/MemPool.jl/issues/52)
~~https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/LoopVectorization.1.7.0-DEV-9f32653992.log https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/NaNStatistics.1.7.0-DEV-9f32653992.log https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/Octavian.1.7.0-DEV-9f32653992.log https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/StatGeochem.1.7.0-DEV-9f32653992.log https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/Gaius.1.7.0-DEV-9f32653992.log~~ AFAICT, these were fixed in LoopVectorization
TypeError: in getfield, expected Symbol, got a value of type Int64
Stacktrace:
[1] macro expansion
@ ~/.julia/packages/LoopVectorization/LuCqO/src/condense_loopset.jl:363 [inlined]
[2] gespf1
@ ~/.julia/packages/LoopVectorization/LuCqO/src/condense_loopset.jl:349 [inlined]
[3] gemm_kernel!(u::LinearAlgebra.Adjoint{Float64, Vector{Float64}}, v::LinearAlgebra.Adjoint{Float64, Vector{Float64}}, A::Matrix{Float64})
@ Gaius ~/.julia/packages/Gaius/E4lVX/src/kernels.jl:88
[4] _mul!
@ ~/.julia/packages/Gaius/E4lVX/src/matmul.jl:64 [inlined]
[5] mul!(C::LinearAlgebra.Adjoint{Float64, Vector{Float64}}, A::LinearAlgebra.Adjoint{Float64, Vector{Float64}}, B::Matrix{Float64}; block_size::Nothing, sizecheck::Bool)
@ Gaius ~/.julia/packages/Gaius/E4lVX/src/public_mul.jl:83
[6] mul!(C::LinearAlgebra.Adjoint{Float64, Vector{Float64}}, A::LinearAlgebra.Adjoint{Float64, Vector{Float64}}, B::Matrix{Float64})
@ Gaius ~/.julia/packages/Gaius/E4lVX/src/public_mul.jl:79
[7] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:445 [inlined]
[8] macro expansion
@ ~/.julia/packages/Gaius/E4lVX/test/_public_mul.jl:101 [inlined]
[9] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[10] macro expansion
@ ~/.julia/packages/Gaius/E4lVX/test/_public_mul.jl:95 [inlined]
[11] top-level scope
@ ./timing.jl:210
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/Infinity.1.7.0-DEV-9f32653992.log filed as https://github.com/cjdoris/Infinity.jl/issues/32
Expression: rand(Infinite) == ∞
Evaluated: -∞ == ∞
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/InterpolatedPDFs.1.7.0-DEV-9f32653992.log filed at https://github.com/m-wells/InterpolatedPDFs.jl/issues/7
Vector knots: Error During Test at /home/pkgeval/.julia/packages/InterpolatedPDFs/YIKGP/test/runtests.jl:42
Test threw exception
Expression: quantile(d, 1) == last(x)
BoundsError: attempt to access 5-element extrapolate(interpolate((::Vector{Float64},), ::Vector{Float64}, Gridded(Interpolations.Linear())), Throw()) with element type Float64 at index [1]
Stacktrace:
[1] throw_boundserror(A::Interpolations.Extrapolation{Float64, 1, Interpolations.GriddedInterpolation{Float64, 1, Float64, Interpolations.Gridded{Interpolations.Linear}, Tuple{Vector{Float64}}}, Interpolations.Gridded{Interpolations.Linear}, Interpolations.Throw{Nothing}}, I::Tuple{Int64})
@ Base ./abstractarray.jl:694
[2] inbounds_index
@ ~/.julia/packages/Interpolations/TBuvH/src/extrapolation/extrapolation.jl:109 [inlined]
[3] inbounds_position
@ ~/.julia/packages/Interpolations/TBuvH/src/extrapolation/extrapolation.jl:100 [inlined]
[4] Extrapolation
@ ~/.julia/packages/Interpolations/TBuvH/src/extrapolation/extrapolation.jl:48 [inlined]
[5] quantile(d::LinearInterpolatedPDF{Interpolations.Extrapolation{Float64, 1, Interpolations.GriddedInterpolation{Float64, 1, Float64, Interpolations.Gridded{Interpolations.Linear}, Tuple{Vector{Float64}}}, Interpolations.Gridded{Interpolations.Linear}, Interpolations.Throw{Nothing}}, Interpolations.Extrapolation{Float64, 1, Interpolations.GriddedInterpolation{Float64, 1, Float64, Interpolations.Gridded{Interpolations.Linear}, Tuple{Vector{Float64}}}, Interpolations.Gridded{Interpolations.Linear}, Interpolations.Throw{Nothing}}, Interpolations.Extrapolation{Float64, 1, Interpolations.GriddedInterpolation{Float64, 1, Float64, Interpolations.Gridded{Interpolations.Linear}, Tuple{Vector{Float64}}}, Interpolations.Gridded{Interpolations.Linear}, Interpolations.Throw{Nothing}}}, x::Int64)
@ InterpolatedPDFs ~/.julia/packages/InterpolatedPDFs/YIKGP/src/linear_1d.jl:67
[6] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:445 [inlined]
[7] macro expansion
@ ~/.julia/packages/InterpolatedPDFs/YIKGP/test/runtests.jl:42 [inlined]
[8] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[9] macro expansion
@ ~/.julia/packages/InterpolatedPDFs/YIKGP/test/runtests.jl:34 [inlined]
[10] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[11] top-level scope
@ ~/.julia/packages/InterpolatedPDFs/YIKGP/test/runtests.jl:9
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/JuMP.1.7.0-DEV-9f32653992.log sort order of dictionaries aren't defined for repr (https://github.com/jump-dev/JuMP.jl/issues/2623)
Printing: Test Failed at /home/pkgeval/.julia/packages/JuMP/Xrr7O/test/Containers/SparseAxisArray.jl:98
Expression: sprint(show, "text/plain", d) == "$(SparseAxisArray{Float64, 2, Tuple{Symbol, Char}}) with 2 entries:\n [b, v] = 0.5\n [a, u] = 2.0"
Evaluated: "SparseAxisArray{Float64, 2, Tuple{Symbol, Char}} with 2 entries:\n [a, u] = 2.0\n [b, v] = 0.5" == "SparseAxisArray{Float64, 2, Tuple{Symbol, Char}} with 2 entries:\n [b, v] = 0.5\n [a, u] = 2.0"
Stacktrace:
[1] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:445 [inlined]
[2] macro expansion
@ ~/.julia/packages/JuMP/Xrr7O/test/Containers/SparseAxisArray.jl:98 [inlined]
[3] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[4] macro expansion
@ ~/.julia/packages/JuMP/Xrr7O/test/Containers/SparseAxisArray.jl:96 [inlined]
[5] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[6] macro expansion
@ ~/.julia/packages/JuMP/Xrr7O/test/Containers/SparseAxisArray.jl:91 [inlined]
[7] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[8] top-level scope
@ ~/.julia/packages/JuMP/Xrr7O/test/Containers/SparseAxisArray.jl:5
Random spatial vector: Error During Test at /home/pkgeval/.julia/packages/LorentzVectors/PNT0Q/test/random.jl:3
Test threw exception
Expression: norm(rand(SpatialVector{Float64})) ≈ 1.0
ArgumentError: Sampler for this object is not defined
Stacktrace:
[1] Random.Sampler(#unused#::Type{TaskLocalRNG}, sp::Random.SamplerType{SpatialVector{Float64}}, #unused#::Val{1})
@ Random /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/Random.jl:145
[2] Random.Sampler(rng::TaskLocalRNG, x::Random.SamplerType{SpatialVector{Float64}}, r::Val{1})
@ Random /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/Random.jl:139
[3] rand(rng::TaskLocalRNG, X::Random.SamplerType{SpatialVector{Float64}})
@ Random /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/Random.jl:253
[4] rand(rng::TaskLocalRNG, ::Type{SpatialVector{Float64}})
@ Random /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/Random.jl:256
[5] rand(#unused#::Type{SpatialVector{Float64}})
@ Random /workspace/srcdir/usr/share/julia/stdlib/v1.7/Random/src/Random.jl:259
[6] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:445 [inlined]
[7] macro expansion
@ ~/.julia/packages/LorentzVectors/PNT0Q/test/random.jl:3 [inlined]
[8] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[9] top-level scope
@ ~/.julia/packages/LorentzVectors/PNT0Q/test/random.jl:2
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-06/03/Perceptrons.1.7.0-DEV-9f32653992.log package issue (filed)
OR function: Error During Test at /home/pkgeval/.julia/packages/Perceptrons/6J70p/test/linear_perceptron_test.jl:7
Got exception outside of a @test
UndefVarError: warn not defined
Stacktrace:
[1] trainer(model::Perceptrons.LinearPerceptron{Float64}, X::Matrix{Float64}, Y::Vector{Float64})
@ Perceptrons ~/.julia/packages/Perceptrons/6J70p/src/linear_perceptron.jl:48
[2] fit(X::Matrix{Float64}, Y::Vector{Float64}; copydata::Bool, centralize::Bool, kernel::String, width::Float64, alpha::Float64, shuffle_epoch::Bool, random_state::Int64, max_epochs::Int64, mode::String)
@ Perceptrons ~/.julia/packages/Perceptrons/6J70p/src/Perceptrons.jl:69
[3] macro expansion
@ ~/.julia/packages/Perceptrons/6J70p/test/linear_perceptron_test.jl:12 [inlined]
[4] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[5] macro expansion
@ ~/.julia/packages/Perceptrons/6J70p/test/linear_perceptron_test.jl:9 [inlined]
[6] macro expansion
@ /workspace/srcdir/usr/share/julia/stdlib/v1.7/Test/src/Test.jl:1282 [inlined]
[7] top-level scope
@ ~/.julia/packages/Perceptrons/6J70p/test/linear_perceptron_test.jl:7
[8] include(fname::String)
@ Base.MainInclude ./client.jl:451
[9] top-level scope
@ ~/.julia/packages/Perceptrons/6J70p/test/runtests.jl:5
[10] include(fname::String)
@ Base.MainInclude ./client.jl:451
[11] top-level scope
@ none:6
[12] eval
@ ./boot.jl:373 [inlined]
[13] exec_options(opts::Base.JLOptions)
@ Base ./client.jl:268
[14] _start()
@ Base ./client.jl:495
invert_pairs: Error During Test at /home/pkgeval/.julia/packages/ReTest/kj6AC/src/ReTest.jl:212
Got exception outside of a @test
type TaskLocalRNG has no field seed
LorentzVectors: defines a rand
method on MersenneTwister
that should be defined for AbstractRNG (https://github.com/JLTastet/LorentzVectors.jl/issues/5).
The remaining issues are:
Documenter – Seems like a bug with IOCapture. I can reproduce locally by replicating a kernel being under load. (echo 4096 | sudo tee /proc/sys/fs/pipe-max-size
)
SPICE – I haven't been able to reproduce this locally running for many iterations in rr
OpenQuantumBase – might actually be an OOM? Running locally, the final report says 142.972633 seconds (248.57 M allocations: 14.148 GiB, 4.79% gc time, 20.30% compilation time), though I only see about 600 MB live RSS (2 GB virtual) when I run that locally.
Update: the bug was fixed in IOCapture some time ago, but Documenter hasn't made a new release yet (https://github.com/JuliaDocs/Documenter.jl/issues/1584)
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-03/16/Documenter.1.7.0-DEV-70b6afa432.log
https://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-03/16/SummationByPartsOperators.1.7.0-DEV-70b6afa432.logsolvedhttps://s3.amazonaws.com/julialang-reports/nanosoldier/pkgeval/by_date/2021-03/16/SPICE.1.7.0-DEV-70b6afa432.log