ERROR: failed process: Process(`/opt/julia-1.7.0/bin/julia -Cnative -J/opt/julia-1.7.0/lib/julia/sys.so -g1 --project=/home/ian/.julia/environments/v1.7 --depwarn=no -e 'using PkgBenchmark

[iajzenszmi]

julia> BenchmarkCI.judge() Resolving package versions... Updating /tmp/BenchmarkCI_jl_hPkxHU/Project.toml [6e4b80f9] + BenchmarkTools v1.2.2 [eacbb407] + Meshes v0.19.2 ~/meshes.jl/Meshes.jl Updating /tmp/BenchmarkCI_jl_hPkxHU/Manifest.toml [79e6a3ab] + Adapt v3.3.1 [6e4b80f9] + BenchmarkTools v1.2.2 [324d7699] + CategoricalArrays v0.10.2 [d360d2e6] + ChainRulesCore v1.11.2 [9e997f8a] + ChangesOfVariables v0.1.2 [7a955b69] + CircularArrays v1.3.0 [34da2185] + Compat v3.41.0 [a8cc5b0e] + Crayons v4.0.4 [9a962f9c] + DataAPI v1.9.0 [864edb3b] + DataStructures v0.18.11 [e2d170a0] + DataValueInterfaces v1.0.0 [b4f34e82] + Distances v0.10.7 [ffbed154] + DocStringExtensions v0.8.6 [3587e190] + InverseFunctions v0.1.2 [92d709cd] + IrrationalConstants v0.1.1 [c8e1da08] + IterTools v1.4.0 [82899510] + IteratorInterfaceExtensions v1.0.0 [692b3bcd] + JLLWrappers v1.3.0 [682c06a0] + JSON v0.21.2 [2ab3a3ac] + LogExpFunctions v0.3.6 [1914dd2f] + MacroTools v0.5.9 [eacbb407] + Meshes v0.19.2 ~/meshes.jl/Meshes.jl [e1d29d7a] + Missings v1.0.2 [b8a86587] + NearestNeighbors v0.4.9 [6fe1bfb0] + OffsetArrays v1.10.8 [bac558e1] + OrderedCollections v1.4.1 [69de0a69] + Parsers v2.1.3 [21216c6a] + Preferences v1.2.2 [3cdcf5f2] + RecipesBase v1.2.1 [74f56ac7] + ReferenceFrameRotations v2.0.0 [ae029012] + Requires v1.2.0 [699a6c99] + SimpleTraits v0.9.4 [a2af1166] + SortingAlgorithms v1.0.1 [276daf66] + SpecialFunctions v2.0.0 [90137ffa] + StaticArrays v1.2.13 [82ae8749] + StatsAPI v1.1.0 [2913bbd2] + StatsBase v0.33.13 [3783bdb8] + TableTraits v1.0.1 [bd369af6] + Tables v1.6.1 [efe28fd5] + OpenSpecFun_jll v0.5.5+0 [0dad84c5] + ArgTools [56f22d72] + Artifacts [2a0f44e3] + Base64 [ade2ca70] + Dates [8bb1440f] + DelimitedFiles [8ba89e20] + Distributed [f43a241f] + Downloads [9fa8497b] + Future [b77e0a4c] + InteractiveUtils [b27032c2] + LibCURL [76f85450] + LibGit2 [8f399da3] + Libdl [37e2e46d] + LinearAlgebra [56ddb016] + Logging [d6f4376e] + Markdown [a63ad114] + Mmap [ca575930] + NetworkOptions [44cfe95a] + Pkg [de0858da] + Printf [9abbd945] + Profile [3fa0cd96] + REPL [9a3f8284] + Random [ea8e919c] + SHA [9e88b42a] + Serialization [1a1011a3] + SharedArrays [6462fe0b] + Sockets [2f01184e] + SparseArrays [10745b16] + Statistics [fa267f1f] + TOML [a4e569a6] + Tar [8dfed614] + Test [cf7118a7] + UUIDs [4ec0a83e] + Unicode [e66e0078] + CompilerSupportLibraries_jll [deac9b47] + LibCURL_jll [29816b5a] + LibSSH2_jll [c8ffd9c3] + MbedTLS_jll [14a3606d] + MozillaCACerts_jll [4536629a] + OpenBLAS_jll [05823500] + OpenLibm_jll [83775a58] + Zlib_jll [8e850b90] + libblastrampoline_jll [8e850ede] + nghttp2_jll [3f19e933] + p7zip_jll [ Info: Using temporary project /tmp/BenchmarkCI_jl_hPkxHU. PkgBenchmark: Running benchmarks... Activating project at /tmp/BenchmarkCI_jl_hPkxHU No Changes to /tmp/BenchmarkCI_jl_hPkxHU/Project.toml No Changes to /tmp/BenchmarkCI_jl_hPkxHU/Manifest.toml ERROR: LoadError: MethodError: no method matching generate_benchmark_definition(::Module, ::Vector{Symbol}, ::Vector{Any}, ::Expr, ::Nothing, ::Nothing, ::Parameters) Closest candidates are: generate_benchmark_definition(::Any, ::Any, ::Any, ::Any, ::Any, ::Any, ::Any, ::Any, ::Any) at ~/.julia/packages/BenchmarkTools/SnZV6/src/execution.jl:461 Stacktrace: [1] benchmarkable(ex::Expr, params::Vector{Any}) @ Main ~/meshes.jl/Meshes.jl/benchmark/utils.jl:13 [2] benchmarkable(ex::Expr) @ Main ~/meshes.jl/Meshes.jl/benchmark/utils.jl:5 [3] add_benchmark!(group::BenchmarkGroup, ex::Expr) @ Main ~/meshes.jl/Meshes.jl/benchmark/utils.jl:25 [4] _broadcast_getindex_evalf @ ./broadcast.jl:670 [inlined] [5] _broadcast_getindex @ ./broadcast.jl:643 [inlined] [6] getindex @ ./broadcast.jl:597 [inlined] [7] copy @ ./broadcast.jl:899 [inlined] [8] materialize @ ./broadcast.jl:860 [inlined] [9] add_benchmark!(group::BenchmarkGroup, exs::Vector{Expr}) @ Main ~/meshes.jl/Meshes.jl/benchmark/utils.jl:29 [10] top-level scope @ ~/meshes.jl/Meshes.jl/benchmark/points.jl:3 [11] include(fname::String) @ Base.MainInclude ./client.jl:451 [12] top-level scope @ ~/meshes.jl/Meshes.jl/benchmark/benchmarks.jl:11 [13] include(fname::String) @ Base.MainInclude ./client.jl:451 [14] top-level scope @ ~/meshes.jl/Meshes.jl/.benchmarkci/benchmarks_wrapper.jl:9 [15] include @ ./Base.jl:418 [inlined] [16] __runbenchmark_local(file::String, output::String, tunefile::String, retune::Bool, runoptions::NamedTuple{(:verbose,), Tuple{Bool}}) @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:268 [17] (::PkgBenchmark.var"#30#31"{String, String, String, Bool, NamedTuple{(:verbose,), Tuple{Bool}}})() @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:262 [18] with_logstate(f::Function, logstate::Any) @ Base.CoreLogging ./logging.jl:511 [19] with_logger(f::Function, logger::TerminalLoggers.TerminalLogger) @ Base.CoreLogging ./logging.jl:623 [20] _runbenchmark_local(file::String, output::String, tunefile::String, retune::Bool, runoptions::NamedTuple{(:verbose,), Tuple{Bool}}, logger_factory_path::Tuple{String, String, Symbol}) @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:261 [21] top-level scope @ none:2 in expression starting at /home/ian/meshes.jl/Meshes.jl/benchmark/points.jl:3 in expression starting at /home/ian/meshes.jl/Meshes.jl/benchmark/benchmarks.jl:11 in expression starting at /home/ian/meshes.jl/Meshes.jl/.benchmarkci/benchmarks_wrapper.jl:9 ERROR: failed process: Process(/opt/julia-1.7.0/bin/julia -Cnative -J/opt/julia-1.7.0/lib/julia/sys.so -g1 --project=/home/ian/.julia/environments/v1.7 --depwarn=no -e 'using PkgBenchmark PkgBenchmark._runbenchmark_local( "/home/ian/meshes.jl/Meshes.jl/.benchmarkci/benchmarks_wrapper.jl", "/tmp/jl_bSpATV", "/home/ian/meshes.jl/Meshes.jl/benchmark/tune.json", false, (verbose = true,), ("32113eaa-f34f-5b0d-bd6c-c81e245fc73d", "PkgBenchmark", :TerminalLogger), ) ', ProcessExited(1)) [1]

Stacktrace: [1] pipeline_error @ ./process.jl:531 [inlined] [2] run(::Cmd; wait::Bool) @ Base ./process.jl:446 [3] run @ ./process.jl:444 [inlined] [4] (::PkgBenchmark.var"#27#29")() @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:255 [5] withenv(f::PkgBenchmark.var"#27#29") @ Base ./env.jl:179 [6] _runbenchmark(file::String, output::String, benchmarkconfig::PkgBenchmark.BenchmarkConfig, tunefile::String; retune::Bool, custom_loadpath::String, runoptions::NamedTuple{(:verbose,), Tuple{Bool}}, logger_factory::Nothing) @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:253 [7] (::PkgBenchmark.var"#21#23"{Bool, Bool, Nothing, String, PkgBenchmark.BenchmarkConfig, String})(f::String) @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:111 [8] _withtemp(f::PkgBenchmark.var"#21#23"{Bool, Bool, Nothing, String, PkgBenchmark.BenchmarkConfig, String}, file::String) @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/util.jl:2 [9] (::PkgBenchmark.var"#do_benchmark#22"{Nothing, Bool, Bool, Nothing, String, String, PkgBenchmark.BenchmarkConfig, Bool, String})() @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:109 [10] benchmarkpkg(pkg::String, target::PkgBenchmark.BenchmarkConfig; script::String, postprocess::Nothing, resultfile::String, retune::Bool, verbose::Bool, logger_factory::Nothing, progressoptions::Nothing, custom_loadpath::String) @ PkgBenchmark ~/.julia/packages/PkgBenchmark/nuPay/src/runbenchmark.jl:141 [11] macro expansion @ ./timing.jl:299 [inlined] [12] (::BenchmarkCI.var"#14#15"{PkgBenchmark.BenchmarkConfig, PkgBenchmark.BenchmarkConfig, String, String, NamedTuple{(:logger_factory, :script), Tuple{Nothing, String}}})() @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:182 [13] noisily(f::BenchmarkCI.var"#14#15"{PkgBenchmark.BenchmarkConfig, PkgBenchmark.BenchmarkConfig, String, String, NamedTuple{(:logger_factory, :script), Tuple{Nothing, String}}}, yes::Bool; interval::Int64) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:175 [14] noisily(f::Function, yes::Bool) (repeats 2 times) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:163 [15] #_judge#13 @ ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:181 [inlined] [16] (::BenchmarkCI.var"#8#9"{String, String, String, Nothing, Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}}, PkgBenchmark.BenchmarkConfig, String})(tmpproject::String, should_resolve::Bool) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:148 [17] (::BenchmarkCI.var"#4#5"{BenchmarkCI.var"#8#9"{String, String, String, Nothing, Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}}, PkgBenchmark.BenchmarkConfig, String}, String})(tmp::String) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:90 [18] mktempdir(fn::BenchmarkCI.var"#4#5"{BenchmarkCI.var"#8#9"{String, String, String, Nothing, Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}}, PkgBenchmark.BenchmarkConfig, String}, String}, parent::String; prefix::String) @ Base.Filesystem ./file.jl:750 [19] maybe_with_merged_project(f::BenchmarkCI.var"#8#9"{String, String, String, Nothing, Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}}, PkgBenchmark.BenchmarkConfig, String}, project::String, pkgdir::String) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:78 [20] judge(target::Nothing, baseline::String; workspace::String, pkgdir::String, script::String, project::String, logger_factory::Nothing, kwargs::Base.Pairs{Symbol, Union{}, Tuple{}, NamedTuple{(), Tuple{}}}) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:146 [21] judge(target::Nothing, baseline::String) @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:134 [22] #judge#6 @ ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:121 [inlined] [23] judge() @ BenchmarkCI ~/.julia/packages/BenchmarkCI/C4I6c/src/BenchmarkCI.jl:121 [24] top-level scope @ REPL[4]:1

julia>

[juliohm]

@iajzenszmi please read the docs before opening an issue. Also we can't help when you don't describe what you are trying to do. Use our Zulip channel for support, the GitHub issues are for well-defined bug reports and feature requests with more information and context.

[iajzenszmi]

julia ~/meshes.jl/Meshes.jl/benchmark/benchmarks.jl does not work, but reports an error. julia ~/meshes.jl/Meshes.jl/test$ julia runtests.jl does work with the results Test Summary: | Pass Total Meshes.jl (Float64) | 1868 1868 For your information and remediation. It would be good to have a julia benchmarks.jl command line that works.

[juliohm]

This is now how users are supposed to run tests or benchmarks. Please check the Pkg.jl documentation to activate the environments and run tests for example.