JuliaParallel / Dagger.jl

A framework for out-of-core and parallel execution
Other
610 stars 66 forks source link

Cannot use Dagger on Julia beta 1.11.0 #501

Closed eschnett closed 2 months ago

eschnett commented 3 months ago

I cannot install Dagger on the recently-released beta version of Julia 1.11 on macOS:

$ julia +beta --project=@.
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.11.0-beta1 (2024-04-10)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

(D) pkg> add Dagger
   Resolving package versions...
      Compat entries added for Dagger
    Updating `/private/tmp/D/Project.toml`
  [d58978e5] + Dagger v0.18.8
    Updating `/private/tmp/D/Manifest.toml`
  [ec485272] + ArnoldiMethod v0.4.0
  [34da2185] + Compat v4.14.0
  [5060bff5] + ConcurrentCollections v0.1.1
  [d58978e5] + Dagger v0.18.8
  [9a962f9c] + DataAPI v1.16.0
  [864edb3b] + DataStructures v0.18.19
  [ffbed154] + DocStringExtensions v0.9.3
  [86223c79] + Graphs v1.10.0
  [076d061b] + HashArrayMappedTries v0.2.0
  [d25df0c9] + Inflate v0.1.4
  [92d709cd] + IrrationalConstants v0.2.2
  [2ab3a3ac] + LogExpFunctions v0.3.27
  [1914dd2f] + MacroTools v0.5.13
  [f9f48841] + MemPool v0.4.8
  [e1d29d7a] + Missings v1.2.0
  [bac558e1] + OrderedCollections v1.6.3
  [aea7be01] + PrecompileTools v1.2.1
  [21216c6a] + Preferences v1.4.3
  [ae029012] + Requires v1.3.0
  [7e506255] + ScopedValues v1.2.0
  [699a6c99] + SimpleTraits v0.9.4
  [a2af1166] + SortingAlgorithms v1.2.1
  [90137ffa] + StaticArrays v1.9.3
  [1e83bf80] + StaticArraysCore v1.4.2
  [10745b16] + Statistics v1.11.1
  [82ae8749] + StatsAPI v1.7.0
  [2913bbd2] + StatsBase v0.34.3
  [a526e669] + TimespanLogging v0.1.0
  [013be700] + UnsafeAtomics v0.2.1
  [56f22d72] + Artifacts v1.11.0
  [2a0f44e3] + Base64 v1.11.0
  [ade2ca70] + Dates v1.11.0
  [8ba89e20] + Distributed v1.11.0
  [b77e0a4c] + InteractiveUtils v1.11.0
  [76f85450] + LibGit2 v1.11.0
  [8f399da3] + Libdl v1.11.0
  [37e2e46d] + LinearAlgebra v1.11.0
  [56ddb016] + Logging v1.11.0
  [d6f4376e] + Markdown v1.11.0
  [a63ad114] + Mmap v1.11.0
  [ca575930] + NetworkOptions v1.2.0
  [de0858da] + Printf v1.11.0
  [9abbd945] + Profile v1.11.0
  [9a3f8284] + Random v1.11.0
  [ea8e919c] + SHA v0.7.0
  [9e88b42a] + Serialization v1.11.0
  [1a1011a3] + SharedArrays v1.11.0
  [6462fe0b] + Sockets v1.11.0
  [2f01184e] + SparseArrays v1.11.0
  [f489334b] + StyledStrings v1.11.0
  [fa267f1f] + TOML v1.0.3
  [cf7118a7] + UUIDs v1.11.0
  [4ec0a83e] + Unicode v1.11.0
  [e66e0078] + CompilerSupportLibraries_jll v1.1.1+0
  [e37daf67] + LibGit2_jll v1.7.2+0
  [29816b5a] + LibSSH2_jll v1.11.0+1
  [c8ffd9c3] + MbedTLS_jll v2.28.6+0
  [4536629a] + OpenBLAS_jll v0.3.26+2
  [bea87d4a] + SuiteSparse_jll v7.6.0+0
  [8e850b90] + libblastrampoline_jll v5.8.0+1
Precompiling project...
  ✗ Dagger
  1 dependency successfully precompiled in 3 seconds. 54 already precompiled.
  1 dependency errored.
  For a report of the errors see `julia> err`. To retry use `pkg> precompile`

The main branch of Dagger can be installed, but I can neither precompile nor using it.

jpsamaroo commented 3 months ago

Can you provide the errors that are output by Dagger, if any? Or if nothing is output, can you set the env. var. JULIA_DEBUG="Dagger" and post the whole output?

eschnett commented 3 months ago

Setting the environment variable I see

$ env JULIA_DEBUG=Dagger julia +beta
               _
   _       _ _(_)_     |  Documentation: https://docs.julialang.org
  (_)     | (_) (_)    |
   _ _   _| |_  __ _   |  Type "?" for help, "]?" for Pkg help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 1.11.0-beta1 (2024-04-10)
 _/ |\__'_|_|_|\__'_|  |  Official https://julialang.org/ release
|__/                   |

julia> using Dagger
Precompiling Dagger...
Info Given Dagger was explicitly requested, output will be shown live
┌ Debug: (:global) Initializing scheduler
│   uid = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:520
┌ Debug: [1] (:scope) Accepted Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:348
┌ Debug: [1] (:schedule) Scheduling to Dagger.OSProc(1) -> Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:773
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Enqueuing task batch
│   batch_size = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1354
┌ Debug: [1] (:processor) Enqueued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1395
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: (:processor) Kicked processors
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1411
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [1] (:processor) Dequeued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1298
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [1] (:execute) Moving data
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1499
┌ Debug: [1] (:move) Moved argument 0 to Dagger.ThreadProc(1, 1): typeof(Dagger.Sch.eager_thunk)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [1] (:execute) Executing typeof(Dagger.Sch.eager_thunk)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1599
┌ Debug: [2] (:submit) Added to scheduler
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:109
┌ Debug: [2] (:submit) Registered future
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:113
┌ Debug: [2] (:scope) Accepted Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:348
┌ Debug: [2] (:schedule) Scheduling to Dagger.OSProc(1) -> Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:773
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Enqueuing task batch
│   batch_size = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1354
┌ Debug: [2] (:processor) Enqueued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1395
┌ Debug: (:processor) Kicked processors
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1411
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [2] (:processor) Dequeued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1298
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [2] (:execute) Moving data
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1499
┌ Debug: [2] (:move) Moved argument 0 to Dagger.ThreadProc(1, 1): typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [2] (:move) Moved argument -1 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [2] (:move) Moved argument -2 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [2] (:execute) Executing typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1599
┌ Debug: [2] (:execute) Returning
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1648
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [2] (:take) Got finished task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:542
┌ Debug: (:processor) Nothing to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1217
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Failed to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1232
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [3] (:submit) Added to scheduler
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:109
┌ Debug: [3] (:submit) Registered future
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:113
┌ Debug: [3] (:scope) Accepted Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:348
┌ Debug: [3] (:schedule) Scheduling to Dagger.OSProc(1) -> Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:773
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Enqueuing task batch
│   batch_size = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1354
┌ Debug: [3] (:processor) Enqueued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1395
┌ Debug: (:processor) Kicked processors
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1411
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [3] (:processor) Dequeued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1298
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [3] (:execute) Moving data
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1499
┌ Debug: [3] (:move) Moved argument 0 to Dagger.ThreadProc(1, 1): typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [3] (:move) Moved argument -1 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [3] (:move) Moved argument 2 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [3] (:execute) Executing typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1599
┌ Debug: [3] (:execute) Returning
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1648
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [3] (:take) Got finished task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:542
┌ Debug: (:processor) Nothing to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1217
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Failed to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1232
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: (:take) Got finished task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:542
┌ Debug: (:global) Tearing down scheduler
│   uid = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:618
┌ Warning: Waiting on thunk 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:42
┌ Debug: [1] (:execute) Returning
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1648
┌ Debug: [1] (:execute) Return queue is closed, failing to put result
│   chan = Distributed.RemoteChannel{Channel{Any}}(1, 1, 2)
│   exception = (InvalidStateException("Channel is closed.", :closed), Union{Ptr{Nothing}, Base.InterpreterIP}[Ptr{Nothing} @0x0000000135247180, Ptr{Nothing} @0x000000013524742b, Ptr{Nothing} @0x000000013524367e, Ptr{Nothing} @0x0000000135243c5c, Ptr{Nothing} @0x0000000135243d1d, Ptr{Nothing} @0x0000000106854767, Ptr{Nothing} @0x000000013309efd9, Ptr{Nothing} @0x0000000133054f46, Ptr{Nothing} @0x00000001330582ef, Ptr{Nothing} @0x0000000106867ed7])
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1319
  Progress [>                                        ]  0/1
  ◒ Dagger

Things stall here, I need to press ctrl-C to abort.

eschnett commented 3 months ago

This was with the main branch of Dagger. crtrl-C leads to this additional output:

│   exception = (InvalidStateException("Channel is closed.", :closed), Union{Ptr{Nothing}, Base.InterpreterIP}[Ptr{Nothing} @0x0000000135247180, Ptr{Nothing} @0x000000013524742b, Ptr{Nothing} @0x000000013524367e, Ptr{Nothing} @0x0000000135243c5c, Ptr{Nothing} @0x0000000135243d1d, Ptr{Nothing} @0x0000000106854767, Ptr{Nothing} @0x000000013309efd9, Ptr{Nothing} @0x0000000133054f46, Ptr{Nothing} @0x00000001330582ef, Ptr{Nothing} @0x0000000106867ed7])
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1319
^C Interrupted: Exiting precompilation...

[78713] signal 2: Interrupt: 2
in expression starting at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:1
__psynch_cvwait at /usr/lib/system/libsystem_kernel.dylib (unknown line)
_pthread_cond_wait at /usr/lib/system/libsystem_pthread.dylib (unknown line)
uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:806
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/scheduler.c:573
poptask at ./task.jl:998
wait at ./task.jl:1007
#wait#725 at ./condition.jl:130
wait at ./condition.jl:125 [inlined]
slowlock at ./lock.jl:157
lock at ./lock.jl:147 [inlined]
lock at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/utils/locked-object.jl:10
#1 at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:11
unknown function (ip: 0x1154ecbbf)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
start_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/task.c:1202
unknown function (ip: 0x0)
Allocations: 34802987 (Pool: 34801898; Big: 1089); GC: 53

  1 dependency had output during precompilation:
┌ Dagger
│  [Output was shown above]
└
┌ Info: Waiting for another process (pid: 78709) to finish precompiling Dagger [d58978e5-989f-55fb-8d15-ea34adc7bf54]. Pidfile: /Users/eschnett/.julia/compiled/v1.11/Dagger/0a2f8_2r9KJ.ji.pidfile
└ @ Base loading.jl:3530
schedule: Task not runnable
atexit hook threw an error: ErrorException("schedule: Task not runnable")
error at ./error.jl:35
┌ Info: Precompiling Dagger [d58978e5-989f-55fb-8d15-ea34adc7bf54] (cache misses: invalid header (3))
└ @ Base loading.jl:2887
#schedule#755 at ./task.jl:870
schedule at ./task.jl:862 [inlined]
uv_writecb_task at ./stream.jl:1191
jfptr_uv_writecb_task_65094.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jlcapi_uv_writecb_task_65553.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
uv__write_callbacks at /workspace/srcdir/libuv/src/unix/stream.c:926
uv__stream_io at /workspace/srcdir/libuv/src/unix/stream.c:1227
uv__run_pending at /workspace/srcdir/libuv/src/unix/core.c:824
uv_run at /workspace/srcdir/libuv/src/unix/core.c:420
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/scheduler.c:512
poptask at ./task.jl:998
wait at ./task.jl:1007
uv_write at ./stream.jl:1072
unsafe_write at ./stream.jl:1145
unsafe_write at ./io.jl:452 [inlined]
write at ./strings/io.jl:248 [inlined]
print at ./strings/io.jl:250
unknown function (ip: 0x13524e986)
showerror at ./errorshow.jl:152
unknown function (ip: 0x13524e856)
_atexit at ./initdefs.jl:454
jfptr__atexit_67266.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
ijl_atexit_hook at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/init.c:271
jl_exit_thread0_cb at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./signals-mach.c:500
^C
[78786] signal 2: Interrupt: 2
in expression starting at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:1
gc_try_setmark_tag at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:815 [inlined]
gc_try_claim_and_push at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2094 [inlined]
gc_mark_obj8 at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2114
gc_mark_outrefs at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2882 [inlined]
gc_mark_loop_serial_ at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2938
gc_mark_loop_serial at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2961
_jl_gc_collect at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:3532
ijl_gc_collect at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:3893
maybe_collect at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:922 [inlined]
jl_gc_pool_alloc_inner at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:1319 [inlined]
ijl_gc_pool_alloc_instrumented at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:1377
LineInfoNode at ./boot.jl:469 [inlined]
ir_inline_linetable! at ./compiler/ssair/inlining.jl:338
ir_prepare_inlining! at ./compiler/ssair/inlining.jl:361
ir_inline_item! at ./compiler/ssair/inlining.jl:400
batch_inline! at ./compiler/ssair/inlining.jl:700
ssa_inlining_pass! at ./compiler/ssair/inlining.jl:81 [inlined]
run_passes_ipo_safe at ./compiler/optimize.jl:968
run_passes_ipo_safe at ./compiler/optimize.jl:983 [inlined]
optimize at ./compiler/optimize.jl:957
jfptr_optimize_41921.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
_typeinf at ./compiler/typeinfer.jl:264
typeinf at ./compiler/typeinfer.jl:212
typeinf_edge at ./compiler/typeinfer.jl:873
abstract_call_method at ./compiler/abstractinterpretation.jl:650
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:102
abstract_call_known at ./compiler/abstractinterpretation.jl:2182
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_call at ./compiler/abstractinterpretation.jl:2257
abstract_call at ./compiler/abstractinterpretation.jl:2402
abstract_eval_call at ./compiler/abstractinterpretation.jl:2417
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2433
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2738
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:3049
typeinf_local at ./compiler/abstractinterpretation.jl:3303
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3385
_typeinf at ./compiler/typeinfer.jl:246
typeinf at ./compiler/typeinfer.jl:212
typeinf_edge at ./compiler/typeinfer.jl:873
abstract_call_method at ./compiler/abstractinterpretation.jl:650
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:102
abstract_call_known at ./compiler/abstractinterpretation.jl:2182
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_call at ./compiler/abstractinterpretation.jl:2257
abstract_call at ./compiler/abstractinterpretation.jl:2402
abstract_eval_call at ./compiler/abstractinterpretation.jl:2417
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2433
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2738
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:3025
typeinf_local at ./compiler/abstractinterpretation.jl:3303
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3385
_typeinf at ./compiler/typeinfer.jl:246
typeinf at ./compiler/typeinfer.jl:212
typeinf_edge at ./compiler/typeinfer.jl:873
abstract_call_method at ./compiler/abstractinterpretation.jl:650
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:102
abstract_call_known at ./compiler/abstractinterpretation.jl:2182
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_apply at ./compiler/abstractinterpretation.jl:1672
abstract_call_known at ./compiler/abstractinterpretation.jl:2084
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_call at ./compiler/abstractinterpretation.jl:2257
abstract_call at ./compiler/abstractinterpretation.jl:2402
abstract_eval_call at ./compiler/abstractinterpretation.jl:2417
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2433
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2738
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:3049
typeinf_local at ./compiler/abstractinterpretation.jl:3303
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3385
_typeinf at ./compiler/typeinfer.jl:246
typeinf at ./compiler/typeinfer.jl:212
typeinf_ext at ./compiler/typeinfer.jl:1045
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1083
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1079
jfptr_typeinf_ext_toplevel_39160.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
jl_type_infer at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:390
jl_generate_fptr_impl at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/jitlayers.cpp:511
jl_compile_method_internal at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:2534
_jl_invoke at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:2938 [inlined]
ijl_apply_generic at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:3123
macro expansion at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:7 [inlined]
macro expansion at /Users/eschnett/.julia/packages/PrecompileTools/L8A3n/src/workloads.jl:78 [inlined]
top-level scope at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:102
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:934
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:952 [inlined]
ijl_toplevel_eval_in at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:428 [inlined]
include_string at ./loading.jl:2543
_include at ./loading.jl:2603
include at ./Base.jl:558
jfptr_include_45969.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
jl_f__call_latest at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/builtins.c:875
include at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/Dagger.jl:1
unknown function (ip: 0x10bee6d32)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
do_call at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:126
eval_stmt_value at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:174
eval_body at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:659
jl_interpret_toplevel_thunk at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:817
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:943
jl_eval_module_expr at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:215 [inlined]
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:743
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:952 [inlined]
ijl_toplevel_eval_in at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:428 [inlined]
include_string at ./loading.jl:2543
_include at ./loading.jl:2603
include at ./Base.jl:558 [inlined]
include_package_for_output at ./loading.jl:2721
jfptr_include_package_for_output_69710.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
do_call at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:126
eval_stmt_value at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:174
eval_body at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:659
jl_interpret_toplevel_thunk at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:817
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:943
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:952 [inlined]
ijl_toplevel_eval_in at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:428 [inlined]
include_string at ./loading.jl:2543
include_string at ./loading.jl:2553 [inlined]
exec_options at ./client.jl:316
_start at ./client.jl:526
jfptr__start_71207.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
true_main at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/jlapi.c:900
jl_repl_entrypoint at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/jlapi.c:1059
unknown function (ip: 0x0)
Allocations: 5080312 (Pool: 5080093; Big: 219); GC: 5
ERROR: InterruptException:
Stacktrace:
  [1] try_yieldto(undo::typeof(Base.ensure_rescheduled))
    @ Base ./task.jl:944
  [2] wait()
    @ Base ./task.jl:1008
  [3] wait(c::Base.GenericCondition{Base.Threads.SpinLock}; first::Bool)
    @ Base ./condition.jl:130
  [4] wait
    @ ./condition.jl:125 [inlined]
  [5] wait(x::Base.Process, syncd::Bool)
    @ Base ./process.jl:694
  [6] wait
    @ ./process.jl:687 [inlined]
  [7] success(x::Base.Process)
    @ Base ./process.jl:556
  [8] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IO, internal_stdout::IO, keep_loaded_modules::Bool; flags::Cmd, cacheflags::Base.CacheFlags, reasons::Dict{…})
    @ Base ./loading.jl:2910
  [9] (::Base.var"#1074#1075"{Base.PkgId})()
    @ Base ./loading.jl:2389
 [10] mkpidlock(f::Base.var"#1074#1075"{Base.PkgId}, at::String, pid::Int32; kwopts::@Kwargs{stale_age::Int64, wait::Bool})
    @ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:95
 [11] #mkpidlock#6
    @ ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:90 [inlined]
 [12] trymkpidlock(::Function, ::Vararg{Any}; kwargs::@Kwargs{stale_age::Int64})
    @ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:116
 [13] #invokelatest#2
    @ ./essentials.jl:1032 [inlined]
 [14] invokelatest
    @ ./essentials.jl:1027 [inlined]
 [15] maybe_cachefile_lock(f::Base.var"#1074#1075"{Base.PkgId}, pkg::Base.PkgId, srcpath::String; stale_age::Int64)
    @ Base ./loading.jl:3525
 [16] maybe_cachefile_lock
    @ ./loading.jl:3522 [inlined]
 [17] _require(pkg::Base.PkgId, env::String)
    @ Base ./loading.jl:2385
 [18] __require_prelocked(uuidkey::Base.PkgId, env::String)
    @ Base ./loading.jl:2217
 [19] #invoke_in_world#3
    @ ./essentials.jl:1064 [inlined]
 [20] invoke_in_world
    @ ./essentials.jl:1061 [inlined]
 [21] _require_prelocked(uuidkey::Base.PkgId, env::String)
    @ Base ./loading.jl:2208
 [22] macro expansion
    @ ./loading.jl:2148 [inlined]
 [23] macro expansion
    @ ./lock.jl:273 [inlined]
 [24] __require(into::Module, mod::Symbol)
    @ Base ./loading.jl:2105
 [25] #invoke_in_world#3
    @ ./essentials.jl:1064 [inlined]
 [26] invoke_in_world
    @ ./essentials.jl:1061 [inlined]
 [27] require(into::Module, mod::Symbol)
    @ Base ./loading.jl:2098
Some type information was truncated. Use `show(err)` to see complete types.

julia>
eschnett commented 3 months ago

More of the error message:

julia> show(err)
1-element ExceptionStack:
InterruptException:
Stacktrace:
  [1] try_yieldto(undo::typeof(Base.ensure_rescheduled))
    @ Base ./task.jl:944
  [2] wait()
    @ Base ./task.jl:1008
  [3] wait(c::Base.GenericCondition{Base.Threads.SpinLock}; first::Bool)
    @ Base ./condition.jl:130
  [4] wait
    @ ./condition.jl:125 [inlined]
  [5] wait(x::Base.Process, syncd::Bool)
    @ Base ./process.jl:694
  [6] wait
    @ ./process.jl:687 [inlined]
  [7] success(x::Base.Process)
    @ Base ./process.jl:556
  [8] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IO, internal_stdout::IO, keep_loaded_modules::Bool; flags::Cmd, cacheflags::Base.CacheFlags, reasons::Dict{String, Int64})
    @ Base ./loading.jl:2910
  [9] (::Base.var"#1074#1075"{Base.PkgId})()
    @ Base ./loading.jl:2389
 [10] mkpidlock(f::Base.var"#1074#1075"{Base.PkgId}, at::String, pid::Int32; kwopts::@Kwargs{stale_age::Int64, wait::Bool})
    @ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:95
 [11] #mkpidlock#6
    @ ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:90 [inlined]
 [12] trymkpidlock(::Function, ::Vararg{Any}; kwargs::@Kwargs{stale_age::Int64})
    @ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:116
 [13] #invokelatest#2
    @ ./essentials.jl:1032 [inlined]
 [14] invokelatest
    @ ./essentials.jl:1027 [inlined]
 [15] maybe_cachefile_lock(f::Base.var"#1074#1075"{Base.PkgId}, pkg::Base.PkgId, srcpath::String; stale_age::Int64)
    @ Base ./loading.jl:3525
 [16] maybe_cachefile_lock
    @ ./loading.jl:3522 [inlined]
 [17] _require(pkg::Base.PkgId, env::String)
    @ Base ./loading.jl:2385
 [18] __require_prelocked(uuidkey::Base.PkgId, env::String)
    @ Base ./loading.jl:2217
 [19] #invoke_in_world#3
    @ ./essentials.jl:1064 [inlined]
 [20] invoke_in_world
    @ ./essentials.jl:1061 [inlined]
 [21] _require_prelocked(uuidkey::Base.PkgId, env::String)
    @ Base ./loading.jl:2208
 [22] macro expansion
    @ ./loading.jl:2148 [inlined]
 [23] macro expansion
    @ ./lock.jl:273 [inlined]
 [24] __require(into::Module, mod::Symbol)
    @ Base ./loading.jl:2105
 [25] #invoke_in_world#3
    @ ./essentials.jl:1064 [inlined]
 [26] invoke_in_world
    @ ./essentials.jl:1061 [inlined]
 [27] require(into::Module, mod::Symbol)
    @ Base ./loading.jl:2098
jpsamaroo commented 3 months ago

@JamesWrigley I think this is the same issue we're sometimes seeing on MacOS CI.

JamesWrigley commented 3 months ago

You mean race conditions within the scheduler? :thinking: TBH I can't really tell from the logs what's happening.

eschnett commented 2 months ago

Is there a way to dump the internal state of the scheduler? If you have a patch (branch) that would e.g. do that every second (or minute?) then I could run this locally and report. I'd also be happy to have a Zoom session where you look at things looking over my shoulder.