Closed eschnett closed 2 months ago
Can you provide the errors that are output by Dagger, if any? Or if nothing is output, can you set the env. var. JULIA_DEBUG="Dagger"
and post the whole output?
Setting the environment variable I see
$ env JULIA_DEBUG=Dagger julia +beta
_
_ _ _(_)_ | Documentation: https://docs.julialang.org
(_) | (_) (_) |
_ _ _| |_ __ _ | Type "?" for help, "]?" for Pkg help.
| | | | | | |/ _` | |
| | |_| | | | (_| | | Version 1.11.0-beta1 (2024-04-10)
_/ |\__'_|_|_|\__'_| | Official https://julialang.org/ release
|__/ |
julia> using Dagger
Precompiling Dagger...
Info Given Dagger was explicitly requested, output will be shown live
┌ Debug: (:global) Initializing scheduler
│ uid = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:520
┌ Debug: [1] (:scope) Accepted Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:348
┌ Debug: [1] (:schedule) Scheduling to Dagger.OSProc(1) -> Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:773
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Enqueuing task batch
│ batch_size = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1354
┌ Debug: [1] (:processor) Enqueued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1395
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: (:processor) Kicked processors
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1411
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [1] (:processor) Dequeued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1298
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [1] (:execute) Moving data
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1499
┌ Debug: [1] (:move) Moved argument 0 to Dagger.ThreadProc(1, 1): typeof(Dagger.Sch.eager_thunk)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [1] (:execute) Executing typeof(Dagger.Sch.eager_thunk)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1599
┌ Debug: [2] (:submit) Added to scheduler
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:109
┌ Debug: [2] (:submit) Registered future
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:113
┌ Debug: [2] (:scope) Accepted Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:348
┌ Debug: [2] (:schedule) Scheduling to Dagger.OSProc(1) -> Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:773
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Enqueuing task batch
│ batch_size = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1354
┌ Debug: [2] (:processor) Enqueued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1395
┌ Debug: (:processor) Kicked processors
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1411
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [2] (:processor) Dequeued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1298
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [2] (:execute) Moving data
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1499
┌ Debug: [2] (:move) Moved argument 0 to Dagger.ThreadProc(1, 1): typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [2] (:move) Moved argument -1 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [2] (:move) Moved argument -2 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [2] (:execute) Executing typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1599
┌ Debug: [2] (:execute) Returning
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1648
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [2] (:take) Got finished task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:542
┌ Debug: (:processor) Nothing to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1217
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Failed to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1232
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [3] (:submit) Added to scheduler
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:109
┌ Debug: [3] (:submit) Registered future
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/submission.jl:113
┌ Debug: [3] (:scope) Accepted Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:348
┌ Debug: [3] (:schedule) Scheduling to Dagger.OSProc(1) -> Dagger.ThreadProc(1, 1)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:773
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Enqueuing task batch
│ batch_size = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1354
┌ Debug: [3] (:processor) Enqueued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1395
┌ Debug: (:processor) Kicked processors
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1411
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [3] (:processor) Dequeued task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1298
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: [3] (:execute) Moving data
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1499
┌ Debug: [3] (:move) Moved argument 0 to Dagger.ThreadProc(1, 1): typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [3] (:move) Moved argument -1 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [3] (:move) Moved argument 2 to Dagger.ThreadProc(1, 1): Int64
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1556
┌ Debug: [3] (:execute) Executing typeof(+)
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1599
┌ Debug: [3] (:execute) Returning
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1648
┌ Debug: (:processor) Trying to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1210
┌ Debug: [3] (:take) Got finished task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:542
┌ Debug: (:processor) Nothing to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1217
┌ Debug: (:take) Waiting for results
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:535
┌ Debug: (:processor) Failed to dequeue
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1232
┌ Debug: (:processor) Waiting for tasks
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1197
┌ Debug: (:take) Got finished task
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:542
┌ Debug: (:global) Tearing down scheduler
│ uid = 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:618
┌ Warning: Waiting on thunk 1
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:42
┌ Debug: [1] (:execute) Returning
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1648
┌ Debug: [1] (:execute) Return queue is closed, failing to put result
│ chan = Distributed.RemoteChannel{Channel{Any}}(1, 1, 2)
│ exception = (InvalidStateException("Channel is closed.", :closed), Union{Ptr{Nothing}, Base.InterpreterIP}[Ptr{Nothing} @0x0000000135247180, Ptr{Nothing} @0x000000013524742b, Ptr{Nothing} @0x000000013524367e, Ptr{Nothing} @0x0000000135243c5c, Ptr{Nothing} @0x0000000135243d1d, Ptr{Nothing} @0x0000000106854767, Ptr{Nothing} @0x000000013309efd9, Ptr{Nothing} @0x0000000133054f46, Ptr{Nothing} @0x00000001330582ef, Ptr{Nothing} @0x0000000106867ed7])
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1319
Progress [> ] 0/1
◒ Dagger
Things stall here, I need to press ctrl-C to abort.
This was with the main
branch of Dagger. crtrl-C leads to this additional output:
│ exception = (InvalidStateException("Channel is closed.", :closed), Union{Ptr{Nothing}, Base.InterpreterIP}[Ptr{Nothing} @0x0000000135247180, Ptr{Nothing} @0x000000013524742b, Ptr{Nothing} @0x000000013524367e, Ptr{Nothing} @0x0000000135243c5c, Ptr{Nothing} @0x0000000135243d1d, Ptr{Nothing} @0x0000000106854767, Ptr{Nothing} @0x000000013309efd9, Ptr{Nothing} @0x0000000133054f46, Ptr{Nothing} @0x00000001330582ef, Ptr{Nothing} @0x0000000106867ed7])
└ @ Dagger /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/Sch.jl:1319
^C Interrupted: Exiting precompilation...
[78713] signal 2: Interrupt: 2
in expression starting at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:1
__psynch_cvwait at /usr/lib/system/libsystem_kernel.dylib (unknown line)
_pthread_cond_wait at /usr/lib/system/libsystem_pthread.dylib (unknown line)
uv_cond_wait at /workspace/srcdir/libuv/src/unix/thread.c:806
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/scheduler.c:573
poptask at ./task.jl:998
wait at ./task.jl:1007
#wait#725 at ./condition.jl:130
wait at ./condition.jl:125 [inlined]
slowlock at ./lock.jl:157
lock at ./lock.jl:147 [inlined]
lock at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/utils/locked-object.jl:10
#1 at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/sch/util.jl:11
unknown function (ip: 0x1154ecbbf)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
start_task at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/task.c:1202
unknown function (ip: 0x0)
Allocations: 34802987 (Pool: 34801898; Big: 1089); GC: 53
1 dependency had output during precompilation:
┌ Dagger
│ [Output was shown above]
└
┌ Info: Waiting for another process (pid: 78709) to finish precompiling Dagger [d58978e5-989f-55fb-8d15-ea34adc7bf54]. Pidfile: /Users/eschnett/.julia/compiled/v1.11/Dagger/0a2f8_2r9KJ.ji.pidfile
└ @ Base loading.jl:3530
schedule: Task not runnable
atexit hook threw an error: ErrorException("schedule: Task not runnable")
error at ./error.jl:35
┌ Info: Precompiling Dagger [d58978e5-989f-55fb-8d15-ea34adc7bf54] (cache misses: invalid header (3))
└ @ Base loading.jl:2887
#schedule#755 at ./task.jl:870
schedule at ./task.jl:862 [inlined]
uv_writecb_task at ./stream.jl:1191
jfptr_uv_writecb_task_65094.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jlcapi_uv_writecb_task_65553.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
uv__write_callbacks at /workspace/srcdir/libuv/src/unix/stream.c:926
uv__stream_io at /workspace/srcdir/libuv/src/unix/stream.c:1227
uv__run_pending at /workspace/srcdir/libuv/src/unix/core.c:824
uv_run at /workspace/srcdir/libuv/src/unix/core.c:420
ijl_task_get_next at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/scheduler.c:512
poptask at ./task.jl:998
wait at ./task.jl:1007
uv_write at ./stream.jl:1072
unsafe_write at ./stream.jl:1145
unsafe_write at ./io.jl:452 [inlined]
write at ./strings/io.jl:248 [inlined]
print at ./strings/io.jl:250
unknown function (ip: 0x13524e986)
showerror at ./errorshow.jl:152
unknown function (ip: 0x13524e856)
_atexit at ./initdefs.jl:454
jfptr__atexit_67266.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
ijl_atexit_hook at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/init.c:271
jl_exit_thread0_cb at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./signals-mach.c:500
^C
[78786] signal 2: Interrupt: 2
in expression starting at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:1
gc_try_setmark_tag at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:815 [inlined]
gc_try_claim_and_push at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2094 [inlined]
gc_mark_obj8 at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2114
gc_mark_outrefs at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2882 [inlined]
gc_mark_loop_serial_ at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2938
gc_mark_loop_serial at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:2961
_jl_gc_collect at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:3532
ijl_gc_collect at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:3893
maybe_collect at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:922 [inlined]
jl_gc_pool_alloc_inner at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:1319 [inlined]
ijl_gc_pool_alloc_instrumented at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gc.c:1377
LineInfoNode at ./boot.jl:469 [inlined]
ir_inline_linetable! at ./compiler/ssair/inlining.jl:338
ir_prepare_inlining! at ./compiler/ssair/inlining.jl:361
ir_inline_item! at ./compiler/ssair/inlining.jl:400
batch_inline! at ./compiler/ssair/inlining.jl:700
ssa_inlining_pass! at ./compiler/ssair/inlining.jl:81 [inlined]
run_passes_ipo_safe at ./compiler/optimize.jl:968
run_passes_ipo_safe at ./compiler/optimize.jl:983 [inlined]
optimize at ./compiler/optimize.jl:957
jfptr_optimize_41921.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
_typeinf at ./compiler/typeinfer.jl:264
typeinf at ./compiler/typeinfer.jl:212
typeinf_edge at ./compiler/typeinfer.jl:873
abstract_call_method at ./compiler/abstractinterpretation.jl:650
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:102
abstract_call_known at ./compiler/abstractinterpretation.jl:2182
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_call at ./compiler/abstractinterpretation.jl:2257
abstract_call at ./compiler/abstractinterpretation.jl:2402
abstract_eval_call at ./compiler/abstractinterpretation.jl:2417
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2433
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2738
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:3049
typeinf_local at ./compiler/abstractinterpretation.jl:3303
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3385
_typeinf at ./compiler/typeinfer.jl:246
typeinf at ./compiler/typeinfer.jl:212
typeinf_edge at ./compiler/typeinfer.jl:873
abstract_call_method at ./compiler/abstractinterpretation.jl:650
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:102
abstract_call_known at ./compiler/abstractinterpretation.jl:2182
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_call at ./compiler/abstractinterpretation.jl:2257
abstract_call at ./compiler/abstractinterpretation.jl:2402
abstract_eval_call at ./compiler/abstractinterpretation.jl:2417
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2433
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2738
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:3025
typeinf_local at ./compiler/abstractinterpretation.jl:3303
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3385
_typeinf at ./compiler/typeinfer.jl:246
typeinf at ./compiler/typeinfer.jl:212
typeinf_edge at ./compiler/typeinfer.jl:873
abstract_call_method at ./compiler/abstractinterpretation.jl:650
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:102
abstract_call_known at ./compiler/abstractinterpretation.jl:2182
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_apply at ./compiler/abstractinterpretation.jl:1672
abstract_call_known at ./compiler/abstractinterpretation.jl:2084
abstract_call at ./compiler/abstractinterpretation.jl:2264
abstract_call at ./compiler/abstractinterpretation.jl:2257
abstract_call at ./compiler/abstractinterpretation.jl:2402
abstract_eval_call at ./compiler/abstractinterpretation.jl:2417
abstract_eval_statement_expr at ./compiler/abstractinterpretation.jl:2433
abstract_eval_statement at ./compiler/abstractinterpretation.jl:2738
abstract_eval_basic_statement at ./compiler/abstractinterpretation.jl:3049
typeinf_local at ./compiler/abstractinterpretation.jl:3303
typeinf_nocycle at ./compiler/abstractinterpretation.jl:3385
_typeinf at ./compiler/typeinfer.jl:246
typeinf at ./compiler/typeinfer.jl:212
typeinf_ext at ./compiler/typeinfer.jl:1045
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1083
typeinf_ext_toplevel at ./compiler/typeinfer.jl:1079
jfptr_typeinf_ext_toplevel_39160.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
jl_type_infer at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:390
jl_generate_fptr_impl at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/jitlayers.cpp:511
jl_compile_method_internal at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:2534
_jl_invoke at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:2938 [inlined]
ijl_apply_generic at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/gf.c:3123
macro expansion at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:7 [inlined]
macro expansion at /Users/eschnett/.julia/packages/PrecompileTools/L8A3n/src/workloads.jl:78 [inlined]
top-level scope at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/precompile.jl:102
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:934
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:952 [inlined]
ijl_toplevel_eval_in at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:428 [inlined]
include_string at ./loading.jl:2543
_include at ./loading.jl:2603
include at ./Base.jl:558
jfptr_include_45969.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
jl_f__call_latest at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/builtins.c:875
include at /Users/eschnett/.julia/packages/Dagger/wwSWJ/src/Dagger.jl:1
unknown function (ip: 0x10bee6d32)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
do_call at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:126
eval_stmt_value at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:174
eval_body at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:659
jl_interpret_toplevel_thunk at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:817
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:943
jl_eval_module_expr at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:215 [inlined]
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:743
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:952 [inlined]
ijl_toplevel_eval_in at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:428 [inlined]
include_string at ./loading.jl:2543
_include at ./loading.jl:2603
include at ./Base.jl:558 [inlined]
include_package_for_output at ./loading.jl:2721
jfptr_include_package_for_output_69710.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
do_call at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:126
eval_stmt_value at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:174
eval_body at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:659
jl_interpret_toplevel_thunk at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/interpreter.c:817
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:943
jl_toplevel_eval_flex at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:886
ijl_toplevel_eval at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:952 [inlined]
ijl_toplevel_eval_in at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/toplevel.c:994
eval at ./boot.jl:428 [inlined]
include_string at ./loading.jl:2543
include_string at ./loading.jl:2553 [inlined]
exec_options at ./client.jl:316
_start at ./client.jl:526
jfptr__start_71207.1 at /Users/eschnett/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/lib/julia/sys.dylib (unknown line)
jl_apply at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/./julia.h:2154 [inlined]
true_main at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/jlapi.c:900
jl_repl_entrypoint at /Users/julia/.julia/scratchspaces/a66863c6-20e8-4ff4-8a62-49f30b1f605e/agent-cache/default-macmini-x64-4.0/build/default-macmini-x64-4-0/julialang/julia-release-1-dot-11/src/jlapi.c:1059
unknown function (ip: 0x0)
Allocations: 5080312 (Pool: 5080093; Big: 219); GC: 5
ERROR: InterruptException:
Stacktrace:
[1] try_yieldto(undo::typeof(Base.ensure_rescheduled))
@ Base ./task.jl:944
[2] wait()
@ Base ./task.jl:1008
[3] wait(c::Base.GenericCondition{Base.Threads.SpinLock}; first::Bool)
@ Base ./condition.jl:130
[4] wait
@ ./condition.jl:125 [inlined]
[5] wait(x::Base.Process, syncd::Bool)
@ Base ./process.jl:694
[6] wait
@ ./process.jl:687 [inlined]
[7] success(x::Base.Process)
@ Base ./process.jl:556
[8] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IO, internal_stdout::IO, keep_loaded_modules::Bool; flags::Cmd, cacheflags::Base.CacheFlags, reasons::Dict{…})
@ Base ./loading.jl:2910
[9] (::Base.var"#1074#1075"{Base.PkgId})()
@ Base ./loading.jl:2389
[10] mkpidlock(f::Base.var"#1074#1075"{Base.PkgId}, at::String, pid::Int32; kwopts::@Kwargs{stale_age::Int64, wait::Bool})
@ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:95
[11] #mkpidlock#6
@ ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:90 [inlined]
[12] trymkpidlock(::Function, ::Vararg{Any}; kwargs::@Kwargs{stale_age::Int64})
@ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:116
[13] #invokelatest#2
@ ./essentials.jl:1032 [inlined]
[14] invokelatest
@ ./essentials.jl:1027 [inlined]
[15] maybe_cachefile_lock(f::Base.var"#1074#1075"{Base.PkgId}, pkg::Base.PkgId, srcpath::String; stale_age::Int64)
@ Base ./loading.jl:3525
[16] maybe_cachefile_lock
@ ./loading.jl:3522 [inlined]
[17] _require(pkg::Base.PkgId, env::String)
@ Base ./loading.jl:2385
[18] __require_prelocked(uuidkey::Base.PkgId, env::String)
@ Base ./loading.jl:2217
[19] #invoke_in_world#3
@ ./essentials.jl:1064 [inlined]
[20] invoke_in_world
@ ./essentials.jl:1061 [inlined]
[21] _require_prelocked(uuidkey::Base.PkgId, env::String)
@ Base ./loading.jl:2208
[22] macro expansion
@ ./loading.jl:2148 [inlined]
[23] macro expansion
@ ./lock.jl:273 [inlined]
[24] __require(into::Module, mod::Symbol)
@ Base ./loading.jl:2105
[25] #invoke_in_world#3
@ ./essentials.jl:1064 [inlined]
[26] invoke_in_world
@ ./essentials.jl:1061 [inlined]
[27] require(into::Module, mod::Symbol)
@ Base ./loading.jl:2098
Some type information was truncated. Use `show(err)` to see complete types.
julia>
More of the error message:
julia> show(err)
1-element ExceptionStack:
InterruptException:
Stacktrace:
[1] try_yieldto(undo::typeof(Base.ensure_rescheduled))
@ Base ./task.jl:944
[2] wait()
@ Base ./task.jl:1008
[3] wait(c::Base.GenericCondition{Base.Threads.SpinLock}; first::Bool)
@ Base ./condition.jl:130
[4] wait
@ ./condition.jl:125 [inlined]
[5] wait(x::Base.Process, syncd::Bool)
@ Base ./process.jl:694
[6] wait
@ ./process.jl:687 [inlined]
[7] success(x::Base.Process)
@ Base ./process.jl:556
[8] compilecache(pkg::Base.PkgId, path::String, internal_stderr::IO, internal_stdout::IO, keep_loaded_modules::Bool; flags::Cmd, cacheflags::Base.CacheFlags, reasons::Dict{String, Int64})
@ Base ./loading.jl:2910
[9] (::Base.var"#1074#1075"{Base.PkgId})()
@ Base ./loading.jl:2389
[10] mkpidlock(f::Base.var"#1074#1075"{Base.PkgId}, at::String, pid::Int32; kwopts::@Kwargs{stale_age::Int64, wait::Bool})
@ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:95
[11] #mkpidlock#6
@ ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:90 [inlined]
[12] trymkpidlock(::Function, ::Vararg{Any}; kwargs::@Kwargs{stale_age::Int64})
@ FileWatching.Pidfile ~/.julia/juliaup/julia-1.11.0-beta1+0.x64.apple.darwin14/share/julia/stdlib/v1.11/FileWatching/src/pidfile.jl:116
[13] #invokelatest#2
@ ./essentials.jl:1032 [inlined]
[14] invokelatest
@ ./essentials.jl:1027 [inlined]
[15] maybe_cachefile_lock(f::Base.var"#1074#1075"{Base.PkgId}, pkg::Base.PkgId, srcpath::String; stale_age::Int64)
@ Base ./loading.jl:3525
[16] maybe_cachefile_lock
@ ./loading.jl:3522 [inlined]
[17] _require(pkg::Base.PkgId, env::String)
@ Base ./loading.jl:2385
[18] __require_prelocked(uuidkey::Base.PkgId, env::String)
@ Base ./loading.jl:2217
[19] #invoke_in_world#3
@ ./essentials.jl:1064 [inlined]
[20] invoke_in_world
@ ./essentials.jl:1061 [inlined]
[21] _require_prelocked(uuidkey::Base.PkgId, env::String)
@ Base ./loading.jl:2208
[22] macro expansion
@ ./loading.jl:2148 [inlined]
[23] macro expansion
@ ./lock.jl:273 [inlined]
[24] __require(into::Module, mod::Symbol)
@ Base ./loading.jl:2105
[25] #invoke_in_world#3
@ ./essentials.jl:1064 [inlined]
[26] invoke_in_world
@ ./essentials.jl:1061 [inlined]
[27] require(into::Module, mod::Symbol)
@ Base ./loading.jl:2098
@JamesWrigley I think this is the same issue we're sometimes seeing on MacOS CI.
You mean race conditions within the scheduler? :thinking: TBH I can't really tell from the logs what's happening.
Is there a way to dump the internal state of the scheduler? If you have a patch (branch) that would e.g. do that every second (or minute?) then I could run this locally and report. I'd also be happy to have a Zoom session where you look at things looking over my shoulder.
I cannot install Dagger on the recently-released beta version of Julia 1.11 on macOS:
The
main
branch of Dagger can be installed, but I can neither precompile norusing
it.