search

KristofferC / NearestNeighbors.jl

High performance nearest neighbor data structures (KDTree and BallTree) and algorithms for Julia.
Other
413 stars 65 forks source link

Julia 1.10 is waiting on IO to finish during compilation #164

Closed SimonDanisch closed 9 months ago

SimonDanisch commented 1 year ago

I get this during compilation:

┌ NearestNeighbors [b8a86587-4115-5ab1-83bc-aa920d37bbce]
│  [pid 26292] waiting for IO to finish:
│   TYPE[FD/PID]       @UV_HANDLE_T->DATA
│   timer              @00000243db2d3ee0->00000243da682620

Doesn't seem to happen if I delete the compiled libraries for only NearestNeighbors after compiling the whole package. Does reproduce, if I wipe all compiled dependencies! Not sure what could need waiting here? 

julia> versioninfo()
Julia Version 1.10.0-beta2
Commit a468aa198d (2023-08-17 06:27 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Windows (x86_64-w64-mingw32)
  CPU: 24 × AMD Ryzen 9 7900X 12-Core Processor
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
  Threads: 35 on 24 virtual cores
Environment:
  JULIA_MAX_NUM_PRECOMPILE_FILES = 20
  JULIA_NUM_PRECOMPILE_TASKS = 24
  JULIA_NUM_THREADS = auto
  JULIA_PKG_PRECOMPILE_AUTO = 0
KristofferC commented 1 year ago

I wonder if this is not from one of the dependencies. Perhaps some __init__ method?

SimonDanisch commented 1 year ago

Ah, I've seen an issue where this would print for Pkg extensions + parallel precompilation, so maybe it's this: https://github.com/JuliaStats/Distances.jl/blob/master/src/Distances.jl#L122-L124 See: https://github.com/JuliaLang/julia/issues/50706

KristofferC commented 9 months ago

I don't think this is an issue with this package since it doesn't have an __init__ method. I think it is some Pkg problem (that is hopefully fixed) regarding extensions and precompilation.