search

seung-lab / Agglomeration

Enlarging your supervoxels
MIT License
1 stars 0 forks source link

problem for parallel usage #11

Closed xiuliren closed 7 years ago

xiuliren commented 7 years ago

I would like to try to pluralize the computations, but the Process was only imported in the master process.

julia -p 2
               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "?help" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.5.0 (2016-09-19 18:14 UTC)
 _/ |\__'_|_|_|\__'_|  |  Official http://julialang.org/ release
|__/                   |  x86_64-pc-linux-gnu

julia> @everywhere using Agglomerat
Agglomeration Agglomerators
julia> @everywhere using Agglomerat
Agglomeration Agglomerators
julia> @everywhere using Agglomeration
INFO: Recompiling stale cache file /usr/people/jingpeng/.julia/lib/v0.5/Agglomeration.ji for module Agglomeration.
WARNING: replacing module Agglomeration.
WARNING: replacing module Agglomeration.

julia> @ev
@eval       @evalpoly    @everywhere
julia> @ev
@eval       @evalpoly    @everywhere
julia> @everywhere using Process
INFO: Recompiling stale cache file /usr/people/jingpeng/.julia/lib/v0.5/RegionGraphs.ji for module RegionGraphs.
INFO: Recompiling stale cache file /usr/people/jingpeng/.julia/lib/v0.5/Agglomerators.ji for module Agglomerators.

WARNING: deprecated syntax "call(agg::RandomForestAgglomerator, ...)".
Use "(agg::RandomForestAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.AccumulatingAgglomerator, ...)".
Use "(agg::Agglomerators.AccumulatingAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.AccumulatingAgglomerator, ...)".
Use "(agg::Agglomerators.AccumulatingAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.ConstrainedAgglomerator, ...)".
Use "(agg::Agglomerators.ConstrainedAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.ConstrainedAgglomerator, ...)".
Use "(agg::Agglomerators.ConstrainedAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.LinearAgglomerator, ...)".
Use "(agg::Agglomerators.LinearAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.LinearAgglomerator, ...)".
Use "(agg::Agglomerators.LinearAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.MaxAffinityAgglomerator, ...)".
Use "(agg::Agglomerators.MaxAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.MaxAffinityAgglomerator, ...)".
Use "(agg::Agglomerators.MaxAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.MeanAffinityAgglomerator, ...)".
Use "(agg::Agglomerators.MeanAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.MeanAffinityAgglomerator, ...)".
Use "(agg::Agglomerators.MeanAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.RandomForestAgglomerator, ...)".
Use "(agg::Agglomerators.RandomForestAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.RandomForestAgglomerator, ...)".
Use "(agg::Agglomerators.RandomForestAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.SmoothedMeanAffinityAgglomerator, ...)".
Use "(agg::Agglomerators.SmoothedMeanAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::Agglomerators.SmoothedMeanAffinityAgglomerator, ...)".
Use "(agg::Agglomerators.SmoothedMeanAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::TeacherAgglomerator, ...)".
Use "(agg::TeacherAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::GatedAgglomerator, ...)".
Use "(agg::GatedAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::AccumulatingGatedAgglomerator, ...)".
Use "(agg::AccumulatingGatedAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::LinearAgglomerator, ...)".
Use "(agg::LinearAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::AccumulatingAgglomerator, ...)".
Use "(agg::AccumulatingAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::ConstrainedAgglomerator, ...)".
Use "(agg::ConstrainedAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::MeanAffinityAgglomerator, ...)".
Use "(agg::MeanAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::MaxAffinityAgglomerator, ...)".
Use "(agg::MaxAffinityAgglomerator)(...)" instead.

WARNING: deprecated syntax "call(agg::SmoothedMeanAffinityAgglomerator, ...)".
Use "(agg::SmoothedMeanAffinityAgglomerator)(...)" instead.
INFO: Recompiling stale cache file /usr/people/jingpeng/.julia/lib/v0.5/SegmentationMetrics.ji for module SegmentationMetrics.
INFO: Recompiling stale cache file /usr/people/jingpeng/.julia/lib/v0.5/MSTs.ji for module MSTs.
WARNING: Base.CPU_CORES is deprecated.
  likely near /usr/people/jingpeng/.julia/v0.5/Agglomeration/src/MSTs.jl:6
in blosc_filter at /usr/people/jingpeng/.julia/v0.5/HDF5/src/blosc_filter.jl
WARNING: Base.CPU_CORES is deprecated.
  likely near /usr/people/jingpeng/.julia/v0.5/Agglomeration/src/MSTs.jl:6
in blosc_filter at /usr/people/jingpeng/.julia/v0.5/HDF5/src/blosc_filter.jl
WARNING: Base.CPU_CORES is deprecated.
  likely near /usr/people/jingpeng/.julia/v0.5/Agglomeration/src/Process.jl:6
in blosc_filter at /usr/people/jingpeng/.julia/v0.5/HDF5/src/blosc_filter.jl
WARNING: Base.CPU_CORES is deprecated.
  likely near /usr/people/jingpeng/.julia/v0.5/Agglomeration/src/Process.jl:6
in blosc_filter at /usr/people/jingpeng/.julia/v0.5/HDF5/src/blosc_filter.jl
WARNING: replacing module Process
WARNING: replacing module Process
ERROR: On worker 2:
LoadError: can only precompile from node 1
 in compilecache at ./loading.jl:560
 in require at ./loading.jl:393
 in include_string at ./loading.jl:441
 in include_from_node1 at ./loading.jl:491
 in eval at ./boot.jl:234
 in require at ./loading.jl:415
 in eval at ./boot.jl:234
 in #5 at ./multi.jl:1957
 in #625 at ./multi.jl:1421
 in run_work_thunk at ./multi.jl:1001
 in macro expansion at ./multi.jl:1421 [inlined]
 in #624 at ./event.jl:68
while loading /usr/people/jingpeng/.julia/v0.5/Agglomeration/src/Process.jl, in expression starting on line 4
 in #remotecall_fetch#606(::Array{Any,1}, ::Function, ::Function, ::Base.Worker) at ./multi.jl:1070
 in remotecall_fetch(::Function, ::Base.Worker) at ./multi.jl:1062
 in #remotecall_fetch#609(::Array{Any,1}, ::Function, ::Function, ::Int64) at ./multi.jl:1080
 in remotecall_fetch(::Function, ::Int64) at ./multi.jl:1080
 in (::##6#8)() at ./multi.jl:1959

...and 2 other exceptions.

 in sync_end() at ./task.jl:311
 in macro expansion; at ./multi.jl:1968 [inlined]
 in anonymous at ./<missing>:?
jonathanzung commented 7 years ago

Can you try running using Agglomeration, Process on node 1, and afterwards run @everywhere using Agglomeration, Process?

xiuliren commented 7 years ago

works, thanks!