In regards to: "docker: error while loading shared libraries: libltdl.so.7: cannot open shared object file: No such file or directory" on GranColoso Server

Hi, I am Sebastián Rodríguez (the engineer working for Hector Allende), and in a previous step before reinstalling the OS on that machine, I remove, purge and then reinstall the latest version of docker (docker-ce).

This spawned this error when someone follows the steps in both of these documents: src/docker and DistributedMachineLearningThesis.

docker: error while loading shared libraries: libltdl.so.7: cannot open shared object file: No such file or directory

The first step I have done to remove this problem is adding Hector's user to the docker group: sudo usermog -aG docker hallende

The second step I have done is that I noticed in the Dockerfile that docker.io is installed, which probably causes conflicts in the volume parameter of docker run: docker run --cpus 1 -tid -v /var/run/docker.sock:/var/run/docker.sock -v $DOCKERBIN:/usr/bin/docker -v /tmp/results:/DistributedMachineLearningThesis/src/results dmlt.

So I replaced line 18 of the Dockerfile with:

# Docker
RUN apt update
RUN apt-get install -y apt-transport-https ca-certificates curl software-properties-common
RUN curl -fsSL https://download.docker.com/linux/ubuntu/gpg | apt-key add -
RUN apt-key fingerprint 0EBFCD88
RUN add-apt-repository "deb [arch=amd64] https://download.docker.com/linux/ubuntu $(lsb_release -cs) stable"
RUN apt update
RUN apt-get install -y docker-ce

This should install the same version in both the container and GranColoso, mainly avoiding compatibility issues. Moreover, running the main container without this modification and without the -v $DOCKERBIN:/usr/bin/docker parameter shows the following results:

hallende@GranColoso:~/newDistributed/DistributedMachineLearningThesis/src$ CID=$(docker run --cpus 1 -tid -v /var/run/docker.sock:/var/run/docker.sock -v /tmp/results:/DistributedMachineLearningThesis/src/results dmlt) && docker exec -ti $CID /bin/bash
root@6813a5557972:/# docker --version
Docker version 1.6.2, build 7c8fca2

The last line shows the potential incompatibility problem, given that the installed version of docker shows the following output: Docker version 18.06.1-ce, build e68fc7a.

Now with the proposed correction in the Dockerfile and the instructions of src/docker in the Julia console I get these results:

               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: https://docs.julialang.org
   _ _   _| |_  __ _   |  Type "?help" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.6.2 (2017-12-13 18:08 UTC)
 _/ |\__'_|_|_|\__'_|  |  Official http://julialang.org/ release
|__/                   |  x86_64-pc-linux-gnu

julia> include("docker/DockerizedJuliaWorker.jl")
INFO: Executing command `docker -v`...
INFO: Docker installed!
test_dockerworker (generic function with 1 method)

julia> adddockerworkers(5) # add 5 Docker workers
INFO: Deploying Docker 5 container(s) and initialize their SSH daemon...
INFO: Executing command `docker run -tid --cpus 1 -m 2048000000 dmlt`...
INFO: Container da247c9777016701d14bd7cac65aa52625044429b892f868a4206929d5034fec is up
INFO: Executing command `docker exec da247c9777016701d14bd7cac65aa52625044429b892f868a4206929d5034fec /usr/sbin/sshd`...
INFO: Getting containers' IP address(es)...
INFO: Executing command `docker inspect '--format={{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' da247c9777016701d14bd7cac65aa52625044429b892f868a4206929d5034fec`...
INFO: Containers' IP address is 172.17.0.2
INFO: Executing command `docker run -tid --cpus 1 -m 2048000000 dmlt`...
INFO: Container 51ff41973d6dc85571a8c6840bf58b7bffb02480120de71a9c2f77f954ace487 is up
INFO: Executing command `docker exec 51ff41973d6dc85571a8c6840bf58b7bffb02480120de71a9c2f77f954ace487 /usr/sbin/sshd`...
INFO: Getting containers' IP address(es)...
INFO: Executing command `docker inspect '--format={{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' 51ff41973d6dc85571a8c6840bf58b7bffb02480120de71a9c2f77f954ace487`...
INFO: Containers' IP address is 172.17.0.3
INFO: Executing command `docker run -tid --cpus 1 -m 2048000000 dmlt`...
INFO: Container c425ba88b94b858358c64ad6b0993d03d8c07737b69fccf2deabd20095ccef0a is up
INFO: Executing command `docker exec c425ba88b94b858358c64ad6b0993d03d8c07737b69fccf2deabd20095ccef0a /usr/sbin/sshd`...
INFO: Getting containers' IP address(es)...
INFO: Executing command `docker inspect '--format={{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' c425ba88b94b858358c64ad6b0993d03d8c07737b69fccf2deabd20095ccef0a`...
INFO: Containers' IP address is 172.17.0.4
INFO: Executing command `docker run -tid --cpus 1 -m 2048000000 dmlt`...
INFO: Container 7132ec329f1e11a4f561a8f41e54a67251e15849a9171a04b85f6fef263de633 is up
INFO: Executing command `docker exec 7132ec329f1e11a4f561a8f41e54a67251e15849a9171a04b85f6fef263de633 /usr/sbin/sshd`...
INFO: Getting containers' IP address(es)...
INFO: Executing command `docker inspect '--format={{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' 7132ec329f1e11a4f561a8f41e54a67251e15849a9171a04b85f6fef263de633`...
INFO: Containers' IP address is 172.17.0.5
INFO: Executing command `docker run -tid --cpus 1 -m 2048000000 dmlt`...
INFO: Container e26b3074868af97b03bd13d604781367082e23963f487ec6b97e92bec8d15b8d is up
INFO: Executing command `docker exec e26b3074868af97b03bd13d604781367082e23963f487ec6b97e92bec8d15b8d /usr/sbin/sshd`...
INFO: Getting containers' IP address(es)...
INFO: Executing command `docker inspect '--format={{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' e26b3074868af97b03bd13d604781367082e23963f487ec6b97e92bec8d15b8d`...
INFO: Containers' IP address is 172.17.0.6
INFO: Creating 5 Worker(s) through SSH...
Warning: Permanently added '172.17.0.5' (ECDSA) to the list of known hosts.
Warning: Permanently added '172.17.0.2' (ECDSA) to the list of known hosts.
Warning: Permanently added '172.17.0.3' (ECDSA) to the list of known hosts.
Warning: Permanently added '172.17.0.4' (ECDSA) to the list of known hosts.
Warning: Permanently added '172.17.0.6' (ECDSA) to the list of known hosts.
stdin: is not a tty
stdin: is not a tty
stdin: is not a tty
stdin: is not a tty
stdin: is not a tty
INFO: Creating 5 Worker(s) through SSH... DONE.
                        Workers' PIDs are
[2, 3, 4, 5, 6]
INFO: Getting Workers' container IDs to update the pids-cid Dict...
5-element Array{Int64,1}:
 2
 3
 4
 5
 6

julia> #adddockerworkers(5,_prototype=true,grancoloso=true) # for DML prototyping at GranColoso
       for i=1:10; @show @fetch myid(); end
@fetch(myid()) = 2
@fetch(myid()) = 3
@fetch(myid()) = 4
@fetch(myid()) = 5
@fetch(myid()) = 6
@fetch(myid()) = 2
@fetch(myid()) = 3
@fetch(myid()) = 4
@fetch(myid()) = 5
@fetch(myid()) = 6

julia> rmalldockerworkers() #remove all workers and containers
INFO: There's no worker with the pid 2
WARNING: No Dockerized Worker to be deleted!

StackFrame[rmdockerworkers(::Array{Int64,1}) at DockerizedJuliaWorker.jl:108, rmalldockerworkers() at DockerizedJuliaWorker.jl:116, eval(::Module, ::Any) at boot.jl:235, eval_user_input(::Any, ::Base.REPL.REPLBackend) at REPL.jl:66, macro expansion at REPL.jl:97 [inlined], (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at event.jl:73]

StackFrame[rmdockerworkers(::Array{Int64,1}) at DockerizedJuliaWorker.jl:104, rmalldockerworkers() at DockerizedJuliaWorker.jl:116, eval(::Module, ::Any) at boot.jl:235, eval_user_input(::Any, ::Base.REPL.REPLBackend) at REPL.jl:66, macro expansion at REPL.jl:97 [inlined], (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at event.jl:73]
4-element Array{Int64,1}:
 3
 4
 5
 6

Finally, following the instructions of the root folder of the repository I am getting these results:}

               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: https://docs.julialang.org
   _ _   _| |_  __ _   |  Type "?help" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.6.2 (2017-12-13 18:08 UTC)
 _/ |\__'_|_|_|\__'_|  |  Official http://julialang.org/ release
|__/                   |  x86_64-pc-linux-gnu

julia> include("call_experiment.jl")
INFO: Precompiling module Clustering.

WARNING: deprecated syntax "abstract ClusteringResult" at /root/.julia/v0.6/Clustering/src/utils.jl:6.
Use "abstract type ClusteringResult end" instead.

WARNING: deprecated syntax "abstract SeedingAlgorithm" at /root/.julia/v0.6/Clustering/src/seeding.jl:21.
Use "abstract type SeedingAlgorithm end" instead.
INFO: Precompiling module Memento.
Configuring Mocha...
 * CUDA       disabled by default
 * Native Ext disabled by default
Mocha configured, continue loading module...
INFO: Precompiling module HDF5.
INFO: Precompiling module JLD.
DefaultBackend = Mocha.CPUBackend

WARNING: deprecated syntax "inner constructor Whitening(...) around /root/.julia/v0.6/MultivariateStats/src/whiten.jl:32".
Use "Whitening{T}(...) where T" instead.

WARNING: deprecated syntax "abstract Discriminant{T}" at /root/.julia/v0.6/MultivariateStats/src/lda.jl:6.
Use "abstract type Discriminant{T} end" instead.

WARNING: deprecated syntax "abstract ICAGDeriv" at /root/.julia/v0.6/MultivariateStats/src/ica.jl:28.
Use "abstract type ICAGDeriv end" instead.
INFO: Precompiling module Logging.
WARNING: Method definition info(Any...) in module Base at util.jl:534 overwritten in module Logging at /root/.julia/v0.6/Logging/src/Logging.jl:115.
WARNING: Method definition warn(Any...) in module Base at util.jl:589 overwritten in module Logging at /root/.julia/v0.6/Logging/src/Logging.jl:115.
WARNING: Method definition info(Any...) in module Base at util.jl:534 overwritten in module Logging at /root/.julia/v0.6/Logging/src/Logging.jl:115.
WARNING: Method definition warn(Any...) in module Base at util.jl:589 overwritten in module Logging at /root/.julia/v0.6/Logging/src/Logging.jl:115.
WARNING: static parameter R does not occur in signature for catvaluetype at /root/.julia/v0.6/CategoricalArrays/src/value.jl:52.
The method will not be callable.
experiment (generic function with 2 methods)

julia> args =["3", "20", "f1", "1234", "4", "2"]
6-element Array{String,1}:
 "3"
 "20"
 "f1"
 "1234"
 "4"
 "2"

julia> experiment(args)

28-Sep 15:07:28:WARNING:root:rmprocs: process 1 not removed
28-Sep 15:07:28:WARNING:root:No Dockerized Worker to be deleted!

StackFrame[rmdockerworkers(::Array{Int64,1}) at DockerizedJuliaWorker.jl:108, experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at call_experiment.jl:20, eval(::Module, ::Any) at boot.jl:235, eval_user_input(::Any, ::Base.REPL.REPLBackend) at REPL.jl:66, macro expansion at REPL.jl:97 [inlined], (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at event.jl:73]

StackFrame[rmdockerworkers(::Array{Int64,1}) at DockerizedJuliaWorker.jl:104, experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at call_experiment.jl:20, eval(::Module, ::Any) at boot.jl:235, eval_user_input(::Any, ::Base.REPL.REPLBackend) at REPL.jl:66, macro expansion at REPL.jl:97 [inlined], (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at event.jl:73]
4
2
Warning: Permanently added '172.17.0.8' (ECDSA) to the list of known hosts.
Warning: Permanently added '172.17.0.7' (ECDSA) to the list of known hosts.
Warning: Permanently added '172.17.0.9' (ECDSA) to the list of known hosts.
stdin: is not a tty
stdin: is not a tty
stdin: is not a tty
28-Sep 15:07:35:INFO:root:Including workers code and functions...

WARNING: deprecated syntax "inner constructor Whitening(...) around /root/.julia/v0.6/MultivariateStats/src/whiten.jl:32".
Use "Whitening{T}(...) where T" instead.

WARNING: deprecated syntax "inner constructor Whitening(...) around /root/.julia/v0.6/MultivariateStats/src/whiten.jl:32".
Use "Whitening{T}(...) where T" instead.

WARNING: deprecated syntax "inner constructor Whitening(...) around /root/.julia/v0.6/MultivariateStats/src/whiten.jl:32".
Use "Whitening{T}(...) where T" instead.

WARNING: deprecated syntax "abstract Discriminant{T}" at /root/.julia/v0.6/MultivariateStats/src/lda.jl:6.
Use "abstract type Discriminant{T} end" instead.

WARNING: deprecated syntax "abstract ICAGDeriv" at /root/.julia/v0.6/MultivariateStats/src/ica.jl:28.
Use "abstract type ICAGDeriv end" instead.

WARNING: deprecated syntax "abstract Discriminant{T}" at /root/.julia/v0.6/MultivariateStats/src/lda.jl:6.
Use "abstract type Discriminant{T} end" instead.

WARNING: deprecated syntax "abstract Discriminant{T}" at /root/.julia/v0.6/MultivariateStats/src/lda.jl:6.
Use "abstract type Discriminant{T} end" instead.

WARNING: deprecated syntax "abstract ICAGDeriv" at /root/.julia/v0.6/MultivariateStats/src/ica.jl:28.
Use "abstract type ICAGDeriv end" instead.

WARNING: deprecated syntax "abstract ICAGDeriv" at /root/.julia/v0.6/MultivariateStats/src/ica.jl:28.
Use "abstract type ICAGDeriv end" instead.
28-Sep 15:07:40:INFO:root:There's no worker with the pid 2
        From worker 2:  Configuring Mocha...
        From worker 2:   * CUDA       disabled by default
        From worker 2:   * Native Ext disabled by default
        From worker 2:  Mocha configured, continue loading module...
        From worker 3:  Configuring Mocha...
        From worker 3:   * CUDA       disabled by default
        From worker 3:   * Native Ext disabled by default
        From worker 3:  Mocha configured, continue loading module...
        From worker 4:  Configuring Mocha...
        From worker 4:   * CUDA       disabled by default
        From worker 4:   * Native Ext disabled by default
        From worker 4:  Mocha configured, continue loading module...
        From worker 2:  DefaultBackend = Mocha.CPUBackend
        From worker 3:  DefaultBackend = Mocha.CPUBackend
        From worker 4:  DefaultBackend = Mocha.CPUBackend
28-Sep 15:07:46:INFO:root:There's no worker with the pid 2
28-Sep 15:07:49:INFO:root:Generating datasets and calculating maximums and minimums

28-Sep 15:07:52:INFO:root:There's no worker with the pid 2
        From worker 4:  elapsed time: 0.424008054 seconds
WOOORKED!
        From worker 2:  elapsed time: 0.438608386 seconds
WOOORKED!
        From worker 3:  elapsed time: 0.643332578 seconds
WOOORKED!
elapsed time: 4.488063049 seconds
28-Sep 15:07:53:INFO:root:
 Merged maxmim logs
28-Sep 15:07:53:INFO:root:./results/executing/calculate_maxmin deleted
28-Sep 15:07:53:INFO:root:We have 2 attributes and 1000 examples

28-Sep 15:07:53:INFO:root:Calculating global max and global min...

28-Sep 15:07:53:INFO:root:Calculating histograms...
elapsed time: 0.684775258 seconds
28-Sep 15:07:54:INFO:root:Training local models

28-Sep 15:07:54:INFO:root:Calculating neighborhoods...

WARNING: Array(::Type{T}, m::Int) where T is deprecated, use Array{T}(m) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Int64}, ::Int64) at ./deprecated.jl:57
 [3] initseeds(::Clustering.KmCentralityAlg, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/seeding.jl:22
 [4] initseeds(::Symbol, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/seeding.jl:34
 [5] #kmeans#2(::Void, ::Symbol, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/kmeans.jl:51
 [6] (::Clustering.#kw##kmeans)(::Array{Any,1}, ::Clustering.#kmeans, ::Array{Float64,2}, ::Int64) at ./<missing>:0
 [7] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:76
 [8] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [9] macro expansion at ./task.jl:302 [inlined]
 [10] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [11] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [12] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [13] eval(::Module, ::Any) at ./boot.jl:235
 [14] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [15] macro expansion at ./REPL.jl:97 [inlined]
 [16] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0
28-Sep 15:08:01:INFO:root:There's no worker with the pid 2
WARNING: Array(::Type{T}, m::Int, n::Int) where T is deprecated, use Array{T}(m, n) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Float64}, ::Int64, ::Int64) at ./deprecated.jl:57
 [3] #kmeans#2(::Void, ::Symbol, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/kmeans.jl:52
 [4] (::Clustering.#kw##kmeans)(::Array{Any,1}, ::Clustering.#kmeans, ::Array{Float64,2}, ::Int64) at ./<missing>:0
 [5] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:76
 [6] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [7] macro expansion at ./task.jl:302 [inlined]
 [8] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [9] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [10] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [11] eval(::Module, ::Any) at ./boot.jl:235
 [12] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [13] macro expansion at ./REPL.jl:97 [inlined]
 [14] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0
        From worker 2:  [2018-09-28 15:08:00 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...WARNING: Array(::Type{T}, m::Int) where T is deprecated, use Array{T}(m) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Int64}, ::Int64) at ./deprecated.jl:57
 [3] #kmeans!#1(::Void, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Array{Float64,2}) at /root/.julia/v0.6/Clustering/src/kmeans.jl:34
 [4] (::Clustering.#kw##kmeans!)(::Array{Any,1}, ::Clustering.#kmeans!, ::Array{Float64,2}, ::Array{Float64,2}) at ./<missing>:0
 [5] #kmeans#2(::Void, ::Symbol, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/kmeans.jl:53
 [6] (::Clustering.#kw##kmeans)(::Array{Any,1}, ::Clustering.#kmeans, ::Array{Float64,2}, ::Int64) at ./<missing>:0
 [7] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:76
 [8] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [9] macro expansion at ./task.jl:302 [inlined]
 [10] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [11] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [12] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [13] eval(::Module, ::Any) at ./boot.jl:235
 [14] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [15] macro expansion at ./REPL.jl:97 [inlined]
 [16] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0

WARNING: Array(::Type{T}, m::Int) where T is deprecated, use Array{T}(m) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Float64}, ::Int64) at ./deprecated.jl:57
 [3] #kmeans!#1(::Void, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Array{Float64,2}) at /root/.julia/v0.6/Clustering/src/kmeans.jl:35
 [4] (::Clustering.#kw##kmeans!)(::Array{Any,1}, ::Clustering.#kmeans!, ::Array{Float64,2}, ::Array{Float64,2}) at ./<missing>:0
 [5] #kmeans#2(::Void, ::Symbol, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/kmeans.jl:53
 [6] (::Clustering.#kw##kmeans)(::Array{Any,1}, ::Clustering.#kmeans, ::Array{Float64,2}, ::Int64) at ./<missing>:0
 [7] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:76
 [8] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [9] macro expansion at ./task.jl:302 [inlined]
 [10] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [11] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [12] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [13] eval(::Module, ::Any) at ./boot.jl:235
 [14] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [15] macro expansion at ./REPL.jl:97 [inlined]
 [16] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0
        From worker 2:  [2018-09-28 15:08:00 | info | Mocha]: Topological sorting 5 layers...WARNING: Array(::Type{T}, m::Int) where T is deprecated, use Array{T}(m) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Bool}, ::Int64) at ./deprecated.jl:57
 [3] _kmeans!(::Array{Float64,2}, ::Void, ::Array{Float64,2}, ::Array{Int64,1}, ::Array{Float64,1}, ::Array{Int64,1}, ::Array{Float64,1}, ::Int64, ::Float64, ::Int64) at /root/.julia/v0.6/Clustering/src/kmeans.jl:78
 [4] #kmeans!#1(::Void, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Array{Float64,2}) at /root/.julia/v0.6/Clustering/src/kmeans.jl:37
 [5] (::Clustering.#kw##kmeans!)(::Array{Any,1}, ::Clustering.#kmeans!, ::Array{Float64,2}, ::Array{Float64,2}) at ./<missing>:0
 [6] #kmeans#2(::Void, ::Symbol, ::Int64, ::Float64, ::Symbol, ::Function, ::Array{Float64,2}, ::Int64) at /root/.julia/v0.6/Clustering/src/kmeans.jl:53
 [7] (::Clustering.#kw##kmeans)(::Array{Any,1}, ::Clustering.#kmeans, ::Array{Float64,2}, ::Int64) at ./<missing>:0
 [8] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:76
 [9] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [10] macro expansion at ./task.jl:302 [inlined]
 [11] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [12] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [13] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [14] eval(::Module, ::Any) at ./boot.jl:235
 [15] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [16] macro expansion at ./REPL.jl:97 [inlined]
 [17] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0

WARNING: Array(::Type{T}, m::Int) where T is deprecated, use Array{T}(m) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Float64}, ::Int64) at ./deprecated.jl:57
 [3] silhouettes(::Array{Int64,1}, ::Array{Int64,1}, ::Array{Float64,2}) at /root/.julia/v0.6/Clustering/src/silhouette.jl:53
 [4] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:77
 [5] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [6] macro expansion at ./task.jl:302 [inlined]
 [7] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [8] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [9] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [10] eval(::Module, ::Any) at ./boot.jl:235
 [11] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [12] macro expansion at ./REPL.jl:97 [inlined]
 [13] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0
        From worker 2:  [2018-09-28 15:08:00 | info | Mocha]: Setup layers...WARNING: Array(::Type{T}, m::Int) where T is deprecated, use Array{T}(m) instead.
Stacktrace:
 [1] depwarn(::String, ::Symbol) at ./deprecated.jl:70
 [2] Array(::Type{Float64}, ::Int64) at ./deprecated.jl:57
 [3] silhouettes(::Array{Int64,1}, ::Array{Int64,1}, ::Array{Float64,2}) at /root/.julia/v0.6/Clustering/src/silhouette.jl:54
 [4] create_neighborhoods_stats_kmeans(::Array{Any,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:77
 [5] macro expansion at /DistributedMachineLearningThesis/src/master_summary.jl:295 [inlined]
 [6] macro expansion at ./task.jl:302 [inlined]
 [7] run_experiments(::Int64, ::Int64, ::String, ::Int64, ::Int64) at /DistributedMachineLearningThesis/src/master_summary.jl:275
 [8] execute_experiment(::Array{String,1}) at /DistributedMachineLearningThesis/src/master_summary.jl:508
 [9] experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at /DistributedMachineLearningThesis/src/call_experiment.jl:21
 [10] eval(::Module, ::Any) at ./boot.jl:235
 [11] eval_user_input(::Any, ::Base.REPL.REPLBackend) at ./REPL.jl:66
 [12] macro expansion at ./REPL.jl:97 [inlined]
 [13] (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at ./event.jl:73
while loading no file, in expression starting on line 0

        From worker 2:  [2018-09-28 15:08:01 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:01 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 2:  [2018-09-28 15:08:01 | info | Mocha]: Topological sorting 5 layers...
        From worker 2:  [2018-09-28 15:08:01 | info | Mocha]: Setup layers...
        From worker 2:  [2018-09-28 15:08:01 | info | Mocha]: Network constructed!
        From worker 2:  Creating snapshots dir for worker 2...
        From worker 2:  Adding coffee breaks...
        From worker 4:  [2018-09-28 15:08:00 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:00 | info | Mocha]: Topological sorting 5 layers...
        From worker 4:  [2018-09-28 15:08:00 | info | Mocha]: Setup layers...
        From worker 4:  [2018-09-28 15:08:01 | info | Mocha]: Network constructed!
        From worker 4:  [2018-09-28 15:08:01 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:01 | info | Mocha]: Topological sorting 5 layers...
        From worker 4:  [2018-09-28 15:08:01 | info | Mocha]: Setup layers...
        From worker 4:  [2018-09-28 15:08:01 | info | Mocha]: Network constructed!
        From worker 4:  Creating snapshots dir for worker 4...
        From worker 4:  Adding coffee breaks...
        From worker 3:  [2018-09-28 15:08:00 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 3:  [2018-09-28 15:08:00 | info | Mocha]: Topological sorting 5 layers...
        From worker 3:  [2018-09-28 15:08:00 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:01 | info | Mocha]: Network constructed!
        From worker 3:  [2018-09-28 15:08:01 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 3:  [2018-09-28 15:08:01 | info | Mocha]: Topological sorting 5 layers...
        From worker 3:  [2018-09-28 15:08:01 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:01 | info | Mocha]: Network constructed!
        From worker 3:  Creating snapshots dir for worker 3...
        From worker 3:  Adding coffee breaks...
0.04287619771753084
elapsed time: 6.004572004 seconds
        From worker 2:  [2018-09-28 15:08:02 | info | Mocha]: Merging existing coffee lounge statistics in Snapshots/snapshots_2/statistics.jld
        From worker 4:  [2018-09-28 15:08:02 | info | Mocha]: Merging existing coffee lounge statistics in Snapshots/snapshots_4/statistics.jld
        From worker 3:  [2018-09-28 15:08:02 | info | Mocha]: Merging existing coffee lounge statistics in Snapshots/snapshots_3/statistics.jld
        From worker 2:  [2018-09-28 15:08:03 | info | Mocha]: Snapshot directory Snapshots/snapshots_2 already exists
        From worker 4:  [2018-09-28 15:08:03 | info | Mocha]: Snapshot directory Snapshots/snapshots_4 already exists
        From worker 2:  [2018-09-28 15:08:03 | info | Mocha]:  TRAIN iter=000000 obj_val=0.25455836
        From worker 2:  [2018-09-28 15:08:03 | info | Mocha]: Saving snapshot to snapshot-000000.jld...
        From worker 2:  [2018-09-28 15:08:03 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-000000.jld...
        From worker 3:  [2018-09-28 15:08:03 | info | Mocha]: Snapshot directory Snapshots/snapshots_3 already exists
        From worker 4:  [2018-09-28 15:08:03 | info | Mocha]:  TRAIN iter=000000 obj_val=0.18286765
        From worker 4:  [2018-09-28 15:08:03 | info | Mocha]: Saving snapshot to snapshot-000000.jld...
        From worker 4:  [2018-09-28 15:08:03 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-000000.jld...
        From worker 3:  [2018-09-28 15:08:04 | info | Mocha]:  TRAIN iter=000000 obj_val=0.06033732
        From worker 3:  [2018-09-28 15:08:04 | info | Mocha]: Saving snapshot to snapshot-000000.jld...
        From worker 3:  [2018-09-28 15:08:04 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-000000.jld...
28-Sep 15:08:07:INFO:root:There's no worker with the pid 2
        From worker 2:  [2018-09-28 15:08:08 | info | Mocha]:  TRAIN iter=001000 obj_val=0.00491524
        From worker 2:  [2018-09-28 15:08:08 | info | Mocha]: Saving snapshot to snapshot-001000.jld...
        From worker 2:  [2018-09-28 15:08:08 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-001000.jld...
        From worker 4:  [2018-09-28 15:08:08 | info | Mocha]:  TRAIN iter=001000 obj_val=0.00307874
        From worker 4:  [2018-09-28 15:08:08 | info | Mocha]: Saving snapshot to snapshot-001000.jld...
        From worker 4:  [2018-09-28 15:08:08 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-001000.jld...
        From worker 2:  [2018-09-28 15:08:08 | info | Mocha]:  TRAIN iter=002000 obj_val=0.00493435
        From worker 2:  [2018-09-28 15:08:08 | info | Mocha]: Saving snapshot to snapshot-002000.jld...
        From worker 2:  [2018-09-28 15:08:08 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-002000.jld...
        From worker 4:  [2018-09-28 15:08:08 | info | Mocha]:  TRAIN iter=002000 obj_val=0.00294698
        From worker 4:  [2018-09-28 15:08:08 | info | Mocha]: Saving snapshot to snapshot-002000.jld...
        From worker 4:  [2018-09-28 15:08:08 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-002000.jld...
        From worker 2:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=003000 obj_val=0.00498304
        From worker 2:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-003000.jld...
        From worker 2:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-003000.jld...
        From worker 4:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=003000 obj_val=0.00293233
        From worker 4:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-003000.jld...
        From worker 4:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-003000.jld...
        From worker 3:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=001000 obj_val=0.00478995
        From worker 3:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-001000.jld...
        From worker 3:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-001000.jld...
        From worker 2:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=004000 obj_val=0.00501384
        From worker 2:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-004000.jld...
        From worker 2:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-004000.jld...
        From worker 4:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=004000 obj_val=0.00292373
        From worker 4:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-004000.jld...
        From worker 4:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-004000.jld...
        From worker 3:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=002000 obj_val=0.00481894
        From worker 3:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-002000.jld...
        From worker 3:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-002000.jld...
        From worker 2:  [2018-09-28 15:08:09 | info | Mocha]:  TRAIN iter=005000 obj_val=0.00504234
        From worker 2:  [2018-09-28 15:08:09 | info | Mocha]: Saving snapshot to snapshot-005000.jld...
        From worker 2:  [2018-09-28 15:08:09 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-005000.jld...
        From worker 4:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=005000 obj_val=0.00293699
        From worker 4:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-005000.jld...
        From worker 4:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-005000.jld...
        From worker 3:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=003000 obj_val=0.00482372
        From worker 3:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-003000.jld...
        From worker 3:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-003000.jld...
        From worker 2:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=006000 obj_val=0.00506609
        From worker 2:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-006000.jld...
        From worker 2:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-006000.jld...
        From worker 4:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=006000 obj_val=0.00294918
        From worker 4:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-006000.jld...
        From worker 4:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-006000.jld...
        From worker 2:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=007000 obj_val=0.00508071
        From worker 2:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-007000.jld...
        From worker 2:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-007000.jld...
        From worker 4:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=007000 obj_val=0.00295992
        From worker 4:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-007000.jld...
        From worker 4:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-007000.jld...
        From worker 3:  [2018-09-28 15:08:10 | info | Mocha]:  TRAIN iter=004000 obj_val=0.00482634
        From worker 3:  [2018-09-28 15:08:10 | info | Mocha]: Saving snapshot to snapshot-004000.jld...
        From worker 3:  [2018-09-28 15:08:10 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-004000.jld...
        From worker 2:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=008000 obj_val=0.00509217
        From worker 2:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-008000.jld...
        From worker 2:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-008000.jld...
        From worker 4:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=008000 obj_val=0.00296522
        From worker 4:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-008000.jld...
        From worker 4:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-008000.jld...
        From worker 3:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=005000 obj_val=0.00482888
        From worker 3:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-005000.jld...
        From worker 3:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-005000.jld...
        From worker 2:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=009000 obj_val=0.00510150
        From worker 2:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-009000.jld...
        From worker 2:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-009000.jld...
        From worker 4:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=009000 obj_val=0.00296016
        From worker 4:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-009000.jld...
        From worker 4:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-009000.jld...
        From worker 3:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=006000 obj_val=0.00483129
        From worker 3:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-006000.jld...
        From worker 3:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-006000.jld...
        From worker 2:  [2018-09-28 15:08:11 | info | Mocha]:  TRAIN iter=010000 obj_val=0.00510905
        From worker 2:  [2018-09-28 15:08:11 | info | Mocha]: Saving snapshot to snapshot-010000.jld...
        From worker 2:  [2018-09-28 15:08:11 | warn | Mocha]: Overwriting Snapshots/snapshots_2/snapshot-010000.jld...
        From worker 4:  [2018-09-28 15:08:12 | info | Mocha]:  TRAIN iter=010000 obj_val=0.00296631
        From worker 4:  [2018-09-28 15:08:12 | info | Mocha]: Saving snapshot to snapshot-010000.jld...
        From worker 4:  [2018-09-28 15:08:12 | warn | Mocha]: Overwriting Snapshots/snapshots_4/snapshot-010000.jld...
        From worker 2:  [2018-09-28 15:08:12 | info | Mocha]:   Square-loss (avg over 1000100) = 0.0052
        From worker 4:  [2018-09-28 15:08:12 | info | Mocha]:   Square-loss (avg over 1000100) = 0.0051
        From worker 3:  [2018-09-28 15:08:12 | info | Mocha]:  TRAIN iter=007000 obj_val=0.00483306
        From worker 3:  [2018-09-28 15:08:12 | info | Mocha]: Saving snapshot to snapshot-007000.jld...
        From worker 3:  [2018-09-28 15:08:12 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-007000.jld...
        From worker 2:  elapsed time: 13.014436101 seconds
        From worker 4:  elapsed time: 12.84032148 seconds
        From worker 3:  [2018-09-28 15:08:12 | info | Mocha]:  TRAIN iter=008000 obj_val=0.00483425
        From worker 3:  [2018-09-28 15:08:12 | info | Mocha]: Saving snapshot to snapshot-008000.jld...
        From worker 3:  [2018-09-28 15:08:12 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-008000.jld...
        From worker 3:  [2018-09-28 15:08:12 | info | Mocha]:  TRAIN iter=009000 obj_val=0.00483519
        From worker 3:  [2018-09-28 15:08:12 | info | Mocha]: Saving snapshot to snapshot-009000.jld...
        From worker 3:  [2018-09-28 15:08:12 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-009000.jld...
        From worker 3:  [2018-09-28 15:08:13 | info | Mocha]:  TRAIN iter=010000 obj_val=0.00483590
        From worker 3:  [2018-09-28 15:08:13 | info | Mocha]: Saving snapshot to snapshot-010000.jld...
        From worker 3:  [2018-09-28 15:08:13 | warn | Mocha]: Overwriting Snapshots/snapshots_3/snapshot-010000.jld...
        From worker 3:  [2018-09-28 15:08:13 | info | Mocha]:   Square-loss (avg over 1000100) = 0.0049
        From worker 3:  elapsed time: 14.210652832 seconds
elapsed time: 19.028661359 seconds
28-Sep 15:08:13:INFO:root:
 Merged train local model logs
28-Sep 15:08:13:INFO:root:./results/executing/train_local_model deleted
28-Sep 15:08:13:INFO:root:Done training local models
28-Sep 15:08:13:INFO:root:Done calculating neighborhoods
28-Sep 15:08:13:INFO:root:Generating neighborhoods for every node

Any[Int3228-Sep 15:08:13:INFO:root:There's no worker with the pid 2
[3], Int32[], Int32[1]]
28-Sep 15:08:13:INFO:root:Done generating neighborhoods for every node
elapsed time: 0.457396247 seconds
28-Sep 15:08:13:INFO:root:Training global model
        From worker 2:  MY ID: 2
        From worker 3:  MY ID: 3
        From worker 4:  MY ID: 4
        From worker 2:  Neurona: 20
        From worker 4:  Neurona: 20
        From worker 3:  Neurona: 20
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Topological sorting 4 layers...
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Setup layers...
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Network constructed!
        From worker 3:  [2018-09-28 15:08:16 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 3:  [2018-09-28 15:08:16 | info | Mocha]: Topological sorting 4 layers...
        From worker 3:  [2018-09-28 15:08:16 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:16 | info | Mocha]: Network constructed!
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Topological sorting 4 layers...
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Setup layers...
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Loading existing model from Snapshots/snapshots_2/snapshot-010000.jld
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Loading existing model from Snapshots/snapshots_2/snapshot-010000.jld
        From worker 3:  [2018-09-28 15:08:16 | info | Mocha]: Loading existing model from Snapshots/snapshots_3/snapshot-010000.jld
        From worker 4:  Done with: 1
        From worker 4:  Neurona: 20
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Topological sorting 4 layers...
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Setup layers...
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Network constructed!
        From worker 4:  [2018-09-28 15:08:16 | info | Mocha]: Loading existing model from Snapshots/snapshots_4/snapshot-010000.jld
        From worker 4:  Done with: 2
        From worker 3:  Done with: 1
        From worker 2:  Done with: 1
        From worker 2:  Neurona: 20
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Topological sorting 4 layers...
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Setup layers...
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:16 | info | Mocha]: Loading existing model from Snapshots/snapshots_4/snapshot-010000.jld
        From worker 2:  Done with: 2
        From worker 4:  elapsed time: 0.963634349 seconds
        From worker 2:  elapsed time: 1.089430503 seconds
        From worker 3:  elapsed time: 1.127327713 seconds
elapsed time: 3.595439618 seconds
28-Sep 15:08:17:INFO:root:
 Merged train global model logs
28-Sep 15:08:17:INFO:root:./results/executing/train_global_model deleted
28-Sep 15:08:17:INFO:root:Done training global model
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_2/snapshot-010000.jld
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_2/snapshot-010000.jld
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_2/snapshot-010000.jld
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_3/snapshot-010000.jld
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_3/snapshot-010000.jld
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 4:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_4/snapshot-010000.jld
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_3/snapshot-010000.jld
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 2:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_4/snapshot-010000.jld
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Constructing net MLP on Mocha.CPUBackend...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Topological sorting 4 layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Setup layers...
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Network constructed!
        From worker 3:  [2018-09-28 15:08:17 | info | Mocha]: Loading existing model from Snapshots/snapshots_4/snapshot-010000.jld
elapsed time: 0.770362447 seconds
elapsed time: 43.005221516 seconds
Any[0.0393074, 0.00998162, 0.0729024]
Any[761.82, 125.722, 362.11]
Any[-2.45187, -0.000821773, 0.340858]
Number of nodes:
2
Any[Int32[3], Int32[], Int32[1]]
28-Sep 15:08:18:INFO:root:Stopping the container analyser daemon
28-Sep 15:08:18:INFO:root:There's no worker with the pid 2
28-Sep 15:08:18:WARNING:root:Could not write the final analysis in master_summary.jl
28-Sep 15:08:18:INFO:root:Results moved into the folder: ./results/905f3cd-18-09-28-15:06:56-1234

28-Sep 15:08:24:INFO:root:Results stored in: ./results/905f3cd-18-09-28-15:06:56-1234/system.csv
28-Sep 15:08:24:INFO:root:There's no worker with the pid 2
28-Sep 15:08:24:INFO:root:There's no worker with the pid 2
28-Sep 15:08:24:WARNING:root:No Dockerized Worker to be deleted!

StackFrame[rmdockerworkers(::Array{Int64,1}) at DockerizedJuliaWorker.jl:108, execute_experiment(::Array{String,1}) at master_summary.jl:543, experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at call_experiment.jl:21, eval(::Module, ::Any) at boot.jl:235, eval_user_input(::Any, ::Base.REPL.REPLBackend) at REPL.jl:66, macro expansion at REPL.jl:97 [inlined], (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at event.jl:73]

StackFrame[rmdockerworkers(::Array{Int64,1}) at DockerizedJuliaWorker.jl:104, execute_experiment(::Array{String,1}) at master_summary.jl:543, experiment(::Array{String,1}, ::Vararg{Array{String,1},N} where N) at call_experiment.jl:21, eval(::Module, ::Any) at boot.jl:235, eval_user_input(::Any, ::Base.REPL.REPLBackend) at REPL.jl:66, macro expansion at REPL.jl:97 [inlined], (::Base.REPL.##1#2{Base.REPL.REPLBackend})() at event.jl:73]
2-element Array{Int64,1}:
 3
 4

I do not know if those are the results you are looking for, but at least there is no error with docker. Kind regards

Sebastian Rodriguez.

NaelsonDouglas / DistributedMachineLearningThesis

In regards to: "docker: error while loading shared libraries: libltdl.so.7: cannot open shared object file: No such file or directory" on GranColoso Server #14