big-data-europe / docker-spark

Apache Spark docker image
2.04k stars 698 forks source link

what is dockerspark_default network #142

Open saianger opened 2 years ago

saianger commented 2 years ago

Hi,

I cannot start any docker container with network dockerspark_default, can I ask what is this dockerspark_default and where it comes from?

Thanks, Leo

saianger commented 2 years ago

I got error msg even if I created the network using below command: docker network create -d bridge dockerspark_default

The error msg is: StandaloneAppClient$ClientEndpoint: Failed to connect to master spark-master:7077

GezimSejdiu commented 2 years ago

Hi @saianger ,

thanks a lot for creating this issue. The dockerspark_default network is coming when docker-compose up -d is executed. See it here: https://docs.docker.com/compose/networking/ as a reference:

When you run docker-compose up, the following happens:

A network called myapp_default is created.
...

If you did run the docker images without docker compose then you should create a network via:

docker network create dockerspark_default

and then use it when linking spark-worker to the master.

Please, do let me know if you still face any issues.

Best regards, Gezim

Mhieu14 commented 2 years ago

In my case, it's docker-spark_default, not dockerspark_default.

humblebyblo commented 2 years ago

also my case , docker network default name is "docker-spark_default" because repo name is "docker-spark"