search

big-data-europe / docker-spark

Apache Spark docker image
2.04k stars 698 forks source link

how can I access this location => /spark/README.md #152

Open zehranrgi opened 2 years ago

zehranrgi commented 2 years ago

In the example below, the parameter is taken from /spark/README.md; can I find this location?

Original Examples

Dockerfile : ... ENV SPARK_APPLICATION_ARGS "/spark/README.md"

GezimSejdiu commented 2 years ago

Hey @zehranrgi ,

that location or at least that file is coming withing docker container just as an example and it comes from here: https://github.com/big-data-europe/docker-spark/blob/6fc7f76ee7aa5be7c5c44a97fc9e3e429b45b0e5/base/Dockerfile#L24%60 as the /spark is the path where spark is located and as such it also contains the README file on its binaries.

You can mount any volume you want when you setup the containers which then becomes visible on the container and define it as a parameter. So, in this example (to be a bit of self-contain) I do use that path.

Let me know if you need more help on this.

Best regards,