search

InseeFrLab / images-datascience

Collection of Docker images to build the data science catalog of the Onyxia project
MIT License
24 stars 22 forks source link

Try to separate images-datascience and spark worker #54

Closed alexisdondon closed 1 month ago

alexisdondon commented 1 year ago

For an easy use we mix jupyter image with hivemetastore and spark image.

We could work on an lighter images datascience pyspark but a worker spark image maybe that could be build on this project

avouacr commented 1 month ago

closing this issue as #117 wants to implement the same idea