search

ml-tooling / ml-workspace

🛠 All-in-one web-based IDE specialized for machine learning and data science.
https://mltooling.org/ml-workspace
Apache License 2.0
3.45k stars 452 forks source link

Build of spark flavor with new version 0.13.2 #98

Closed marianobilli closed 2 years ago

marianobilli commented 3 years ago

Thanks for releasing new version 0.13.2, would it be possible you build the spark flavor in docker hub using this new base flavor? Thanks!

lukasmasuch commented 3 years ago

@marianobilli I'm happy to see people using the spark flavor :) I assumed a low usage and excluded it from the update to save some time. I will try to find some time to provide an update for the spark image as well.

marianobilli commented 3 years ago

Honestly the spark flavor is a bit heavy, it would be good if it is based on the minimal-flavor and not on top of the r-flavor.

But we are using it a lot, by replacing the spark client with the custom aws spark client and connecting it to AWS EMR clusters.

amouhsine commented 3 years ago

I don't know @marianobilli I would still like to have it on top of R. I am using the current 0.12 versio because of it :)

marianobilli commented 3 years ago

Sure no problem, we are using it anyway, so @LukasMasuch do you think you could build the image? thanks!

marianobilli commented 3 years ago

I would still be happy if this build can happen :)

sim-san commented 3 years ago

I would like to try out the new Spark 3.2 on our ml-hub

github-actions[bot] commented 2 years ago

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 14 days

sim-san commented 2 years ago

Still interested

marianobilli commented 2 years ago

march 2022 still interested! @LukasMasuch

geodose commented 2 years ago

also interested!

github-actions[bot] commented 2 years ago

This issue is stale because it has been open 90 days with no activity. Remove stale label or comment or this will be closed in 14 days

rickdgit commented 2 years ago

Still interested @LukasMasuch