search

stitchfix / flotilla-os

Open source Flotilla
Apache License 2.0
192 stars 10 forks source link

Adding S3 claim and override to force driver to emptydir #503

Closed willhume closed 6 months ago

willhume commented 6 months ago

PROBLEM

We need some infra to handle Disk Spills in Spark.

SOLUTION

This PR will mount a S3 mount to the pods. Associated infra is located here https://github.com/stitchfix/algo-terraform-configs/pull/166