stackabletech / spark-k8s-operator

Operator for Apache Spark-on-Kubernetes for Stackable Data Platform
https://stackable.tech
Other
51 stars 3 forks source link

re-include executor/driver cores in spark-config #302

Closed adwk67 closed 11 months ago

adwk67 commented 11 months ago

Description

re-include executor/driver cores in spark-config. Fixes https://github.com/stackabletech/spark-k8s-operator/issues/300.

CI: :green_circle: https://ci.stackable.tech/view/02%20Operator%20Tests%20(custom)/job/spark-k8s-operator-it-custom/113/

The resources test has been adapted to confirm that SPARK_EXECUTOR_CORES has been correctly set in the executor pods.

Definition of Done Checklist

# Author
- [x] Changes are OpenShift compatible
- [x] Helm chart can be installed and deployed operator works
- [x] Integration tests passed (for non trivial changes)
- [x] Changes need to be "offline" compatible
# Reviewer
- [x] Code contains useful comments
- [x] (Integration-)Test cases added
- [x] Documentation added or updated
- [x] Changelog updated
- [x] Cargo.toml only contains references to git tags (not specific commits or branches)
# Acceptance
- [ ] Feature Tracker has been updated
- [ ] Proper release label has been added