NickLarsenNZ
commented
3 months ago FYI, here is my workflow for the Vector upgrade. It could be helpful to anyone wanting to speed up repetitive tasks:
Find where replacements might be needed. In this this case I'm looking for the Vector chart version 0.34.0.
# cd into an operator or other stackable repo so that the relative paths work
rg -l -- '--version 0\.34\.0' | cut -d'/' -f1 | sed 's/^/pushd ..\//' | sort -rProduces this list. Run these in a shell to add each directory in a stack in reverse (this will help with using popd to move to the next):
pushd ../zookeeper-operator
pushd ../superset-operator
pushd ../spark-k8s-operator
pushd ../opa-operator
pushd ../nifi-operator
pushd ../kafka-operator
pushd ../hive-operator
pushd ../hdfs-operator
pushd ../hbase-operator
pushd ../druid-operatorThen in each directory:
# stash any existing work
git stash -m "before vector 0.40.0 upgrade"
git checkout main
git pull
git checkout -b vector-0.40.0
# find files that might need changing
rg -l -- '--version 0\.34\.0'
# edit the file, change to chart 0.35.0
# Interactively stage the changes
git add -p
# Using this message will make the PR use the same message
git commit -s -m "chore: Bump Vector to 0.40.0" --no-verify # skip pre-commit hooks for trivial changes
git push
# move to the next repo
popdRaise a PR with the following template (updating the dependency the link to the applicable docker-image PR for the product/image):
Part of https://github.com/stackabletech/issues/issues/626
```[tasklist]
### Depends on
- [ ] https://github.com/stackabletech/docker-images/pull/802
```Set:
- Assignee
- Label:
scheduled-for/24.11(I typefor11as a shortcut) - Project to Stackable Engineering (will set status later)
Create the PR and copy the link...
Refresh this page, and copy link to the this tracking issue.
This issue has moved to https://github.com/stackabletech/docker-images/issues/831
The description below will no longer be updated with progress.
This issue tracks the product versions and the changes we need to do to them in our SDP release 24.11.
The single source of truth for this data is a spreadsheet we filled colaboratively in a planning meeting.
Acceptance
These high level tasks need to be completed.
versions.pyto reflect the agreed upon versions in the spreadsheet.nextbranch for now.Base images
UBI8 Rust Builder
ubi8-rust-builder
FROM)RUST_DEFAULT_TOOLCHAIN_VERSIONCARGO_CYCLONEDX_CRATE_VERSIONCARGO_AUDITABLE_CRATE_VERSIONPROTOC_VERSIONUBI9 Rust Builder
ubi9-rust-builder
FROM)RUST_DEFAULT_TOOLCHAIN_VERSIONCARGO_CYCLONEDX_CRATE_VERSIONCARGO_AUDITABLE_CRATE_VERSIONPROTOC_VERSIONVector
Used as a base for java-base.
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.Java Base and Devel
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.Stackable Base
stackable-base
FROM)RUST_DEFAULT_TOOLCHAIN_VERSIONCARGO_CYCLONEDX_CRATE_VERSIONCARGO_AUDITABLE_CRATE_VERSIONPROTOC_VERSIONCONFIG_UTILS_VERSIONProduct Images
Airflow
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.Druid
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).HBase, Phoenix, Omid
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).HDFS
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).Hive
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).Kafka
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).NiFi
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).OpenPolicyAgent (OPA)
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.Spark
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).Superset
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.Trino
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.ZooKeeper
Actions to take:
versions.pyto reflect the agreed upon versions in the spreadsheet.versions.pyto the latest supported version of JVM (base and devel).