search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
826 stars 236 forks source link

Release Checklist v24.10 #11249

Open caryr35 opened 4 months ago

caryr35 commented 4 months ago

Release Checklist for v24.10:

Status Task Start End Owner
Pre-release
  • - [X]
Notification to team of last feature sprint in milestone 2024-09-09 2024-09-27 @mattahrens
  • - [X]
Burndown (no new features for current release) 2024-09-30 2024-10-11 Team
  • - [X]
Update docs for current release in spark-rapids without updating release links 2024-10-07 2024-10-11 Team
  • - [X]
Create a PR to update release links 2024-10-11 2024-10-11 @nvliyuan
  • - [X]
Get RAPIDS 24.12 cudf java build working. 2024-09-23 2024-09-27 @NvTimLiu
  • - [X]
Create 24.12 branch including spark-rapids-{jni,private} and spark-rapids 2024-09-26 2024-09-27 @NvTimLiu
  • - [X]
Automerge from 24.10 to 24.12 2024-09-26 2024-09-27 @NvTimLiu
  • - [X]
Enable Jenkins builds (premerge, nightly, integration, performance) for 24.12 2024-09-27 2024-10-01 @NvTimLiu
  • - [X]
[spark-rapids-private 24.10] Java release to sonatype 2024-10-11 2024-10-11 @NvTimLiu
  • - [X]
[spark-rapids-jni 24.10] Java release to sonatype 2024-10-11 2024-10-11 @NvTimLiu
  • - [X]
[cudf 24.10] Java release to sonatype 2024-10-11 2024-10-11 @NvTimLiu
  • - [X]
Notify RAPIDS team of javadocs for 24.10 2024-10-14 2024-10-14 @GaryShen2008
Staging release
  • - [X]
Make 24.12 the default branch 2024-10-07 2024-10-07 @jlowe
  • - [X]
Enable static scanning on the new 24.12 branches 2024-10-23 2024-10-23 @GaryShen2008
  • - [X]
Merge all remaining branch-24.10 PRs 2024-10-11 2024-10-11 Team
  • - [X]
Update spark-rapids-jni dependency version 2024-10-09 2024-10-09 @NvTimLiu
  • - [X]
Create CHANGELOG.md 2024-10-11 2024-10-11 @NvTimLiu
  • - [X]
Deliver Snapshot packages to QA 2024-10-07 2024-10-07 @NvTimLiu
  • - [X]
Create a PR (not squashed) to merge from branch-24.10 to main. Needs review from repository owner 2024-10-11 2024-10-11 @NvTimLiu
  • - [X]
Trigger the release for spark-rapids Jenkins job on the main branch and deploy the jar to sonatype staging (including spark-rapids-tools/core) 2024-10-15 2024-10-15 @NvTimLiu
  • - [X]
Deliver final packages to QA 2024-10-15 2024-10-15 @NvTimLiu
  • - [X]
Run integration tests on staging jars with AQE on, UCX on, Databricks Azure, Databricks AWS, Dataproc 2024-08-13 2024-08-16 @NvTimLiu
  • - [X]
Run LHA tests on staging jars 2024-10-15 2024-10-18 @NvTimLiu
  • - [X]
CDH testing(skip) 2024-10-15 2024-10-18 @NVTimLiu
  • - [X]
QA testing with Snapshot on NGC V100,Colossus H100/A100/L4,Dataproc T4/L4, Databricks A10/T4. 2024-10-07 2024-10-17 @johnzhong
  • - [X]
Run pre-processing workflow for DLRM sample use case(skip) 2024-10-15 2024-10-18 @johnzhong
  • - [X]
QA testing with final packages on NGC V100,Colossus H100/A100/L4,Dataproc T4/L4, Databricks A10/T4. 2024-10-15 2024-10-18 @johnzhong
Release
  • - [X]
Tag the release and deploy the staging artifacts to maven central repository 2024-10-23 2024-10-23 @NvTimLiu
  • - [X]
Update gh-pages 2024-10-21 2024-10-23 @nvliyuan
  • - [X]
Test spark-rapids-examples repo with Spark-Rapids 24.10 2024-10-21 2024-10-23 @nvliyuan
  • - [X]
Update docs for current release in spark-rapids-examples 2024-10-21 2024-10-23 @nvliyuan
  • - [ ]
Update spark-rapids.sh in https://github.com/GoogleCloudDataproc/initialization-actions/tree/master/spark-rapids for the plugin 2024-10-21 2024-10-23 @nvliyuan
nvliyuan commented 1 week ago

Pending on https://github.com/GoogleCloudDataproc/initialization-actions/pull/1248