search

cms-sw / cmssw

CMS Offline Software
http://cms-sw.github.io/
Apache License 2.0
1.09k stars 4.33k forks source link

Build CMSSW_12_6_0_pre3_LossyCompression #39697

Closed rappoccio closed 2 years ago

rappoccio commented 2 years ago

RELEASE_QUEUE: CMSSW_12_6_X CMSSW_COMMIT: CMSSW_12_6_0_pre3_CompressionBranch

Making a release on a separate branch that is on top of pre3 in order to test the new Lossy Compression algorithm from here. This can then be used to make special relvals to investigate the impact of the compression algorithm on higher statistics.

cmsbuild commented 2 years ago

Request received. I will start to build the release after one of the following approve the issue: @perrotta, @smuzaffar, @dpiparo, @rappoccio. You can do this by writing "+1" in a comment. You can also ask me to begin to build cmssw-tool-conf first ( Cannot be done for patch releases ). To do this write "build cmssw-tool-conf" in a comment. I will start to build cmssw-tool-conf and then wait for the "+1" to start the build of the release. CMSSW Branch: CMSSW_12_6_X(master) Architecture: el8_amd64_gcc10(Production), el8_amd64_gcc11, slc7_amd64_gcc10, el8_aarch64_gcc10, el8_ppc64le_gcc10 Release tag based on: CMSSW_12_6_0_pre3_CompressionBranch

smuzaffar commented 2 years ago

+1

cmsbuild commented 2 years ago

Release created: https://github.com/cms-sw/cmssw/releases/tag/CMSSW_12_6_0_pre3_LossyCompression. The tag was created on top of branch: https://github.com/cms-sw/cmssw/tree/master

cmsbuild commented 2 years ago

Queuing Jenkins build for the following architectures: el8_ppc64le_gcc10, el8_amd64_gcc10, el8_amd64_gcc11, slc7_amd64_gcc10, el8_aarch64_gcc10 You can abort the build by writing "Abort" in a comment. I will delete the release, the cmssw and cmsdist tag, and close the issue. You can't abort the upload once at least one achitecture is being uploaded. If you are building cmssw-tool-conf first, I will wait for each architecture to finish to start the build of cmssw.

cmsbuild commented 2 years ago

The build has started for el8_amd64_gcc10 in cmsbuild02. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/build-release/3659/console CMSDIST Branch: IB/CMSSW_12_6_X/master, PKGTOOLS Branch: V00-34-XX

cmsbuild commented 2 years ago

The build has started for el8_amd64_gcc11 in cmsbuild01. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/build-release/3660/console CMSDIST Branch: IB/CMSSW_12_6_X/g11, PKGTOOLS Branch: V00-34-XX

cmsbuild commented 2 years ago

The build has started for slc7_amd64_gcc10 in cmsbuild04. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/build-release/3661/console CMSDIST Branch: IB/CMSSW_12_6_X/master, PKGTOOLS Branch: V00-34-XX

cmsbuild commented 2 years ago

The build has started for el8_ppc64le_gcc10 in ibmminsky-2a. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/build-release/3662/console CMSDIST Branch: IB/CMSSW_12_6_X/master, PKGTOOLS Branch: V00-34-XX

cmsbuild commented 2 years ago

The build has started for el8_aarch64_gcc10 in olarm-202a. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/build-release/3663/console CMSDIST Branch: IB/CMSSW_12_6_X/master, PKGTOOLS Branch: V00-34-XX

cmsbuild commented 2 years ago

The build has finished sucessfully for the architecture slc7_amd64_gcc10 and is ready to be uploaded. You can start the uploads by writing the comment: "upload all". I will upload all the architectures as soon as the build finishes successfully. You can see the log for the build here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-slc7_amd64_gcc10/3661 Some tests ( runTheMatrix.py -s ) are being run, the results will be posted when done.

cmsbuild commented 2 years ago

The build has finished sucessfully for the architecture el8_ppc64le_gcc10 and is ready to be uploaded. You can start the uploads by writing the comment: "upload all". I will upload all the architectures as soon as the build finishes successfully. You can see the log for the build here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_ppc64le_gcc10/3662 Some tests ( runTheMatrix.py -s ) are being run, the results will be posted when done.

cmsbuild commented 2 years ago

The build has finished sucessfully for the architecture el8_amd64_gcc10 and is ready to be uploaded. You can start the uploads by writing the comment: "upload all". I will upload all the architectures as soon as the build finishes successfully. You can see the log for the build here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_amd64_gcc10/3659 Some tests ( runTheMatrix.py -s ) are being run, the results will be posted when done.

cmsbuild commented 2 years ago

The build has finished sucessfully for the architecture el8_amd64_gcc11 and is ready to be uploaded. You can start the uploads by writing the comment: "upload all". I will upload all the architectures as soon as the build finishes successfully. You can see the log for the build here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_amd64_gcc11/3660 Some tests ( runTheMatrix.py -s ) are being run, the results will be posted when done.

cmsbuild commented 2 years ago

The build has finished sucessfully for the architecture el8_aarch64_gcc10 and is ready to be uploaded. You can start the uploads by writing the comment: "upload all". I will upload all the architectures as soon as the build finishes successfully. You can see the log for the build here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_aarch64_gcc10/3663 Some tests ( runTheMatrix.py -s ) are being run, the results will be posted when done.

cmsbuild commented 2 years ago

The tests have finished for slc7_amd64_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-slc7_amd64_gcc10/3661

Tests results: 48 47 46 33 18 4 1 1 1 1 1 tests passed, 0 0 0 0 0 0 0 0 0 0 0 failed

cmsbuild commented 2 years ago

The tests have finished for el8_amd64_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_amd64_gcc10/3659

Tests results: 48 47 46 33 18 4 1 1 1 1 1 tests passed, 0 0 0 0 0 0 0 0 0 0 0 failed

cmsbuild commented 2 years ago

The tests have finished for el8_amd64_gcc11 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_amd64_gcc11/3660

Tests results: 48 47 46 33 18 4 1 1 1 1 1 tests passed, 0 0 0 0 0 0 0 0 0 0 0 failed

cmsbuild commented 2 years ago

The tests have finished for el8_ppc64le_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_ppc64le_gcc10/3662

Tests results: 48 47 46 33 18 4 1 1 1 1 1 tests passed, 0 0 0 0 0 0 0 0 0 0 0 failed

cmsbuild commented 2 years ago

The tests have finished for el8_aarch64_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-build-release/CMSSW_12_6_0_pre3_LossyCompression-el8_aarch64_gcc10/3663

Tests results: 48 47 46 33 18 4 1 1 1 1 1 tests passed, 0 0 0 0 0 0 0 0 0 0 0 failed

rappoccio commented 2 years ago

upload all

rappoccio commented 2 years ago

release-notes

cmsbuild commented 2 years ago

Queing Jenkins upload for slc7_amd64_gcc10

cmsbuild commented 2 years ago

Queing Jenkins upload for el8_amd64_gcc10

cmsbuild commented 2 years ago

Queing Jenkins upload for el8_ppc64le_gcc10

cmsbuild commented 2 years ago

Queing Jenkins upload for el8_aarch64_gcc10

cmsbuild commented 2 years ago

Queing Jenkins upload for el8_amd64_gcc11

cmsbuild commented 2 years ago

The upload has started for el8_aarch64_gcc10 in olarm-202. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/upload-release/2495/console

cmsbuild commented 2 years ago

The upload has started for el8_amd64_gcc10 in cmsbuild02. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/upload-release/2496/console

cmsbuild commented 2 years ago

The upload has started for el8_ppc64le_gcc10 in ibmminsky-2. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/upload-release/2498/console

cmsbuild commented 2 years ago

The upload has started for el8_amd64_gcc11 in cmsbuild01. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/upload-release/2497/console

cmsbuild commented 2 years ago

The upload has successfully finished for el8_ppc64le_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-upload-release/CMSSW_12_6_0_pre3_LossyCompression-el8_ppc64le_gcc10/2498

cmsbuild commented 2 years ago

The upload has successfully finished for el8_aarch64_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-upload-release/CMSSW_12_6_0_pre3_LossyCompression-el8_aarch64_gcc10/2495

cmsbuild commented 2 years ago

The upload has successfully finished for el8_amd64_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-upload-release/CMSSW_12_6_0_pre3_LossyCompression-el8_amd64_gcc10/2496

cmsbuild commented 2 years ago

The upload has started for slc7_amd64_gcc10 in cmsbuild04. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/upload-release/2499/console

cmsbuild commented 2 years ago

The upload has successfully finished for slc7_amd64_gcc10 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-upload-release/CMSSW_12_6_0_pre3_LossyCompression-slc7_amd64_gcc10/2499

cmsbuild commented 2 years ago

The upload has successfully finished for el8_amd64_gcc11 You can see the log here: https://cmssdt.cern.ch/SDT/jenkins-artifacts/auto-upload-release/CMSSW_12_6_0_pre3_LossyCompression-el8_amd64_gcc11/2497

perrotta commented 2 years ago

release-notes since CMSSW_12_6_0_pre3

cmsbuild commented 2 years ago

Generating release notes since CMSSW_12_6_0_pre3. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/release-produce-changelog/ I will generate an announcement template.

cmsbuild commented 2 years ago

You can use this template for announcing the release:

Hi all,

The development release CMSSW_12_6_0_pre3_LossyCompression is now available for the following architectures:

el8_amd64_gcc10 (production) el8_aarch64_gcc10 el8_ppc64le_gcc10 slc7_amd64_gcc10 el8_amd64_gcc11

The release notes of what changed with respect to CMSSW_12_6_0_pre3 can be found at:

https://github.com/cms-sw/cmssw/releases/CMSSW_12_6_0_pre3_LossyCompression

Making a release on a separate branch that is on top of pre3 in order to test the new Lossy Compression algorithm from here. This can then be used to make special relvals to investigate the impact of the compression algorithm on higher statistics.

Cheers, cms-bot

You can also click here to send the email.

cmsbuild commented 2 years ago

Generating release notes since CMSSW_12_6_0_pre3. You can see the progress here: https://cmssdt.cern.ch/jenkins/job/release-produce-changelog/ I will generate an announcement template.

cmsbuild commented 2 years ago

You can use this template for announcing the release:

Hi all,

The development release CMSSW_12_6_0_pre3_LossyCompression is now available for the following architectures:

el8_amd64_gcc10 (production) el8_aarch64_gcc10 el8_ppc64le_gcc10 slc7_amd64_gcc10 el8_amd64_gcc11

The release notes of what changed with respect to CMSSW_12_6_0_pre3 can be found at:

https://github.com/cms-sw/cmssw/releases/CMSSW_12_6_0_pre3_LossyCompression

Making a release on a separate branch that is on top of pre3 in order to test the new Lossy Compression algorithm from here. This can then be used to make special relvals to investigate the impact of the compression algorithm on higher statistics.

Cheers, cms-bot

You can also click here to send the email.

cmsbuild commented 2 years ago

There was an error generating the release notes, please look into the logs

cmsbuild commented 2 years ago

The release notes are ready: https://github.com/cms-sw/cmssw/releases/tag/CMSSW_12_6_0_pre3_LossyCompression

slava77 commented 2 years ago

The release notes of what changed with respect to CMSSW_12_6_0_pre3 can be found at:

https://github.com/cms-sw/cmssw/releases/CMSSW_12_6_0_pre3_LossyCompression

it looks like the bot is not able to extract the extra commit that was added without a pull request

rappoccio commented 2 years ago

@slava77 yes, good catch. The extra one added via cherry-pick can be seen here:

https://github.com/cms-sw/cmssw/compare/CMSSW_12_6_0_pre3...CMSSW_12_6_0_pre3_LossyCompression

cmsbuild commented 2 years ago

The cleanup has started for el8_aarch64_gcc10

cmsbuild commented 2 years ago

The cleanup has started for slc7_amd64_gcc10

cmsbuild commented 2 years ago

The cleanup has started for el8_amd64_gcc10

cmsbuild commented 2 years ago

The cleanup has started for el8_ppc64le_gcc10

cmsbuild commented 2 years ago

The cleanup has started for el8_amd64_gcc11