search

apache / lucene

Apache Lucene open-source search software
https://lucene.apache.org/
Apache License 2.0
2.69k stars 1.04k forks source link

Update buildAndPushRelease.py for new gradle build [LUCENE-10174] #11211

Closed asfimport closed 3 years ago

asfimport commented 3 years ago

With #10527 and #11210 the gradle build was polished to properly build source and binary artifacts, and sign those using either gpg tool or a built-in java-based signing plugin. See https://github.com/apache/lucene/blob/main/help/publishing.txt

This jira will update buildAndPushRelease.py script to use the correct build parameters. It will also add cmdline args to choose between gpg and built-in (gpg default), and to supply the location of gpgHome if you do not use gpg. We'll also add an option to NOT prompt for passphrase in the python script, which will fallback to defaults (gpg-agent, env.vars or gradle.properties).

Migrated from LUCENE-10174 by Jan Høydahl (@janhoy), resolved Oct 20 2021 Parent: #10527 Linked issues:

Pull requests: https://github.com/apache/lucene/pull/396, https://github.com/apache/lucene/pull/401

asfimport commented 3 years ago

Jan Høydahl (@janhoy) (migrated from JIRA)

Please see PR https://github.com/apache/lucene/pull/382 for instructions on how to test

asfimport commented 3 years ago

ASF subversion and git services (migrated from JIRA)

Commit cdfa11b1582ead89547b08c4c41c13712550d4ba in lucene's branch refs/heads/main from Jan Høydahl https://gitbox.apache.org/repos/asf?p=lucene.git;h=cdfa11b

LUCENE-10174 Update buildAndPushRelease.py for new gradle build (#382)

Co-authored-by: Tomoko Uchida <tomoko.uchida.1111@gmail.com>

asfimport commented 3 years ago

Jan Høydahl (@janhoy) (migrated from JIRA)

Re-opening to enhance the 'assembleRelease' step, to avoid OOM in gpg-agent. Will split in two commands and skip 'clean':

gradlew assembleRelease ...
gradlew assembleRelease -Psign --max-workers 1 ...
asfimport commented 3 years ago

Jan Høydahl (@janhoy) (migrated from JIRA)

When we skip "clean" step, the task does not need to re-compile, only to assemble the tar/zip and sign. I tested locally and --max-workers 8 (my default) results in OOM, but \--max-workers 4 works fine. So I'll settle on \--max-workers 2 which on my laptop takes less than a minute, which should be acceptable for a release. The imporant thing to parallellize is the tests.

asfimport commented 3 years ago

Jan Høydahl (@janhoy) (migrated from JIRA)

See PR https://github.com/apache/lucene/pull/396

asfimport commented 3 years ago

ASF subversion and git services (migrated from JIRA)

Commit f5486d13e6f440a7296c23f45cd53f0313e83e0e in lucene's branch refs/heads/main from Jan Høydahl https://gitbox.apache.org/repos/asf?p=lucene.git;h=f5486d1

LUCENE-10174 BuildAndPushRelease additional improvements (#396)

asfimport commented 3 years ago

Jan Høydahl (@janhoy) (migrated from JIRA)

See GitHub Pull Request #401 for a nice speedup of the last step 'pushLocal'

asfimport commented 3 years ago

ASF subversion and git services (migrated from JIRA)

Commit 5b8f0a5eb5e3f876607b102eb509db88de26691c in lucene's branch refs/heads/main from Jan Høydahl https://gitbox.apache.org/repos/asf?p=lucene.git;h=5b8f0a5

LUCENE-10174 Speed up 'pushLocal' by using uncompressed tar (#401)

asfimport commented 3 years ago

ASF subversion and git services (migrated from JIRA)

Commit f5486d13e6f440a7296c23f45cd53f0313e83e0e in lucene's branch refs/heads/hnsw from Jan Høydahl https://gitbox.apache.org/repos/asf?p=lucene.git;h=f5486d1

LUCENE-10174 BuildAndPushRelease additional improvements (#396)

asfimport commented 3 years ago

ASF subversion and git services (migrated from JIRA)

Commit 5b8f0a5eb5e3f876607b102eb509db88de26691c in lucene's branch refs/heads/hnsw from Jan Høydahl https://gitbox.apache.org/repos/asf?p=lucene.git;h=5b8f0a5

LUCENE-10174 Speed up 'pushLocal' by using uncompressed tar (#401)

asfimport commented 2 years ago

Adrien Grand (@jpountz) (migrated from JIRA)

Closing after the 9.0.0 release