opensearch-project / ml-commons

ml-commons provides a set of common machine learning algorithms, e.g. k-means, or linear regression, to help developers build ML related features within OpenSearch.
Apache License 2.0
95 stars 129 forks source link

[AUTOCUT] OS Distribution Build Failed for ml-commons-3.0.0 #965

Closed opensearch-ci-bot closed 1 year ago

opensearch-ci-bot commented 1 year ago

Received Error: Error building ml-commons, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component ml-commons. The distribution build for ml-commons has failed. Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/7948/consoleFull

b4sjoo commented 1 year ago

Tried failed task opensearch-ml-plugin:delombok locally and also use opensearch build env to test the build and all passed. So it seems either it has been fixed or it is a transient issue. We can wait to see if problem remains in future Jenkins CI build. cc: @gaiksaya

b4sjoo commented 1 year ago

And it seems latest build passed? https://build.ci.opensearch.org/job/distribution-build-opensearch/7949/

gaiksaya commented 1 year ago

Click on parameters and see that only OpenSearch and security was build in that build https://build.ci.opensearch.org/job/distribution-build-opensearch/7949/parameters/

Triggered a new build to see if the issue persists. Please see https://build.ci.opensearch.org/blue/organizations/jenkins/distribution-build-opensearch/detail/distribution-build-opensearch/7950/

b4sjoo commented 1 year ago

Interesting. Seems the issue persists but I cannot reproduce it locally. Is it possible for you to identify when did this issue happen? Meanwhile, is it possible for you to also take a look, Dhrubo? cc: @dhrubo-os

gaiksaya commented 1 year ago

You can reproduce using following steps:

  1. To keep the build env same as CI, use this docker image https://github.com/opensearch-project/opensearch-build/blob/main/manifests/3.0.0/opensearch-3.0.0.yml#L8-L9
  2. Run the commands mentioned here: https://github.com/opensearch-project/opensearch-build#building-from-source

Thanks!

b4sjoo commented 1 year ago

Can confirm this is due to jdk20 migration. Use issue #891 to track it.

dhrubo-os commented 1 year ago

PR should solve this issue. @gaiksaya can you try to run the build again?

gaiksaya commented 1 year ago

It's running right now: https://build.ci.opensearch.org/job/distribution-build-opensearch/7977/ Thanks!

dhrubo-os commented 1 year ago

Looks like Job-scheduler is failing to build but ML-Commons was successful to build.

> Task :opensearch-ml-plugin:sourcesJar UP-TO-DATE
> Task :opensearch-ml-plugin:assemble

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/8.1.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD SUCCESSFUL in 14s
23 actionable tasks: 5 executed, 18 up-to-date
=======================================
OpenSearch Build Hamster says Hello!
  Gradle Version        : 8.1.1
  OS Info               : Windows Server 2019 10.0 (amd64)
  JDK Version           : 20 (Eclipse Temurin JDK)
  JAVA_HOME             : C:\Users\Administrator\jenkins\tools\hudson.model.JDK\openjdk-20
  Random Testing Seed   : 9EEBE39894886591
  In FIPS 140 mode      : false
=======================================

@gaiksaya can you please confirm? Thanks.

dhrubo-os commented 1 year ago

I ran the build in my end and the build was successful. Closing the issue.