elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.9k stars 24.73k forks source link

Could not resolve all files for configuration ':x-pack:plugin:ml:nativeBundle' #91382

Closed kingherc closed 1 year ago

kingherc commented 1 year ago

CI Link

https://gradle-enterprise.elastic.co/s/udr4zarqelpuw

Repro line

Appears a lot recently - see failure history

Does it reproduce?

Yes

Applicable branches

main, 7.17, 8.5

Failure history

https://gradle-enterprise.elastic.co/scans/failures?failures.expandedAnalyses=WyJycTZ2YzRzMndobHk2IiwidWRyNHphcnFlbHB1dyIsIjN2dWpiY3Q1NHh0NGUiXQ&failures.failureClassification=all_failures&failures.failureMessage=Could%20not%20determine%20the%20dependencies%20of%20task%20*%0A%3E%20Could%20not%20resolve%20all%20files%20for%20configuration%20%27:x-pack:plugin:ml:nativeBundle%27.%0A%20%20%20%3E%20Could%20not%20download%20*%0A%20%20%20%20%20%20%3E%20Could%20not%20get%20resource%20%27https://artifacts-snapshot.elastic.co/ml-cpp/*/downloads/ml-cpp/*%0A%20%20%20%20%20%20%20%20%20%3E%20Premature%20end%20of%20Content-Length%20delimited%20message%20body%20(expected:%20*%20received:%20*&search.timeZoneId=Europe/Athens

Failure excerpt

Could not determine the dependencies of task ':x-pack:plugin:ml:explodedBundlePlugin'

Build file 'C:\Users\jenkins\workspace\platform-support\463\x-pack\plugin\ml\build.gradle' line: 58
Could not resolve all files for configuration ':x-pack:plugin:ml:nativeBundle'.
> Could not download ml-cpp-8.6.0-SNAPSHOT-deps.zip (org.elasticsearch.ml:ml-cpp:8.6.0-SNAPSHOT)
  > Could not get resource 'https://artifacts-snapshot.elastic.co/ml-cpp/8.6.0-SNAPSHOT/downloads/ml-cpp/ml-cpp-8.6.0-SNAPSHOT-deps.zip'.
    > Premature end of Content-Length delimited message body (expected: 340,418,397; received: 8,388,544)

Probably some robustness is needed for such a large file? Maybe some way for gradle to retry it?

elasticsearchmachine commented 1 year ago

Pinging @elastic/ml-core (Team:ML)

kingherc commented 1 year ago

Also here and here among others.

kingherc commented 1 year ago

This looks similar to https://github.com/elastic/elasticsearch/issues/91395 where I've tagged the Delivery/Build team. If ML team believes this is a build issue as well, please re-label appropriately. Note that this issue appears much more frequently than https://github.com/elastic/elasticsearch/issues/91395 .

elasticsearchmachine commented 1 year ago

Pinging @elastic/es-delivery (Team:Delivery)

kingherc commented 1 year ago

This seems repeating a lot in recent test failures, and because I believe it may be a packaging/build issue, I am also marking the Delivery team to investigate if there's a workaround/mitigation.

mark-vieira commented 1 year ago

This is a duplicate issue of many others all related to a infra ticket.

ruthwik3690 commented 1 year ago

what is the solution/workaround for this issue? facing the same. infact i am doing it for an older version : 7.17.9 but the error is same.

mark-vieira commented 1 year ago

what is the solution/workaround for this issue?

Is it consistently happening? The workaround is simply to retry the build given this is just an ephemeral network error.

ruthwik3690 commented 1 year ago
Could not find org.elasticsearch.ml:ml-cpp:7.17.9-SNAPSHOT.
     Searched in the following locations:
       - https://artifacts-snapshot.elastic.co/ml-cpp/7.17.9-SNAPSHOT/downloads/ml-cpp/ml-cpp-7.17.9-SNAPSHOT.zip
     Required by:
         project :x-pack:plugin:ml`

actually the ml-cpp--SNAPSHOT is not available in the location. This is the exact error, could you help me out with this?

mark-vieira commented 1 year ago

I believe that artifact is no longer available. Is there a reason you are trying to build 7.17.9 from source?

wdongyu commented 10 months ago

exactly the same error on 8.6.0 when I run ./gradlew test

Could not determine the dependencies of task ':x-pack:plugin:ml:explodedBundlePlugin'.
    Could not resolve all task dependencies for configuration ':x-pack:plugin:ml:nativeBundle'.
     Could not find org.elasticsearch.ml:ml-cpp:8.6.0-SNAPSHOT.
     Searched in the following locations:
       - https://artifacts-snapshot.elastic.co/ml-cpp/8.6.0-SNAPSHOT/downloads/ml-cpp/ml-cpp-8.6.0-SNAPSHOT-deps.zip
     Required by:
         project :x-pack:plugin:ml
nileiqing commented 7 months ago

gradlew run --debug-jvm -x :x-pack:plugin:ml:explodedBundlePlugin