opensearch-project / ml-commons

ml-commons provides a set of common machine learning algorithms, e.g. k-means, or linear regression, to help developers build ML related features within OpenSearch.
Apache License 2.0
89 stars 126 forks source link

[BUG] A lot of tests in ml-commons are failing due to disk circuit breaker open #2639

Closed zane-neo closed 1 month ago

zane-neo commented 1 month ago

What is the bug? https://github.com/opensearch-project/ml-commons/actions/runs/9868776951/job/27251331931?pr=2500#step:6:3786

How can one reproduce the bug? Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

What is the expected behavior? A clear and concise description of what you expected to happen.

What is your host/environment?

Do you have any screenshots? If applicable, add screenshots to help explain your problem.

Do you have any additional context? Add any other context about the problem.

b4sjoo commented 1 month ago

@zane-neo Hi Zan, do you know what's the circuit breaker value range for the setting you are changing?

b4sjoo commented 1 month ago

@zane-neo Meanwhile you need to add this setting to OpenSearch Document

zane-neo commented 1 month ago

@b4sjoo There's no range for this setting, this is the PR to document: https://github.com/opensearch-project/documentation-website/pull/7799/files

ylwu-amzn commented 1 month ago

@b4sjoo There's no range for this setting, this is the PR to document: https://github.com/opensearch-project/documentation-website/pull/7799/files

@zane-neo Can you test? I think should be >=0 ?

zane-neo commented 1 month ago

@b4sjoo There's no range for this setting, this is the PR to document: https://github.com/opensearch-project/documentation-website/pull/7799/files

@zane-neo Can you test? I think should be >=0 ?

Checked, it's [-1, Long.MAX_VALUE] and updated to the document.