[BUG] flaky org.opensearch.snapshots.CloneSnapshotIT.testShallowCloneNameAvailability test

[ashking94]

Describe the bug org.opensearch.snapshots.CloneSnapshotIT.testShallowCloneNameAvailability is flaky

To Reproduce org.opensearch.snapshots.CloneSnapshotIT.testShallowCloneNameAvailability

Expected behavior Test should always pass

Plugins Please list all plugins currently enabled.

Screenshots If applicable, add screenshots to help explain your problem.

Host/Environment (please complete the following information):

• OS: [e.g. iOS]
• Version [e.g. 22]

Additional context CI - https://build.ci.opensearch.org/job/gradle-check/25992/

[harishbhakuni]

not able to reproduce with the given seed:

./gradlew ':server:internalClusterTest' --tests "org.opensearch.snapshots.CloneSnapshotIT.testShallowCloneNameAvailability" -Dtests.seed=221689B6AE8054B1

> Configure project :
========================= WARNING =========================
         Backwards compatibility tests are disabled!
See https://github.com/opensearch-project/OpenSearch/issues/4173
===========================================================
=======================================
OpenSearch Build Hamster says Hello!
  Gradle Version        : 8.5
  OS Info               : Mac OS X 13.6.3 (aarch64)
  JDK Version           : 18 (Amazon Corretto JDK)
  JAVA_HOME             : /Library/Java/JavaVirtualMachines/amazon-corretto-18.jdk/Contents/Home
  Random Testing Seed   : 221689B6AE8054B1
  In FIPS 140 mode      : false
=======================================

> Task :server:internalClusterTest
Jan 22, 2024 10:47:32 AM sun.util.locale.provider.LocaleProviderAdapter <clinit>
WARNING: COMPAT locale provider will be removed in a future release

WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.BootstrapForTesting (file:/Volumes/workplace/os-fork/OpenSearch/test/framework/build/distributions/framework-3.0.0-SNAPSHOT.jar)
WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.BootstrapForTesting
WARNING: System::setSecurityManager will be removed in a future release
WARNING: A terminally deprecated method in java.lang.System has been called
WARNING: System::setSecurityManager has been called by org.gradle.api.internal.tasks.testing.worker.TestWorker (file:/Users/hbhakuni/.gradle/wrapper/dists/gradle-8.5-all/3zlzzgtsutfj0pbojr50n2l7z/gradle-8.5/lib/plugins/gradle-testing-base-8.5.jar)
WARNING: Please consider reporting this to the maintainers of org.gradle.api.internal.tasks.testing.worker.TestWorker
WARNING: System::setSecurityManager will be removed in a future release

BUILD SUCCESSFUL in 1m 14s

[harishbhakuni]

also was able to run it 50+ times in local without failure. we recently fixed couple of bugs as part of 2.11 in create and restore path and i think this issue was happening due to those bugs. @kasundra07 can you look into this and confirm if this is fixed or still going on?

[kasundra07]

Same for me. Tested multiple runs without failures. Not able to reproduce it using the same seed as well. Looks like it was fixed as part of those bug fixes @harishbhakuni mentioned. We can close it for now and reopen in case it fails.

[mch2]

Re-opeening, failed with https://github.com/opensearch-project/OpenSearch/pull/12877

[shourya035]

@harishbhakuni Please update the tracking release version for this and add the corresponding PR if it's already open