[BUG] org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testContainerCreationAndDeletion / org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testReadRange are flaky

[ashking94]

Describe the bug
org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testContainerCreationAndDeletion is flaky.

Below is the exception thrown -

java.nio.file.FileAlreadyExistsException: foo/test: Status code 409, "<?xml version="1.0" encoding="UTF-8"?><Error><Code>BlobAlreadyExists</Code><Message>CONFLICT</Message></Error>"

RepositoryVerificationException[[fk] path  is not accessible on cluster-manager node]; nested: FileAlreadyExistsException[tests-jnHit112SoK5QkCcNmujXA/master.dat: Status code 409, "<?xml version="1.0" encoding="UTF-8"?><Error><Code>BlobAlreadyExists</Code><Message>CONFLICT</Message></Error>"];
	at app//org.opensearch.repositories.blobstore.BlobStoreRepository.startVerification(BlobStoreRepository.java:1887)
	at app//org.opensearch.repositories.RepositoriesService$3.doRun(RepositoriesService.java:373)
	at app//org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:911)
	at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52)
	at [email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at [email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at [email protected]/java.lang.Thread.run(Thread.java:1583)
Caused by: java.nio.file.FileAlreadyExistsException: tests-jnHit112SoK5QkCcNmujXA/master.dat: Status code 409, "<?xml version="1.0" encoding="UTF-8"?><Error><Code>BlobAlreadyExists</Code><Message>CONFLICT</Message></Error>"
	at org.opensearch.repositories.azure.AzureBlobStore.writeBlob(AzureBlobStore.java:379)
	at org.opensearch.repositories.azure.AzureBlobContainer.writeBlob(AzureBlobContainer.java:133)
	at org.opensearch.repositories.azure.AzureBlobContainer.writeBlobAtomic(AzureBlobContainer.java:141)
	at org.opensearch.repositories.blobstore.BlobStoreRepository.startVerification(BlobStoreRepository.java:1879)
	... 6 more

To Reproduce
https://build.ci.opensearch.org/job/gradle-check/29044/testReport/junit/org.opensearch.repositories.azure/AzureBlobStoreRepositoryTests/testContainerCreationAndDeletion/

https://build.ci.opensearch.org/job/gradle-check/30312/testReport/junit/org.opensearch.repositories.azure/AzureBlobStoreRepositoryTests/testReadRange/

Expected behavior
The test must always pass.

[gbbafna]

@shourya035 , can you please take this up ?

[bowenlan-amzn]

Come across a similar test failure
org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testWriteRead

[sandeshkr419]

Flaky: https://build.ci.opensearch.org/job/gradle-check/40891/

[reta]

Closing in favour of #14291