Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTOCUT] Gradle Check Flaky Test Report for IndicesRequestCacheIT #14288

Open
opensearch-ci-bot opened this issue Jun 13, 2024 · 5 comments
Open
Assignees
Labels
autocut flaky-test Random test failure that succeeds on second run Search:Performance >test-failure Test failure from CI, local build, etc.

Comments

@opensearch-ci-bot
Copy link
Collaborator

opensearch-ci-bot commented Jun 13, 2024

Flaky Test Report for IndicesRequestCacheIT

Noticed the IndicesRequestCacheIT has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference Merged Pull Request Build Details Test Name
194005e 13885 39647 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupSkipsWithHighStalenessThreshold {p0={"search.concurrent_segment_search.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
b06d0b9 14062 40165 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupOnEqualStalenessAndThreshold {p0={"search.concurrent_segment_search.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupWithDefaultSettings {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
2e49743 13869 39454 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testQueryRewrite {p0={"search.concurrent_segment_search.enabled":"false"}}
05fb780 13864 39402 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
0ddf4bd 12982 40066 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
1525a3f 13703 39843 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
156eca3 13785 39919 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
306e920 14035 40015 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
5919409 13945 39654 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
6ac4e4f 14047 40068 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
8cf895b 14026 40287 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
9bc536d 14036 40018 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
9da6170 13720 40067 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
a6c86e7 13906 39544 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
de13aca 13920 39716 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
e3d7e99 13942 39680 org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"false"}}

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"search.concurrent_segment_search.enabled":"true"}}
120678d 14086 41248 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testCacheClearanceAfterIndexClosure {p0={"search.concurrent_segment_search.enabled":"true"}}
5121409 13304 39858 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testQueryRewriteDates {p0={"search.concurrent_segment_search.enabled":"true"}}
71dbc22 14274 40946 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupSkipsWithHighStalenessThreshold {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
8599065 14028 40008 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysCleanupWithMultipleIndices {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
90ef844 14238 40848 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testDeleteAndCreateSameIndexShardOnSameNode {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
afeddc2 14037 40910 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testDynamicStalenessThresholdUpdate {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}
bb013da 13717 39669 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testQueryRewrite {p0={"search.concurrent_segment_search.enabled":"false"}}
c5c6024 13568 41256 org.opensearch.indices.IndicesRequestCacheIT.classMethod

org.opensearch.indices.IndicesRequestCacheIT.testCacheClearAPIRemovesStaleKeysWhenStalenessThresholdIsLow {p0={"search.concurrent_segment_search.enabled":"false"}}
0bc4832 16019 48183 org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
2528067 14400 41155 org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysCleanupWithMultipleIndices {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}
2e13e9c 14107 40782 org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
2e9db40 13788 46292 org.opensearch.indices.IndicesRequestCacheIT.testTimedOutQuery {p0={"search.concurrent_segment_search.enabled":"true"}}
3936671 14050 40310 org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
4035db4 14213 40812 org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"search.concurrent_segment_search.enabled":"false"}}
41cdfa3 13944 39681 org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupOnZeroStalenessThreshold {p0={"search.concurrent_segment_search.enabled":"true"}}
769fdc8 14937 43352 org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
89a7d75 15615 46531 org.opensearch.indices.IndicesRequestCacheIT.testTimedOutQuery {p0={"search.concurrent_segment_search.enabled":"true"}}
9c59780 14343 41004 org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"search.concurrent_segment_search.enabled":"true"}}
a1846cf 16077 48405 org.opensearch.indices.IndicesRequestCacheIT.testTimedOutQuery {p0={"search.concurrent_segment_search.enabled":"true"}}
a42e51d 16067 48412 org.opensearch.indices.IndicesRequestCacheIT.testQueryRewriteDatesWithNow {p0={"search.concurrent_segment_search.enabled":"true"}}
b01b6e8 13998 40004 org.opensearch.indices.IndicesRequestCacheIT.testStaleKeysRemovalWithoutExplicitThreshold {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"false"}}
c49eca4 13721 40576 org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
daf1669 15923 48414 org.opensearch.indices.IndicesRequestCacheIT.testTimedOutQuery {p0={"search.concurrent_segment_search.enabled":"true"}}
e2f12e5 16053 48400 org.opensearch.indices.IndicesRequestCacheIT.testTimedOutQuery {p0={"search.concurrent_segment_search.enabled":"true"}}
e7ad37d 16174 48822 org.opensearch.indices.IndicesRequestCacheIT.testCacheWithFilteredAlias {p0={"search.concurrent_segment_search.enabled":"true"}}
e9b6a8d 13590 40040 org.opensearch.indices.IndicesRequestCacheIT.testDynamicStalenessThresholdUpdate {p0={"opensearch.experimental.feature.pluggable.caching.enabled":"true"}}
f8213b8 14357 41268 org.opensearch.indices.IndicesRequestCacheIT.testCacheCleanupWithDefaultSettings {p0={"search.concurrent_segment_search.enabled":"false"}}
fc1bf2c 15759 47451 org.opensearch.indices.IndicesRequestCacheIT.testTimedOutQuery {p0={"search.concurrent_segment_search.enabled":"true"}}

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the IndicesRequestCacheIT class are:

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

@opensearch-ci-bot opensearch-ci-bot added >test-failure Test failure from CI, local build, etc. autocut untriaged labels Jun 13, 2024
@prudhvigodithi prudhvigodithi added the flaky-test Random test failure that succeeds on second run label Jun 14, 2024
@getsaurabh02
Copy link
Member

Untriaged as part of the Search Community Meeting. @kiranprakash154 is going to look into this.

@sandeshkr419
Copy link
Contributor

One more failure: https://build.ci.opensearch.org/job/gradle-check/41656/

Noting here for stack trace reference.

@kiranprakash154
Copy link
Contributor

kiranprakash154 commented Jul 22, 2024

This seems to be outdated
The fix has been merged on June 20 - #14369
Closing this out since I haven't received any reports of flakiness yet.
(cc: @kkhatua )

@andrross
Copy link
Member

andrross commented Nov 5, 2024

@sgup432 Here is another failure of "testTimedOutQuery" that happened after your fix in #16276: https://build.ci.opensearch.org/job/gradle-check/50411/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
autocut flaky-test Random test failure that succeeds on second run Search:Performance >test-failure Test failure from CI, local build, etc.
Projects
Status: 🏗 In progress
Development

No branches or pull requests

7 participants