Retry only specified tests #8825
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
andrross
requested review from
reta,
anasalkouz,
Bukhtawar,
CEHENKLE,
dblock,
gbbafna,
setiah,
kartg,
kotwanikunal,
mch2,
nknize,
owaiskazi19,
Rishikesh1159,
ryanbogan,
saratvemulapalli,
shwetathareja,
dreamer-89,
tlfeng,
VachaShah,
dbwiddis and
sachinpkale
as code owners
Gradle Check (Jenkins) Run Completed with:
|
Codecov Report
@@ Coverage Diff @@
## main #8825 +/- ##
============================================
+ Coverage 71.06% 71.10% +0.03%
+ Complexity 57241 57236 -5
============================================
Files 4757 4757
Lines 269804 269804
Branches 39454 39454
============================================
+ Hits 191733 191831 +98
+ Misses 61870 61791 -79
+ Partials 16201 16182 -19 |
kotwanikunal
approved these changes
Jul 24, 2023
|
@andrross Should we outline the process to add or remove these tests in one of the readmes? |
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <[email protected]>
andrross
force-pushed
the
retry-explicit-tests
branch
from
554e680
to
64ea3a4
Compare
@kotwanikunal I added a section to the TESTING.md documentation |
kotwanikunal
approved these changes
Jul 24, 2023
Gradle Check (Jenkins) Run Completed with:
|
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Jul 24, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <[email protected]> (cherry picked from commit 5d78de6) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
dreamer-89
pushed a commit
that referenced
this pull request
Jul 26, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 (cherry picked from commit 5d78de6) Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
andrross
added a commit
to andrross/OpenSearch
that referenced
this pull request
Jul 27, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]>
6 tasks
andrross
added a commit
that referenced
this pull request
Jul 27, 2023
The intent of #8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]>
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Jul 27, 2023
The intent of #8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]> (cherry picked from commit 5495c64) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
kotwanikunal
pushed a commit
that referenced
this pull request
Jul 28, 2023
The intent of #8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering (cherry picked from commit 5495c64) Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
baba-devv
pushed a commit
to baba-devv/OpenSearch
that referenced
this pull request
Jul 28, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]>
baba-devv
pushed a commit
to baba-devv/OpenSearch
that referenced
this pull request
Jul 29, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <[email protected]>
baba-devv
pushed a commit
to baba-devv/OpenSearch
that referenced
this pull request
Jul 29, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]>
4 tasks
kaushalmahi12
pushed a commit
to kaushalmahi12/OpenSearch
that referenced
this pull request
Sep 12, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: Kaushal Kumar <[email protected]>
kaushalmahi12
pushed a commit
to kaushalmahi12/OpenSearch
that referenced
this pull request
Sep 12, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: Kaushal Kumar <[email protected]>
brusic
pushed a commit
to brusic/OpenSearch
that referenced
this pull request
Sep 25, 2023
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: Ivan Brusic <[email protected]>
brusic
pushed a commit
to brusic/OpenSearch
that referenced
this pull request
Sep 25, 2023
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: Ivan Brusic <[email protected]>
shiv0408
pushed a commit
to Gaurav614/OpenSearch
that referenced
this pull request
Apr 25, 2024
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The [flaky-test-finder.rb][1] script was used to collect this list. ``` ruby flaky-test-finder.rb -s 18000 -e 20681 | sed 's/[0-9]*[[:space:]]\(.*\)\..*/includeClasses\.add(\"\1\")/' | sort | uniq ``` [1]: https://gist.github.com/andrross/ee07a8a05beb63f1173bcb98523918b9 Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: Shivansh Arora <[email protected]>
shiv0408
pushed a commit
to Gaurav614/OpenSearch
that referenced
this pull request
Apr 25, 2024
The intent of opensearch-project#8825 was to retry only specified tests. The wrong parameter was configured though: ['filter' should be set][1], not 'classRetry'. [1]: https://github.com/gradle/test-retry-gradle-plugin/blob/main/README.adoc#filtering Signed-off-by: Andrew Ross <[email protected]> Signed-off-by: Shivansh Arora <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This list was compiled by finding every test failure that succeeded on a retry in the past month (approx. June 20-July 20, 2023). The flaky-test-finder.rb script was used to collect this list.
Full test failure details
227 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testNodeDropWithOngoingReplication (18079,18079,18420,18425,18426,18467,18482,18485,18487,18489,18489,18492,18495,18496,18497,18499,18502,18510,18510,18516,18517,18517,18519,18526,18526,18531,18533,18534,18534,18537,18539,18541,18542,18543,18546,18550,18555,18563,18568,18575,18583,18595,18595,18595,18596,18599,18599,18599,18600,18606,18610,18611,18612,18614,18615,18616,18618,18619,18620,18624,18625,18627,18628,18629,18630,18631,18633,18635,18635,18648,18649,18653,18659,18660,18667,18667,18672,18680,18685,18707,18712,18723,18724,18728,18728,18732,18738,18739,18739,18746,18757,18762,18763,18766,18775,18777,18777,18781,18782,18795,18796,18800,18801,18804,18804,18805,18808,18811,18815,18817,18818,18821,18826,18830,18832,18837,18838,18841,18841,18842,18852,18856,18857,18857,18861,18867,18871,18873,18873,18876,18879,18879,18879,18888,18889,18895,18900,18919,18920,18934,18947,18947,18947,18950,18951,18953,18956,18959,18962,18968,18974,18976,18977,18979,18982,18983,18983,18989,18989,18989,18991,18993,18993,18998,18999,19001,19002,19008,19009,19013,19013,19019,19021,19025,19029,19038,19041,19047,19048,19051,19053,19054,19055,19056,19060,19061,19062,19063,19063,19065,19066,19068,19069,19069,19075,19077,19080,19084,19090,19091,19092,19092,19093,19094,19099,19101,19102,19102,19106,19107,19109,19118,19119,19127,19135,19142,19142,19147,19152,19154,19157,19157,19159,19166,19168,19183,19193) 149 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testDropPrimaryDuringReplication (18001,18001,18001,18021,18031,18040,18076,18079,18091,18099,18126,18139,18140,18160,18193,18197,18202,18219,18219,18230,18265,18280,18306,18320,18345,18348,18361,18365,18377,18389,18389,18404,18435,18489,18510,18517,18526,18534,18539,18543,18577,18605,18612,18624,18624,18635,18667,18719,18728,18728,18763,18777,18782,18801,18804,18807,18826,18830,18857,18873,18888,18895,18974,18983,18993,19004,19013,19024,19029,19063,19069,19101,19102,19120,19142,19156,19157,19170,19176,19195,19202,19222,19275,19289,19290,19319,19321,19335,19391,19418,19428,19437,19465,19495,19520,19521,19564,19577,19644,19654,19654,19690,19704,19716,19729,19729,19729,19775,19842,19850,19859,19901,19904,19909,19914,19922,19924,19934,19937,19940,19960,19974,19993,20002,20026,20027,20027,20035,20043,20046,20046,20056,20063,20070,20070,20076,20129,20163,20179,20213,20348,20372,20376,20377,20399,20405,20423,20461,20487) 147 org.opensearch.search.SearchWeightedRoutingIT.testStrictWeightedRoutingWithCustomString (18022,18043,18043,18088,18088,18202,18202,18280,18296,18351,18351,18365,18365,18373,18389,18389,18389,18415,18415,18454,18454,18506,18509,18569,18626,18626,18626,18654,18696,18696,18700,18701,18730,18730,18730,18806,18806,18806,18807,18810,18810,18816,18816,18833,18833,19010,19024,19026,19026,19033,19039,19052,19070,19070,19163,19187,19195,19195,19200,19202,19266,19292,19336,19398,19398,19406,19418,19442,19442,19463,19463,19472,19472,19474,19474,19474,19492,19492,19494,19514,19514,19518,19520,19520,19521,19521,19542,19542,19555,19562,19619,19619,19789,19789,19821,19824,19853,19853,19859,19859,19888,19903,19940,19940,19947,19961,19969,19985,19985,19985,19986,19987,19987,19993,19993,19993,19997,20008,20008,20014,20014,20023,20023,20023,20026,20037,20041,20048,20051,20095,20159,20163,20170,20170,20177,20230,20230,20324,20390,20455,20482,20482,20487,20580,20673,20673,20673) 101 org.opensearch.remotestore.RemoteStoreRefreshListenerIT.testRemoteRefreshRetryOnFailure (18020,18054,18060,18063,18074,18074,18074,18107,18110,18126,18143,18163,18182,18193,18205,18219,18225,18225,18230,18260,18269,18285,18293,18313,18338,18338,18348,18361,18371,18371,18379,18385,18393,18393,18467,18541,18541,18541,18543,18583,18611,18611,18612,18612,18624,18672,18705,18705,18712,18727,18727,18728,18728,18738,18763,18763,18766,18782,18782,18817,18817,18817,18821,18823,18823,18833,18852,18873,18873,18968,18977,18981,18981,19019,19021,19052,19052,19056,19056,19062,19107,19133,19168,19171,19171,19198,19198,19238,19282,19341,19359,19359,19388,19422,19454,19454,19459,19503,19509,19509,19968) 75 org.opensearch.cluster.allocation.AwarenessAllocationIT.testThreeZoneOneReplicaWithForceZoneValueAndLoadAwareness (18021,18040,18042,18072,18150,18255,18320,18335,18377,18412,18425,18497,18516,18575,18606,18624,18627,18630,18724,18728,18804,18805,18808,18900,18950,18999,19056,19069,19080,19101,19118,19188,19233,19245,19276,19289,19308,19321,19343,19399,19428,19430,19475,19644,19652,19654,19681,19684,19693,19698,19730,19757,19761,19767,19866,19870,19901,19904,19960,19978,19999,20040,20080,20089,20178,20291,20322,20330,20352,20402,20529,20598,20604,20644,20676) 65 org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithInvokeFlush (19251,19251,19272,19277,19329,19329,19331,19331,19335,19343,19358,19372,19373,19373,19373,19568,19582,19598,19607,19626,19650,19653,19659,19670,19674,19679,19727,19752,19759,19785,19814,19830,19833,19854,19857,19875,19917,19919,19923,19960,19968,19999,20043,20078,20105,20162,20165,20222,20225,20261,20296,20312,20315,20325,20378,20386,20394,20399,20405,20408,20424,20573,20575,20596,20602) 54 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPressureServiceStats (18040,18043,18057,18067,18088,18187,18197,18197,18198,18198,18207,18207,18207,18210,18222,18285,18286,18286,18294,18294,18294,18296,18356,18373,18375,18375,18393,18393,18397,18401,18415,18415,18427,18435,18505,18506,18509,18569,18577,18577,18605,18626,18645,18645,18654,18671,18696,18696,18716,18716,18716,18727,18727,20646) 50 org.opensearch.cluster.service.MasterServiceTests.classMethod (18106,18106,18184,18184,18379,18379,18563,18563,18568,18568,18575,18575,18672,18672,18723,18723,18738,18738,19013,19013,19013,19013,19056,19056,19056,19056,19094,19094,19397,19397,19397,19397,19397,19397,19541,19541,19633,19633,19718,19718,19825,19825,19825,19825,20298,20298,20305,20305,20613,20613) 48 org.opensearch.indices.replication.SegmentReplicationIT.testScrollCreatedOnReplica (18029,18048,18060,18140,18232,18324,18365,18404,18409,18539,18596,18627,18629,18727,18730,18757,18834,19172,19193,19242,19336,19356,19405,19441,19492,19586,19597,19626,19631,19698,19731,19742,19767,19879,19910,19952,19975,19978,20043,20162,20213,20223,20240,20273,20313,20449,20530,20647) 45 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testBasicTaskResourceTracking (18044,18113,18143,18193,18213,18265,18269,18360,18385,18467,18497,18611,18833,18857,18871,18895,19048,19094,19181,19199,19233,19358,19368,19534,19613,19619,19671,19752,19888,19897,19919,19950,19955,19960,19997,20175,20220,20230,20231,20288,20317,20320,20392,20644,20663) 44 org.opensearch.cluster.routing.MovePrimaryFirstTests.testClusterGreenAfterPartialRelocation (18013,18176,18200,18201,18209,18228,18233,18236,18237,18573,18574,18582,18587,18592,18593,18604,18697,18718,18740,18742,18743,18747,18750,18756,18835,18843,18844,18851,18855,19161,19173,19174,20020,20100,20174,20238,20247,20264,20383,20456,20463,20486,20572,20650) 44 org.opensearch.cluster.routing.MovePrimaryFirstTests.classMethod (18013,18176,18200,18201,18209,18228,18233,18236,18237,18573,18574,18582,18587,18592,18593,18604,18697,18718,18740,18742,18743,18747,18750,18756,18835,18843,18844,18851,18855,19161,19173,19174,20020,20100,20174,20238,20247,20264,20383,20456,20463,20486,20572,20650) 42 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.classMethod (18492,18492,18667,18667,18808,18808,18818,18818,19008,19008,19038,19038,19354,19354,19369,19369,19396,19396,19449,19449,19501,19501,19653,19653,19862,19862,19875,19875,19942,19942,20046,20046,20091,20091,20230,20230,20240,20240,20298,20298,20443,20443) 38 org.opensearch.snapshots.DedicatedClusterSnapshotRestoreIT.testIndexDeletionDuringSnapshotCreationInQueue (18005,18015,18128,18143,18207,18222,18224,18260,18265,18353,18405,18425,18542,18763,18821,18823,18951,19048,19080,19276,19366,19395,19508,19601,19730,19751,19901,19904,19924,20026,20031,20050,20118,20129,20348,20484,20545,20655) 35 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocation (18499,18633,18645,18660,18979,19014,19021,19118,19135,19142,19330,19418,19539,19713,19720,19854,19859,19887,19887,19891,19935,19941,19967,20007,20071,20085,20145,20179,20240,20330,20399,20484,20525,20525,20557) 34 org.opensearch.remotestore.multipart.RemoteStoreMultipartIT.testStaleCommitDeletionWithInvokeFlush (19917,19919,19942,19960,19965,19967,19968,19984,20043,20063,20070,20078,20126,20135,20165,20165,20168,20259,20261,20262,20298,20315,20325,20333,20366,20378,20392,20399,20405,20476,20540,20567,20573,20596) 34 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.classMethod (18048,18048,18404,18404,18616,18616,19054,19054,19119,19119,19156,19156,19331,19331,19331,19331,19395,19395,19584,19584,19629,19629,19681,19681,19718,19718,19733,19733,19825,19825,19844,19844,19937,19937) 33 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreInSameRemoteStoreEnabledIndex (18537,18550,18555,18575,18577,18595,18596,18611,18620,18628,18630,18660,18680,18680,18705,18727,18728,18738,18739,18757,18758,18775,18801,18842,18842,18989,18991,19004,19013,19016,19061,19068,19127) 30 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testPressureServiceStats (18492,18808,18818,19008,19038,19272,19354,19369,19396,19449,19501,19613,19862,19875,19909,19909,19909,19964,19967,19967,20091,20298,20304,20304,20312,20364,20364,20364,20443,20443) 30 org.opensearch.remotestore.RemoteStoreIT.testStaleCommitDeletionWithoutInvokeFlush (19243,19251,19276,19294,19308,19318,19319,19325,19329,19330,19331,19341,19350,19354,19358,19358,19369,19373,19373,19389,19433,19441,19591,19623,19650,19733,19742,19785,19785,19788) 27 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testPrimaryRelocationWithSegRepFailure (18027,18610,19061,19289,19323,19343,19358,19636,19759,19764,19919,19919,19919,19935,20023,20058,20071,20089,20089,20261,20283,20399,20531,20671,20671,20675,20681) 26 org.opensearch.search.backpressure.SearchBackpressureIT.testSearchShardTaskCancellationWithHighCpu (18015,18023,18029,18031,18034,18044,18048,18051,18062,18085,18110,18115,18120,18122,18131,18137,18149,18152,18184,18185,18193,18213,18246,18270,18333,18429) 25 org.opensearch.cluster.service.MasterServiceTests.testThrottlingForMultipleTaskTypes (18106,18184,18379,18563,18568,18575,18672,18723,18738,19013,19013,19056,19056,19094,19397,19397,19397,19541,19633,19718,19825,19825,20298,20305,20613) 23 org.opensearch.search.SearchWeightedRoutingIT.testSearchAggregationWithNetworkDisruption_FailOpenEnabled (18221,18327,18381,18420,18563,18628,18757,19008,19060,19077,19313,19388,19455,19640,19759,19858,19875,20062,20149,20149,20179,20276,20476) 23 org.opensearch.cluster.allocation.ClusterRerouteIT.testDelayWithALargeAmountOfShards (18131,18139,18324,18342,18403,18467,18489,18725,18804,18841,19109,19198,19334,19497,19517,19660,19833,19991,20052,20141,20276,20331,20405) 20 org.opensearch.search.backpressure.SearchBackpressureIT.testSearchTaskCancellationWithHighCpu (18001,18004,18005,18016,18032,18042,18045,18053,18060,18063,18072,18083,18107,18119,18128,18156,18195,18273,18320,18430) 20 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testStartReplicationListenerSuccess (18011,18039,18060,18114,18196,18224,18255,18283,18296,18340,18373,18397,18410,18981,19004,19016,19192,19290,19422,19514) 18 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicaHasDiffFilesThanPrimary (18645,18700,18700,18700,18730,18739,18782,18810,19016,19171,19171,19266,19391,19482,19550,19725,20646,20680) 17 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPitCreatedOnReplica (18308,18833,18834,18888,19092,19318,19321,19504,19519,19635,19661,19737,19761,19914,19964,20008,20313) 16 org.opensearch.indices.replication.SegmentReplicationIT.testDropPrimaryDuringReplication (19451,19477,19551,19570,19657,19670,19704,19733,19733,20094,20339,20511,20522,20522,20541,20675) 16 org.opensearch.index.IndexSettingsTests.testDefaultSearchPipelineWithoutFeatureFlag (20320,20361,20366,20372,20376,20377,20378,20386,20392,20394,20395,20396,20397,20402,20404,20408) 15 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testCancellation (18467,18517,19056,19062,19395,19395,19614,19850,19978,20123,20168,20168,20367,20378,20487) 13 org.opensearch.indices.replication.SegmentReplicationRelocationIT.testRelocateWhileContinuouslyIndexingAndWaitingForRefresh (18680,18680,19783,19901,19913,19997,20118,20157,20163,20177,20240,20288,20288) 12 org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=pit/10_basic/Delete all} (18042,18088,18182,18738,18782,18989,19209,19463,19731,20449,20557,20644) 12 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testPrimaryStopped_ReplicaPromoted (18244,18258,18841,19199,19517,19551,19623,19651,19935,19958,20145,20306) 12 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.classMethod (18085,18085,18364,18364,18974,18974,19356,19356,19558,19558,19608,19608) 12 org.opensearch.index.IndexServiceTests.testAsyncTranslogTrimTaskOnClosedIndex (18027,18079,18728,18900,19063,19504,19578,19678,19875,20386,20423,20490) 10 org.opensearch.indices.replication.SegmentReplicationIT.testPitCreatedOnReplica (18022,19549,19619,19706,19718,19956,19958,20107,20367,20397) 10 org.opensearch.gateway.RecoveryFromGatewayIT.testReuseInFileBasedPeerRecovery (18039,18220,18265,19308,19373,19418,19495,19555,19664,20229) 9 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreRemoteStoreIndicesWithoutRemoteTranslog (18534,18542,18580,18680,18766,18861,18977,19009,19108) 9 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreRemoteStoreIndicesWithRemoteTranslog (18531,18534,18542,18680,18766,18861,18861,18920,19108) 9 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessAfterFailureInFirstAttemptAfterSnapshotAndMetadataUpload (18048,18404,18616,19054,19119,19156,19733,19825,20339) 9 org.opensearch.index.reindex.BulkByScrollResponseTests.testFromXContent (20020,20100,20174,20238,20247,20264,20383,20486,20572) 8 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testReplicaHasDiffFilesThanPrimary (19062,20404,20443,20476,20476,20493,20493,20523) 8 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testShardAlreadyReplicating (19984,20235,20469,20503,20525,20556,20580,20613) 8 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttemptAttempt (19308,19348,19436,19436,19436,19511,19511,19927) 8 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testTaskResourceTrackingDuringTaskCancellation (18276,18415,18489,19062,19817,19952,20074,20590) 7 org.opensearch.search.SearchTimeoutIT.testSimpleTimeout (19539,19774,19834,20168,20352,20529,20580) 7 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testCancelPrimaryAllocation (18206,19202,19205,19385,19672,20487,20638) 7 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testDropPrimaryDuringReplication (19935,20063,20157,20229,20229,20229,20240) 7 org.opensearch.indices.replication.SegmentReplicationIT.testReplicationPostDeleteAndForceMerge (18042,18127,19133,19249,19555,19678,20165) 7 org.opensearch.indices.replication.SegmentReplicationAllocationIT.testSingleIndexShardAllocation (18120,18712,18871,19211,19242,19974,20672) 6 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testRestartPrimary (18120,18144,18685,20001,20044,20095) 6 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testScrollWithConcurrentIndexAndSearch (19653,19698,19942,20046,20230,20240) 6 org.opensearch.remotestore.CreateRemoteIndexClusterDefaultDocRep.testRemoteStoreTranslogDisabledByUser (18039,18313,18365,19519,19942,20647) 6 org.opensearch.indices.replication.SegmentReplicationIT.testCancellation (18624,18781,18953,19127,19159,19562) 6 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshAfterCommit (19331,19331,19395,19584,19681,19718) 6 org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.testIndexCreateBlockIsRemovedWhenAnyNodesNotExceedHighWatermarkWithAutoReleaseEnabled (18225,18672,18757,19311,19945,20618) 6 org.opensearch.cluster.metadata.IndexGraveyardTests.testXContent (20020,20100,20174,20247,20486,20572) 5 org.opensearch.upgrade.DetectEsInstallationTaskTests.testTaskExecution (18697,18697,18697,18843,18843) 5 org.opensearch.search.pit.DeletePitMultiNodeIT.testDeleteWhileSearch (18115,18611,19785,19967,20506) 5 org.opensearch.search.ConcurrentSegmentSearchTimeoutIT.testSimpleTimeout (19536,19578,20098,20275,20635) 5 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testScrollCreatedOnReplica (20443,20443,20484,20522,20530) 5 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetSegmentFiles (18085,19356,19608,19888,19937) 5 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnSecondAttempt (19008,19330,19373,19426,19445) 4 org.opensearch.search.aggregations.bucket.DoubleTermsIT.classMethod (19070,19070,19070,19070) 4 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testReadRangeBlobWithRetries (19106,19108,19183,19736) 4 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testReadNonexistentBlobThrowsNoSuchFileException (18205,18871,19251,19690) 4 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testReadBlobWithRetries (19118,19494,19658,20138) 4 org.opensearch.remotestore.multipart.RemoteStoreMultipartIT.testStaleCommitDeletionWithoutInvokeFlush (20078,20122,20129,20141) 4 org.opensearch.indices.replication.SegmentReplicationIT.classMethod (20367,20397,20449,20625) 3 org.opensearch.test.rest.ClientYamlTestSuiteIT.test {p0=search.aggregation/20_terms/string profiler via global ordinals} (18220,19650,19792) 3 org.opensearch.snapshots.RestoreSnapshotIT.testRestoreShallowCopySnapshotWithDifferentRepo (18815,18823,18842) 3 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testSnapshotAndRestore (18054,19422,19651) 3 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testWriteBlobWithRetries (19250,19564,19887) 3 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testReplicationAfterForceMerge (19166,19995,20286) 3 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testPrimaryStopped_ReplicaPromoted (19485,19771,20298) 3 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testPitCreatedOnReplica (20450,20476,20523) 3 org.opensearch.remotestore.CreateRemoteIndexIT.testRemoteStoreOverrideTranslogDisabledCorrectly (19368,19898,20051) 3 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetCheckpointMetadata (18364,19558,20042) 3 org.opensearch.index.translog.RemoteFSTranslogTests.testMetadataFileDeletion (19430,19610,20548) 3 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testAfterCommit (19629,19844,19937) 3 org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting (18185,18230,18365) 3 org.opensearch.http.SearchRestCancellationIT.testAutomaticCancellationDuringFetchPhase (18821,19941,20424) 3 org.opensearch.cluster.ClusterHealthIT.testHealthOnClusterManagerFailover (19184,19924,20313) 3 org.opensearch.client.ReindexIT.testReindexTask (18275,18342,19718) 3 org.opensearch.client.PitIT.testDeleteAllAndListAllPits (18195,19195,20663) 2 org.opensearch.snapshots.SnapshotStatusApisIT.testStatusAPIStatsForBackToBackShallowSnapshot (20063,20450) 2 org.opensearch.snapshots.SnapshotStatusApisIT.testStatusAPICallForShallowCopySnapshot (19914,19988) 2 org.opensearch.snapshots.CloneSnapshotIT.testCloneShallowSnapshotIndex (19553,19610) 2 org.opensearch.snapshots.CloneSnapshotIT.testCloneAfterRepoShallowSettingDisabled (19466,19811) 2 org.opensearch.search.SearchWeightedRoutingIT.testShardRoutingWithNetworkDisruption_FailOpenEnabled (20298,20482) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testWriteRead (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testSnapshotWithLargeSegmentFiles (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testMultipleSnapshotAndRollback (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testDeleteBlobs (19184,19788) 2 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.classMethod (19184,19788) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testSnapshotWithLargeSegmentFiles (18054,19651) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testList (18054,19651) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testIndicesDeletedFromRepository (18054,19651) 2 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testDeleteBlobs (18054,19651) 2 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.classMethod (20646,20646) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testRestartPrimary (19491,19997) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testReplicationPostDeleteAndForceMerge (18763,20511) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testIndexReopenClose (18667,20109) 2 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testCancelPrimaryAllocation (19093,20516) 2 org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimarySingleReplica (20395,20395) 2 org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimaryMultipleReplicaShards (20396,20518) 2 org.opensearch.remotestore.RemoteStoreIT.testRemoteTranslogCleanup (18800,18800) 2 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.classMethod (19628,19628) 2 org.opensearch.monitor.fs.FsHealthServiceTests.testFailsHealthOnHungIOBeyondHealthyTimeout (20596,20604) 2 org.opensearch.indices.replication.SegmentReplicationRelocationIT.classMethod (20525,20671) 2 org.opensearch.index.ShardIndexingPressureIT.testShardIndexingPressureTrackingDuringBulkWrites (18234,19704) 2 org.opensearch.http.netty4.Netty4HttpServerTransportTests.testLargeCompressedResponse (18697,18756) 2 org.opensearch.common.util.concurrent.QueueResizableOpenSearchThreadPoolExecutorTests.classMethod (19264,19264) 2 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search/90_search_after/date} (19480,19480) 2 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=pit/10_basic/Delete all} (19454,20390) 2 org.opensearch.action.admin.indices.create.CreateIndexIT.testCreateAndDeleteIndexConcurrently (18056,18403) 2 org.opensearch.action.admin.indices.create.CreateIndexIT.classMethod (18056,18403) 2 org.opensearch.action.admin.cluster.tasks.PendingTasksBlocksIT.testPendingTasksWithClusterNotRecoveredBlock (19442,19959) 1 org.opensearch.snapshots.SnapshotStatusApisIT.testStatusAPICallInProgressShallowSnapshot (20056) 1 org.opensearch.snapshots.SnapshotStatusApisIT.testCorrectCountsForDoneShards (19988) 1 org.opensearch.search.basic.SearchWithRandomIOExceptionsIT.testRandomDirectoryIOExceptions (18396) 1 org.opensearch.search.basic.SearchWithRandomIOExceptionsIT.classMethod (18396) 1 org.opensearch.search.aggregations.metrics.CardinalityIT.classMethod (19720) 1 org.opensearch.search.aggregations.bucket.terms.StringTermsIT.classMethod (19731) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testReadNonExistingPath (19788) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testList (19184) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testIndicesDeletedFromRepository (19184) 1 org.opensearch.repositories.s3.S3BlobStoreRepositoryTests.testContainerCreationAndDeletion (19788) 1 org.opensearch.repositories.gcs.GoogleCloudStorageBlobStoreRepositoryTests.classMethod (19329) 1 org.opensearch.repositories.gcs.GoogleCloudStorageBlobContainerRetriesTests.testReadBlobWithPrematureConnectionClose (19608) 1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testWriteRead (18054) 1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testReadNonExistingPath (18136) 1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testMultipleSnapshotAndRollback (18054) 1 org.opensearch.repositories.azure.AzureBlobContainerRetriesTests.testWriteLargeBlob (20168) 1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicationAfterPrimaryRefreshAndFlush (19934) 1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testReplicationAfterForceMerge (20612) 1 org.opensearch.remotestore.SegmentReplicationUsingRemoteStoreIT.testIndexReopenClose (20036) 1 org.opensearch.remotestore.SegmentReplicationRemoteStoreIT.testNodeDropWithOngoingReplication (20476) 1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsResponseFromLocalNode (20525) 1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsOnShardUnassigned (20396) 1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsOnRemoteStoreRestore (20395) 1 org.opensearch.remotestore.RemoteStoreIT.testRemoteSegmentCleanup (18800) 1 org.opensearch.remotestore.RemoteStoreBackpressureIT.testWritesRejectedDueToTimeLagBreach (19162) 1 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing (19628) 1 org.opensearch.remotestore.CreateRemoteIndexTranslogDisabledIT.testRemoteStoreTranslogDisabledByUser (18115) 1 org.opensearch.remotestore.CreateRemoteIndexTranslogDisabledIT.testDefaultRemoteStoreNoUserOverride (20313) 1 org.opensearch.remotestore.CreateRemoteIndexIT.testRemoteStoreTranslogDisabledByUser (18833) 1 org.opensearch.remotestore.CreateRemoteIndexIT.testRemoteStoreOverrideTranslogRepoCorrectly (19761) 1 org.opensearch.remotestore.CreateRemoteIndexIT.classMethod (19761) 1 org.opensearch.recovery.ReplicationCollectionTests.testStartMultipleReplicationsForSingleShard (19465) 1 org.opensearch.indices.state.CloseWhileRelocatingShardsIT.testCloseWhileRelocatingShards (19939) 1 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testsSuccessfulReplication_listenerCompletes (19433) 1 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.testOnNewCheckpointFromNewPrimaryCancelOngoingReplication (19577) 1 org.opensearch.indices.replication.SegmentReplicationTargetServiceTests.classMethod (19577) 1 org.opensearch.indices.replication.SegmentReplicationIT.testScrollWithConcurrentIndexAndSearch (19914) 1 org.opensearch.indices.replication.SegmentReplicationIT.testReplicationAfterPrimaryRefreshAndFlush (20625) 1 org.opensearch.indices.replication.SegmentReplicationIT.testReplicaHasDiffFilesThanPrimary (20165) 1 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetSegmentFilesFailure (20006) 1 org.opensearch.indices.replication.RemoteStoreReplicationSourceTests.testGetCheckpointMetadataFailure (18974) 1 org.opensearch.indices.DateMathIndexExpressionsIntegrationIT.testIndexNameDateMathExpressions (18136) 1 org.opensearch.indices.DateMathIndexExpressionsIntegrationIT.testAutoCreateIndexWithDateMathExpression (19475) 1 org.opensearch.index.translog.RemoteFSTranslogTests.testConcurrentWriteViewsAndSnapshot (19887) 1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshSuccessOnThirdAttempt (19937) 1 org.opensearch.index.shard.IndexShardIT.testIndexCanChangeCustomDataPath (18136) 1 org.opensearch.index.reindex.UpdateByQueryBasicTests.testMultipleSources (19092) 1 org.opensearch.index.reindex.DeleteByQueryBasicTests.testMultipleSources (20675) 1 org.opensearch.index.ShardIndexingPressureSettingsIT.classMethod (18230) 1 org.opensearch.index.SegmentReplicationPressureIT.testBelowReplicaLimit (20074) 1 org.opensearch.index.SegmentReplicationPressureIT.testAddReplicaWhileWritesBlocked (20213) 1 org.opensearch.http.SearchRestCancellationIT.testAutomaticCancellationMultiSearchDuringFetchPhase (18342) 1 org.opensearch.http.SearchRestCancellationIT.testAutomaticCancellationDuringQueryPhase (18034) 1 org.opensearch.gateway.ReplicaShardAllocatorIT.testPreferCopyWithHighestMatchingOperations (19021) 1 org.opensearch.common.util.concurrent.QueueResizableOpenSearchThreadPoolExecutorTests.testResizeQueueDown (19264) 1 org.opensearch.cluster.coordination.AwarenessAttributeDecommissionIT.testNodesRemovedAfterZoneDecommission_ClusterManagerNotInToBeDecommissionedZone (18166) 1 org.opensearch.client.ReindexIT.testDeleteByQueryTask (20604) 1 org.opensearch.client.PitIT.testCreateAndDeletePit (19195) 1 org.opensearch.blocks.SimpleBlocksIT.testAddBlockWhileDeletingIndices (19557) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=update/20_doc_upsert/Doc upsert} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=snapshot.restore/10_basic/Create a snapshot and then restore it} (19854) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search/330_fetch_fields/Test basic field retrieval} (18396) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/40_range/Empty Agg Body} (18133) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/270_median_absolute_deviation_metric/bad arguments} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/20_terms/string profiler via global ordinals} (19077) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/20_terms/Long test} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=search.aggregation/100_avg_metric/Metadata test} (18396) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.stats/11_metric/Metric - _all include_segment_file_sizes} (18396) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.shrink/10_basic/Shrink index via API} (18806) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.get_settings/10_basic/Get /_settings with local flag} (18401) 1 org.opensearch.backwards.MixedClusterClientYamlTestSuiteIT.test {p0=indices.get/10_basic/Should return an exception when querying invalid indices} (18396) 1 org.opensearch.aliases.IndexAliasesIT.testSameAlias (19308) 1 org.opensearch.action.admin.indices.create.ShrinkIndexIT.testCreateShrinkIndex (20026)Related Issues
Resolves #8798
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.