5 fail, 6 skipped, 99 pass in 3h 24m 40s
4 files 4 suites 3h 24m 40s ⏱️
110 tests 99 ✅ 6 💤 5 ❌
452 runs 416 ✅ 24 💤 12 ❌
Results for commit ec9d9b0.
Annotations
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
3 out of 7 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 13s]
artifacts/E2E Test Results (k8s 1.27)/junit.xml [took 12s]
artifacts/E2E Test Results (k8s 1.28)/junit.xml [took 12s]
Raw output
Failed
=== RUN TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
time="2024-06-07T15:34:09Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
time="2024-06-07T15:34:09Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2024-06-07T15:34:09Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2024-06-07T15:34:09Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2024-06-07T15:34:09Z" level=info msg="Warning: annotation \"kubernetes.io/ingress.class\" is deprecated, please use 'spec.ingressClassName' instead\ningress.networking.k8s.io/alb-rollout-multi-ingress-1 created\n" rollout=alb-rollout
time="2024-06-07T15:34:10Z" level=info msg="Warning: annotation \"kubernetes.io/ingress.class\" is deprecated, please use 'spec.ingressClassName' instead\ningress.networking.k8s.io/alb-rollout-multi-ingress-2 created\n" rollout=alb-rollout
time="2024-06-07T15:34:10Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2024-06-07T15:34:10Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2024-06-07T15:34:11Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2024-06-07T15:34:11Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2024-06-07T15:34:11Z" level=info msg="Updated rollout pod spec: 2024-06-07T15:34:11.200945706Z" rollout=alb-rollout
time="2024-06-07T15:34:11Z" level=info msg="Sleeping 10s" rollout=alb-rollout
require.go:72:
Error Trace: /home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:300
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:289
Error: Not equal:
expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
actual : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
Diff:
--- Expected
+++ Actual
@@ -1 +1 @@
-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
Test: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
Name: alb-rollout
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/1
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 0
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ alb-rollout Rollout �[94m◌�[0m Progressing 11s
├──# revision:2
│ ├──⧉ �[33malb-rollout-649fb49d77�[0m ReplicaSet �[0m•�[0m ScaledDown 10s �[33mcanary�[0m
│ └──Σ �[94malb-rollout-649fb49d77-2-0�[0m Experiment �[94m◌�[0m Running 10s
│ ├──⧉ alb-rollout-649fb49d77-2-0-experiment-alb-canary ReplicaSet �[32m✔�[0m Healthy 10s
│ │ └──□ alb-rollout-649fb49d77-2-0-experiment-alb-canary-btwbm Pod �[32m✔�[0m Running 10s ready:1/1
│ └──⧉ alb-rollout-649fb49d77-2-0-experiment-alb-stable ReplicaSet �[32m✔�[0m Healthy 10s
│ └──□ alb-rollout-649fb49d77-2-0-experiment-alb-stable-gs8l7 Pod �[32m✔�[0m Running 10s ready:1/1
└──# revision:1
└──⧉ �[32malb-rollout-d6f4fdcdc�[0m ReplicaSet �[32m✔�[0m Healthy 11s �[32mstable�[0m
└──□ alb-rollout-d6f4fdcdc-lftnp Pod �[32m✔�[0m Running 11s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2024-06-07T15:34:10Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestALBExperimentStepNoSetWeightMultiIngress
name: alb-rollout
namespace: default
resourceVersion: "4331"
uid: 902ef8b5-775d-40fc-87e5-42ad9b82c199
spec:
replicas: 1
selector:
matchLabels:
app: alb-rollout
strategy:
canary:
canaryService: alb-rollout-canary
stableService: alb-rollout-stable
steps:
- experiment:
analysisRunMetadata: {}
duration: 15s
templates:
- metadata: {}
name: experiment-alb-canary
specRef: canary
weight: 20
- metadata: {}
name: experiment-alb-stable
specRef: stable
weight: 20
trafficRouting:
alb:
ingresses:
- alb-rollout-multi-ingress-1
- alb-rollout-multi-ingress-2
rootService: alb-rollout-root
servicePort: 80
template:
metadata:
annotations:
update: "2024-06-07T15:34:11.200945706Z"
creationTimestamp: null
labels:
app: alb-rollout
spec:
containers:
- image: nginx:1.19-alpine
name: alb-rollout
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen: {}
canary:
currentExperiment: alb-rollout-649fb49d77-2-0
weights:
additional:
- weight: 20
- weight: 20
canary:
podTemplateHash: 649fb49d77
serviceName: alb-rollout-canary
weight: 0
stable:
podTemplateHash: d6f4fdcdc
serviceName: alb-rollout-stable
weight: 60
conditions:
- lastTransitionTime: "2024-06-07T15:34:11Z"
lastUpdateTime: "2024-06-07T15:34:11Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2024-06-07T15:34:11Z"
lastUpdateTime: "2024-06-07T15:34:11Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2024-06-07T15:34:11Z"
lastUpdateTime: "2024-06-07T15:34:11Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2024-06-07T15:34:10Z"
lastUpdateTime: "2024-06-07T15:34:11Z"
message: Created new replica set "alb-rollout-649fb49d77"
reason: NewReplicaSetCreated
status: "True"
type: Progressing
currentPodHash: 649fb49d77
currentStepHash: 8b59978
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "3"
phase: Progressing
readyReplicas: 1
replicas: 1
selector: app=alb-rollout
stableRS: d6f4fdcdc
2024-06-07T15:34:10Z Normal RolloutAddedToInformer Rollout resource added to informer: default/alb-rollout
2024-06-07T15:34:10Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (d6f4fdcdc)
2024-06-07T15:34:10Z Normal RolloutUpdated Rollout updated to revision 1
2024-06-07T15:34:10Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2024-06-07T15:34:10Z Normal TrafficWeightUpdated Traffic weight updated to 0
2024-06-07T15:34:10Z Normal ScalingReplicaSet Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2024-06-07T15:34:10Z Normal RolloutCompleted Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2024-06-07T15:34:11Z Normal SwitchService Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2024-06-07T15:34:11Z Normal SwitchService Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2024-06-07T15:34:11Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (649fb49d77)
2024-06-07T15:34:11Z Normal RolloutUpdated Rollout updated to revision 2
2024-06-07T15:34:11Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-649fb49d77 (revision 2)
2024-06-07T15:34:11Z (x2) Normal TrafficWeightUpdated Traffic weight updated
2024-06-07T15:34:11Z Normal ExperimentCreated Created Experiment 'alb-rollout-649fb49d77-2-0'
2024-06-07T15:34:12Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-multi-ingress-1` to desiredWeight '0'
2024-06-07T15:34:12Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-multi-ingress-2` to desiredWeight '0'
2024-06-07T15:34:12Z Normal TrafficWeightUpdated Traffic weight updated additional: [{20 } {20 }]
time="2024-06-07T15:34:21Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
--- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (12.15s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
4 out of 8 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 1m 55s]
artifacts/E2E Test Results (k8s 1.27)/junit.xml [took 1m 40s]
artifacts/E2E Test Results (k8s 1.28)/junit.xml [took 1m 42s]
artifacts/E2E Test Results (k8s 1.29)/junit.xml [took 1m 42s]
Raw output
Failed
=== RUN TestAWSSuite
--- FAIL: TestAWSSuite (100.53s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.27)/junit.xml [took 3s]
artifacts/E2E Test Results (k8s 1.28)/junit.xml [took 3s]
Raw output
Failed
=== RUN TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
time="2024-06-07T15:42:39Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2024-06-07T15:42:39Z" level=info msg="rollout.argoproj.io/updatescaling created\n" rollout=updatescaling
time="2024-06-07T15:42:39Z" level=info msg="Waiting for condition: status=Healthy" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=updatescaling
W0607 15:42:40.702272 25905 warnings.go:70] unknown field "spec.template.metadata.creationTimestamp"
time="2024-06-07T15:42:40Z" level=info msg="Patched rollout: {\"spec\":{\"template\":{\"spec\":{\"containers\":[{\"name\":\"updatescaling\",\"resources\":{\"requests\":{\"cpu\":\"2m\",\"memory\":\"16Mi\"}}}]}}}}" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Condition 'status.replicas=7' met after 0s" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Scaled rollout to 8" rollout=updatescaling
time="2024-06-07T15:42:40Z" level=info msg="Waiting for condition: status.replicas=11" rollout=updatescaling
time="2024-06-07T15:42:41Z" level=info msg="Condition 'status.replicas=11' met after 0s" rollout=updatescaling
time="2024-06-07T15:42:41Z" level=info msg="Pod expectation 'canary pod count == 8' met" rollout=updatescaling
time="2024-06-07T15:42:41Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2024-06-07T15:42:41Z" level=info msg="Scaled rollout to 4" rollout=updatescaling
time="2024-06-07T15:42:41Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2024-06-07T15:42:42Z" level=info msg="Condition 'status.replicas=7' met after 0s" rollout=updatescaling
time="2024-06-07T15:42:42Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2024-06-07T15:42:42Z" level=warning msg="unexpected stable (hash 79b6b5f5d4) pod count: expected 3, saw: 4" rollout=updatescaling
time="2024-06-07T15:42:42Z" level=error msg="Pod expectation 'stable pod count == 3' failed" rollout=updatescaling
Name: updatescaling
Namespace: default
Status: �[94m◌�[0m Progressing
Message: old replicas are pending termination
Strategy: Canary
Step:
SetWeight: 100
ActualWeight: 100
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 4
Current: 7
Updated: 4
Ready: 7
Available: 7
NAME KIND STATUS AGE INFO
⟳ updatescaling Rollout �[94m◌�[0m Progressing 3s
├──# revision:2
│ └──⧉ �[32mupdatescaling-79b6b5f5d4�[0m ReplicaSet �[32m✔�[0m Healthy 2s �[32mstable�[0m
│ ├──□ updatescaling-79b6b5f5d4-7q5wv Pod �[32m✔�[0m Running 2s ready:1/1
│ ├──□ updatescaling-79b6b5f5d4-g98cs Pod �[32m✔�[0m Running 2s ready:1/1
│ ├──□ updatescaling-79b6b5f5d4-jkbjc Pod �[32m✔�[0m Running 2s ready:1/1
│ ├──□ updatescaling-79b6b5f5d4-rgvf7 Pod �[32m✔�[0m Running 2s ready:1/1
│ ├──□ updatescaling-79b6b5f5d4-5tdmr Pod �[94m◌�[0m Terminating 1s ready:0/1
│ ├──□ updatescaling-79b6b5f5d4-bzwj6 Pod �[94m◌�[0m Terminating 1s ready:0/1
│ ├──□ updatescaling-79b6b5f5d4-gzjrw Pod �[94m◌�[0m Terminating 1s ready:0/1
│ └──□ updatescaling-79b6b5f5d4-rfv2p Pod �[94m◌�[0m Terminating 1s ready:0/1
└──# revision:1
└──⧉ updatescaling-54d546d75c ReplicaSet �[94m◌�[0m Progressing 3s
├──□ updatescaling-54d546d75c-2b5cb Pod �[94m◌�[0m Terminating 3s ready:1/1
├──□ updatescaling-54d546d75c-8zj4g Pod �[94m◌�[0m Terminating 3s ready:1/1
├──□ updatescaling-54d546d75c-n8w8t Pod �[94m◌�[0m Terminating 3s ready:0/1
└──□ updatescaling-54d546d75c-wtwkb Pod �[94m◌�[0m Terminating 3s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2024-06-07T15:42:39Z"
generation: 4
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestRolloutWithMaxSurgeScalingDuringUpdate
name: updatescaling
namespace: default
resourceVersion: "10024"
uid: 908f3a6c-60f7-40af-b588-6b77c8dd64b8
spec:
replicas: 4
selector:
matchLabels:
app: updatescaling
strategy:
canary:
maxSurge: 100%
template:
metadata:
creationTimestamp: null
labels:
app: updatescaling
spec:
containers:
- image: nginx:1.19-alpine
name: updatescaling
resources:
requests:
cpu: 2m
memory: 16Mi
status:
HPAReplicas: 7
availableReplicas: 7
blueGreen: {}
canary: {}
conditions:
- lastTransitionTime: "2024-06-07T15:42:40Z"
lastUpdateTime: "2024-06-07T15:42:40Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2024-06-07T15:42:42Z"
lastUpdateTime: "2024-06-07T15:42:42Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2024-06-07T15:42:42Z"
lastUpdateTime: "2024-06-07T15:42:42Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2024-06-07T15:42:39Z"
lastUpdateTime: "2024-06-07T15:42:42Z"
message: ReplicaSet "updatescaling-79b6b5f5d4" is progressing.
reason: ReplicaSetUpdated
status: "True"
type: Progressing
currentPodHash: 79b6b5f5d4
currentStepHash: 5ffbfbbd64
message: old replicas are pending termination
observedGeneration: "4"
phase: Progressing
readyReplicas: 7
replicas: 7
selector: app=updatescaling
stableRS: 79b6b5f5d4
updatedReplicas: 4
2024-06-07T15:42:39Z Normal RolloutAddedToInformer Rollout resource added to informer: default/updatescaling
2024-06-07T15:42:39Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (54d546d75c)
2024-06-07T15:42:39Z Normal RolloutUpdated Rollout updated to revision 1
2024-06-07T15:42:39Z Normal NewReplicaSetCreated Created ReplicaSet updatescaling-54d546d75c (revision 1)
2024-06-07T15:42:39Z Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-54d546d75c (revision 1) from 0 to 4
2024-06-07T15:42:39Z Normal RolloutCompleted Rollout completed update to revision 1 (54d546d75c): Initial deploy
2024-06-07T15:42:40Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (79b6b5f5d4)
2024-06-07T15:42:40Z Normal RolloutUpdated Rollout updated to revision 2
2024-06-07T15:42:40Z Normal NewReplicaSetCreated Created ReplicaSet updatescaling-79b6b5f5d4 (revision 2)
2024-06-07T15:42:40Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 4 to 3
2024-06-07T15:42:40Z Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 0 to 4
2024-06-07T15:42:40Z Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 4 to 8
2024-06-07T15:42:41Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 8 to 4
2024-06-07T15:42:42Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 3 to 0
2024-06-07T15:42:42Z Normal RolloutCompleted Rollout completed update to revision 2 (79b6b5f5d4): Completed all 0 canary steps
time="2024-06-07T15:42:42Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2024-06-07T15:42:42Z" level=info msg="Deleting e2e-test-name"
--- FAIL: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (3.26s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
2 out of 6 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.27)/junit.xml [took 5m 22s]
artifacts/E2E Test Results (k8s 1.28)/junit.xml [took 5m 22s]
Raw output
Failed
=== RUN TestCanarySuite
time="2024-06-07T15:37:20Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (322.44s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.29)/junit.xml [took 12s]
Raw output
Failed
=== RUN TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2024-06-07T15:34:17Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2024-06-07T15:34:17Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2024-06-07T15:34:17Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2024-06-07T15:34:17Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2024-06-07T15:34:17Z" level=info msg="Warning: annotation \"kubernetes.io/ingress.class\" is deprecated, please use 'spec.ingressClassName' instead\ningress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2024-06-07T15:34:18Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2024-06-07T15:34:18Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2024-06-07T15:34:19Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=alb-rollout
time="2024-06-07T15:34:19Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2024-06-07T15:34:19Z" level=info msg="Updated rollout pod spec: 2024-06-07T15:34:19.039976149Z" rollout=alb-rollout
time="2024-06-07T15:34:19Z" level=info msg="Sleeping 10s" rollout=alb-rollout
require.go:72:
Error Trace: /home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:265
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:255
Error: Not equal:
expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
actual : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
Diff:
--- Expected
+++ Actual
@@ -1 +1 @@
-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
Test: TestAWSSuite/TestALBExperimentStepNoSetWeight
Name: alb-rollout
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/1
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 0
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ alb-rollout Rollout �[94m◌�[0m Progressing 11s
├──# revision:2
│ ├──⧉ �[33malb-rollout-66474964bb�[0m ReplicaSet �[0m•�[0m ScaledDown 10s �[33mcanary�[0m
│ └──Σ �[94malb-rollout-66474964bb-2-0�[0m Experiment �[94m◌�[0m Running 10s
│ ├──⧉ alb-rollout-66474964bb-2-0-experiment-alb-canary ReplicaSet �[32m✔�[0m Healthy 10s
│ │ └──□ alb-rollout-66474964bb-2-0-experiment-alb-canary-j4rt7 Pod �[32m✔�[0m Running 10s ready:1/1
│ └──⧉ alb-rollout-66474964bb-2-0-experiment-alb-stable ReplicaSet �[32m✔�[0m Healthy 10s
│ └──□ alb-rollout-66474964bb-2-0-experiment-alb-stable-tx6x7 Pod �[32m✔�[0m Running 10s ready:1/1
└──# revision:1
└──⧉ �[32malb-rollout-d6f4fdcdc�[0m ReplicaSet �[32m✔�[0m Healthy 11s �[32mstable�[0m
└──□ alb-rollout-d6f4fdcdc-ntxz6 Pod �[32m✔�[0m Running 11s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2024-06-07T15:34:18Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestALBExperimentStepNoSetWeight
name: alb-rollout
namespace: default
resourceVersion: "4079"
uid: 0dc09ef6-0be2-4800-944a-dec39ff68545
spec:
replicas: 1
selector:
matchLabels:
app: alb-rollout
strategy:
canary:
canaryService: alb-rollout-canary
stableService: alb-rollout-stable
steps:
- experiment:
analysisRunMetadata: {}
duration: 15s
templates:
- metadata: {}
name: experiment-alb-canary
specRef: canary
weight: 20
- metadata: {}
name: experiment-alb-stable
specRef: stable
weight: 20
trafficRouting:
alb:
ingress: alb-rollout-ingress
rootService: alb-rollout-root
servicePort: 80
template:
metadata:
annotations:
update: "2024-06-07T15:34:19.039976149Z"
creationTimestamp: null
labels:
app: alb-rollout
spec:
containers:
- image: nginx:1.19-alpine
name: alb-rollout
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen: {}
canary:
currentExperiment: alb-rollout-66474964bb-2-0
weights:
additional:
- weight: 20
- weight: 20
canary:
podTemplateHash: 66474964bb
serviceName: alb-rollout-canary
weight: 0
stable:
podTemplateHash: d6f4fdcdc
serviceName: alb-rollout-stable
weight: 60
conditions:
- lastTransitionTime: "2024-06-07T15:34:19Z"
lastUpdateTime: "2024-06-07T15:34:19Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2024-06-07T15:34:19Z"
lastUpdateTime: "2024-06-07T15:34:19Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2024-06-07T15:34:19Z"
lastUpdateTime: "2024-06-07T15:34:19Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2024-06-07T15:34:18Z"
lastUpdateTime: "2024-06-07T15:34:19Z"
message: Created new replica set "alb-rollout-66474964bb"
reason: NewReplicaSetCreated
status: "True"
type: Progressing
currentPodHash: 66474964bb
currentStepHash: 8b59978
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "3"
phase: Progressing
readyReplicas: 1
replicas: 1
selector: app=alb-rollout
stableRS: d6f4fdcdc
2024-06-07T15:34:18Z Normal RolloutAddedToInformer Rollout resource added to informer: default/alb-rollout
2024-06-07T15:34:18Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (d6f4fdcdc)
2024-06-07T15:34:18Z Normal RolloutUpdated Rollout updated to revision 1
2024-06-07T15:34:18Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2024-06-07T15:34:18Z Normal TrafficWeightUpdated Traffic weight updated to 0
2024-06-07T15:34:18Z Normal ScalingReplicaSet Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2024-06-07T15:34:18Z Normal RolloutCompleted Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2024-06-07T15:34:19Z Normal SwitchService Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2024-06-07T15:34:19Z Normal SwitchService Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2024-06-07T15:34:19Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (66474964bb)
2024-06-07T15:34:19Z Normal RolloutUpdated Rollout updated to revision 2
2024-06-07T15:34:19Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-66474964bb (revision 2)
2024-06-07T15:34:19Z (x2) Normal TrafficWeightUpdated Traffic weight updated
2024-06-07T15:34:19Z Normal ExperimentCreated Created Experiment 'alb-rollout-66474964bb-2-0'
2024-06-07T15:34:20Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2024-06-07T15:34:20Z Normal TrafficWeightUpdated Traffic weight updated additional: [{20 } {20 }]
time="2024-06-07T15:34:29Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
--- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (12.06s)
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
110 tests found
There are 110 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryWithPausedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestNeverScaleDown
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownOnSuccess
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownProgressively
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitInStableDownscaleAfterCanaryAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite