Skip to content
GitHub Actions / E2E Tests Published Test Results succeeded Mar 21, 2024 in 0s

8 fail, 6 skipped, 94 pass in 3h 47m 27s

  4 files    4 suites   3h 47m 27s ⏱️
108 tests  94 ✅  6 💤  8 ❌
448 runs  409 ✅ 24 💤 15 ❌

Results for commit 4bda53d.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestFunctionalSuite/TestBlueGreenUpdate (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 8s]
Raw output
Failed
=== RUN   TestFunctionalSuite/TestBlueGreenUpdate
time="2024-03-21T00:29:18Z" level=info msg="Deleting e2e-test-name=TestBlueGreenUpdate"
W0321 00:29:18.219876   22043 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0321 00:29:18.223493   22043 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2024-03-21T00:29:18Z" level=info msg="Event watcher started"
time="2024-03-21T00:29:18Z" level=info msg="service/bluegreen created\n" rollout=bluegreen
time="2024-03-21T00:29:18Z" level=info msg="rollout.argoproj.io/bluegreen created\n" rollout=bluegreen
time="2024-03-21T00:29:18Z" level=info msg="Waiting for condition: status=Healthy" rollout=bluegreen
time="2024-03-21T00:29:22Z" level=info msg="Condition 'status=Healthy' met after 4s" rollout=bluegreen
time="2024-03-21T00:29:22Z" level=info msg="Replica count expectation met (desired:3, current:3, updated:3, ready:3, available:3)" rollout=bluegreen
time="2024-03-21T00:29:22Z" level=info msg="Updated rollout pod spec: 2024-03-21T00:29:22.929349735Z" rollout=bluegreen
time="2024-03-21T00:29:22Z" level=info msg="Waiting for condition: status=Progressing" rollout=bluegreen
time="2024-03-21T00:29:22Z" level=info msg="Condition 'status=Progressing' met after 0s" rollout=bluegreen
time="2024-03-21T00:29:23Z" level=info msg="Waiting for condition: active revision=2" rollout=bluegreen
time="2024-03-21T00:29:26Z" level=info msg="Condition 'active revision=2' met after 3s" rollout=bluegreen
time="2024-03-21T00:29:26Z" level=info msg="Replica count expectation met (desired:3, current:6, updated:3, ready:3, available:3)" rollout=bluegreen
time="2024-03-21T00:29:26Z" level=info msg="Waiting for condition: status=Healthy" rollout=bluegreen
time="2024-03-21T00:29:26Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=bluegreen
time="2024-03-21T00:29:26Z" level=info msg="Replica count expectation met (desired:3, current:6, updated:3, ready:3, available:3)" rollout=bluegreen
    functional_test.go:704: 
        	Error Trace:	/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:493
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/functional_test.go:704
        	Error:      	Not equal: 
        	            	expected: []string{"RolloutAddedToInformer", "RolloutUpdated", "NewReplicaSetCreated", "ScalingReplicaSet", "RolloutCompleted", "SwitchService", "RolloutUpdated", "NewReplicaSetCreated", "RolloutNotCompleted", "ScalingReplicaSet", "SwitchService", "RolloutCompleted"}
        	            	actual  : []string{"RolloutAddedToInformer", "RolloutUpdated", "NewReplicaSetCreated", "ScalingReplicaSet", "RolloutCompleted", "SwitchService", "RolloutUpdated", "NewReplicaSetCreated", "RolloutNotCompleted", "ScalingReplicaSet", "SwitchService"}
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1,2 +1,2 @@
        	            	-([]string) (len=12) {
        	            	+([]string) (len=11) {
        	            	  (string) (len=22) "RolloutAddedToInformer",
        	            	@@ -11,4 +11,3 @@
        	            	  (string) (len=17) "ScalingReplicaSet",
        	            	- (string) (len=13) "SwitchService",
        	            	- (string) (len=16) "RolloutCompleted"
        	            	+ (string) (len=13) "SwitchService"
        	            	 }
        	Test:       	TestFunctionalSuite/TestBlueGreenUpdate
time="2024-03-21T00:29:26Z" level=info msg="Event watcher stopped" rollout=bluegreen
Name:            bluegreen
Namespace:       default
Status:          �[32m✔�[0m Healthy
Strategy:        BlueGreen
Images:          nginx:1.19-alpine (�[32mactive�[0m, �[32mstable�[0m)
Replicas:
  Desired:       3
  Current:       6
  Updated:       3
  Ready:         3
  Available:     3

NAME                                   KIND        STATUS     AGE  INFO
⟳ bluegreen                            Rollout     �[32m✔�[0m Healthy  8s   
├──# revision:2                                                    
│  └──⧉ �[32m�[32mbluegreen-b8b54554b�[0m�[0m            ReplicaSet  �[32m✔�[0m Healthy  4s   �[32mstable�[0m,�[32mactive�[0m
│     ├──□ bluegreen-b8b54554b-f9vg4   Pod         �[32m✔�[0m Running  4s   ready:1/1
│     ├──□ bluegreen-b8b54554b-hnz5t   Pod         �[32m✔�[0m Running  4s   ready:1/1
│     └──□ bluegreen-b8b54554b-q4v5t   Pod         �[32m✔�[0m Running  4s   ready:1/1
└──# revision:1                                                    
   └──⧉ bluegreen-5976bbf5bf           ReplicaSet  �[32m✔�[0m Healthy  8s   delay:9s
      ├──□ bluegreen-5976bbf5bf-84dqg  Pod         �[32m✔�[0m Running  8s   ready:1/1
      ├──□ bluegreen-5976bbf5bf-mpbd2  Pod         �[32m✔�[0m Running  8s   ready:1/1
      └──□ bluegreen-5976bbf5bf-vgzns  Pod         �[32m✔�[0m Running  8s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-03-21T00:29:18Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestBlueGreenUpdate
  name: bluegreen
  namespace: default
  resourceVersion: "11767"
  uid: 56ff1e0e-95a1-4261-9bcc-660d24d9ca21
spec:
  replicas: 3
  selector:
    matchLabels:
      app: bluegreen
  strategy:
    blueGreen:
      activeService: bluegreen
      scaleDownDelaySeconds: 10
  template:
    metadata:
      annotations:
        update: "2024-03-21T00:29:22.929349735Z"
      creationTimestamp: null
      labels:
        app: bluegreen
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: bluegreen
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 3
  availableReplicas: 3
  blueGreen:
    activeSelector: b8b54554b
  canary: {}
  conditions:
  - lastTransitionTime: "2024-03-21T00:29:22Z"
    lastUpdateTime: "2024-03-21T00:29:22Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-03-21T00:29:26Z"
    lastUpdateTime: "2024-03-21T00:29:26Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2024-03-21T00:29:18Z"
    lastUpdateTime: "2024-03-21T00:29:26Z"
    message: ReplicaSet "bluegreen-b8b54554b" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2024-03-21T00:29:26Z"
    lastUpdateTime: "2024-03-21T00:29:26Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  currentPodHash: b8b54554b
  observedGeneration: "2"
  phase: Healthy
  readyReplicas: 3
  replicas: 6
  selector: app=bluegreen,rollouts-pod-template-hash=b8b54554b
  stableRS: b8b54554b
  updatedReplicas: 3

2024-03-21T00:29:18Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/bluegreen
2024-03-21T00:29:18Z    Normal    RolloutUpdated            Rollout updated to revision 1
2024-03-21T00:29:18Z    Normal    NewReplicaSetCreated      Created ReplicaSet bluegreen-5976bbf5bf (revision 1)
2024-03-21T00:29:18Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet bluegreen-5976bbf5bf (revision 1) from 0 to 3
2024-03-21T00:29:18Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (5976bbf5bf): Initial deploy
2024-03-21T00:29:22Z    Normal    SwitchService             Switched selector for service 'bluegreen' from '' to '5976bbf5bf'
2024-03-21T00:29:22Z    Normal    RolloutUpdated            Rollout updated to revision 2
2024-03-21T00:29:22Z    Normal    NewReplicaSetCreated      Created ReplicaSet bluegreen-b8b54554b (revision 2)
2024-03-21T00:29:22Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 3 (b8b54554b)
2024-03-21T00:29:22Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet bluegreen-b8b54554b (revision 2) from 0 to 3
2024-03-21T00:29:26Z    Normal    SwitchService             Switched selector for service 'bluegreen' from '5976bbf5bf' to 'b8b54554b'
2024-03-21T00:29:26Z    Normal    RolloutCompleted          Rollout completed update to revision 2 (b8b54554b): Completed blue-green update

time="2024-03-21T00:29:26Z" level=info msg="Deleting e2e-test-name=TestBlueGreenUpdate"
W0321 00:29:27.096562   22043 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0321 00:29:27.104568   22043 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestFunctionalSuite/TestBlueGreenUpdate (8.99s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestFunctionalSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 6m 19s]
Raw output
Failed
=== RUN   TestFunctionalSuite
time="2024-03-21T00:28:32Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestFunctionalSuite (379.01s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 13s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2024-03-21T00:16:19Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
W0321 00:16:19.674635   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0321 00:16:19.677825   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2024-03-21T00:16:19Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2024-03-21T00:16:20Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2024-03-21T00:16:20Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2024-03-21T00:16:20Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2024-03-21T00:16:20Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2024-03-21T00:16:20Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2024-03-21T00:16:22Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2024-03-21T00:16:22Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2024-03-21T00:16:22Z" level=info msg="Updated rollout pod spec: 2024-03-21T00:16:22.355742879Z" rollout=alb-rollout
time="2024-03-21T00:16:22Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:264
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:254
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeight
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  12s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-5c5d9cd4bf�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-5c5d9cd4bf-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-5c5d9cd4bf-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-5c5d9cd4bf-2-0-experiment-alb-canary-jmcfk  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-5c5d9cd4bf-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-5c5d9cd4bf-2-0-experiment-alb-stable-v6tp6  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      12s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-xg9pf                                Pod         �[32m✔�[0m Running      12s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-03-21T00:16:20Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeight
  name: alb-rollout
  namespace: default
  resourceVersion: "4040"
  uid: 17e3868b-4f30-4fba-8685-b97c91ec7ad4
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          analysisRunMetadata: {}
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingress: alb-rollout-ingress
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-03-21T00:16:22.355742879Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-5c5d9cd4bf-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 5c5d9cd4bf
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2024-03-21T00:16:22Z"
    lastUpdateTime: "2024-03-21T00:16:22Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-03-21T00:16:22Z"
    lastUpdateTime: "2024-03-21T00:16:22Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-03-21T00:16:22Z"
    lastUpdateTime: "2024-03-21T00:16:22Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-03-21T00:16:20Z"
    lastUpdateTime: "2024-03-21T00:16:22Z"
    message: Created new replica set "alb-rollout-5c5d9cd4bf"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 5c5d9cd4bf
  currentStepHash: 8b59978
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2024-03-21T00:16:20Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2024-03-21T00:16:20Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2024-03-21T00:16:20Z         Normal    RolloutUpdated            Rollout updated to revision 1
2024-03-21T00:16:20Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2024-03-21T00:16:20Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2024-03-21T00:16:20Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2024-03-21T00:16:20Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2024-03-21T00:16:22Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2024-03-21T00:16:22Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2024-03-21T00:16:22Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (5c5d9cd4bf)
2024-03-21T00:16:22Z         Normal    RolloutUpdated            Rollout updated to revision 2
2024-03-21T00:16:22Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-5c5d9cd4bf (revision 2)
2024-03-21T00:16:22Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2024-03-21T00:16:22Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-5c5d9cd4bf-2-0'
2024-03-21T00:16:23Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2024-03-21T00:16:23Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2024-03-21T00:16:32Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
W0321 00:16:32.770439   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0321 00:16:32.773622   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (13.17s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 13s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
time="2024-03-21T00:16:29Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
time="2024-03-21T00:16:30Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2024-03-21T00:16:30Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2024-03-21T00:16:30Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2024-03-21T00:16:30Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-1 created\n" rollout=alb-rollout
time="2024-03-21T00:16:30Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-2 created\n" rollout=alb-rollout
time="2024-03-21T00:16:30Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2024-03-21T00:16:30Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2024-03-21T00:16:33Z" level=info msg="Condition 'status=Healthy' met after 2s" rollout=alb-rollout
time="2024-03-21T00:16:33Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2024-03-21T00:16:33Z" level=info msg="Updated rollout pod spec: 2024-03-21T00:16:33.016192802Z" rollout=alb-rollout
time="2024-03-21T00:16:33Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:298
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:287
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  13s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-5959698c7b�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-5959698c7b-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-5959698c7b-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-5959698c7b-2-0-experiment-alb-canary-q4h9t  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-5959698c7b-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-5959698c7b-2-0-experiment-alb-stable-h28ss  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      13s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-l5xch                                Pod         �[32m✔�[0m Running      13s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-03-21T00:16:30Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeightMultiIngress
  name: alb-rollout
  namespace: default
  resourceVersion: "4347"
  uid: 19b2422f-d415-44e8-835a-8a203e96a0c5
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          analysisRunMetadata: {}
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingresses:
          - alb-rollout-multi-ingress-1
          - alb-rollout-multi-ingress-2
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-03-21T00:16:33.016192802Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-5959698c7b-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 5959698c7b
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2024-03-21T00:16:32Z"
    lastUpdateTime: "2024-03-21T00:16:32Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-03-21T00:16:33Z"
    lastUpdateTime: "2024-03-21T00:16:33Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-03-21T00:16:33Z"
    lastUpdateTime: "2024-03-21T00:16:33Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-03-21T00:16:30Z"
    lastUpdateTime: "2024-03-21T00:16:33Z"
    message: Created new replica set "alb-rollout-5959698c7b"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 5959698c7b
  currentStepHash: 8b59978
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2024-03-21T00:16:30Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2024-03-21T00:16:30Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2024-03-21T00:16:30Z         Normal    RolloutUpdated            Rollout updated to revision 1
2024-03-21T00:16:30Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2024-03-21T00:16:30Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2024-03-21T00:16:30Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2024-03-21T00:16:30Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2024-03-21T00:16:32Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2024-03-21T00:16:32Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2024-03-21T00:16:33Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (5959698c7b)
2024-03-21T00:16:33Z         Normal    RolloutUpdated            Rollout updated to revision 2
2024-03-21T00:16:33Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-5959698c7b (revision 2)
2024-03-21T00:16:33Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2024-03-21T00:16:33Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-5959698c7b-2-0'
2024-03-21T00:16:34Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-multi-ingress-1` to desiredWeight '0'
2024-03-21T00:16:35Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-multi-ingress-2` to desiredWeight '0'
2024-03-21T00:16:35Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2024-03-21T00:16:43Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (13.53s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 2m 0s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 1m 55s]
Raw output
Failed
=== RUN   TestAWSSuite
--- FAIL: TestAWSSuite (120.77s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

4 out of 8 runs failed: TestCanarySuite/TestCanaryDynamicStableScale (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 18s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 21s]
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryDynamicStableScale
time="2024-03-21T00:20:06Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
W0321 00:20:06.566226   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0321 00:20:06.568839   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2024-03-21T00:20:06Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2024-03-21T00:20:06Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2024-03-21T00:20:07Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2024-03-21T00:20:07Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2024-03-21T00:20:07Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
time="2024-03-21T00:20:08Z" level=info msg="Marked 4 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2024-03-21T00:20:08Z" level=info msg="Waiting for condition: status=Healthy" rollout=dynamic-stable-scale
time="2024-03-21T00:20:12Z" level=info msg="Condition 'status=Healthy' met after 3s" rollout=dynamic-stable-scale
time="2024-03-21T00:20:12Z" level=info msg="Updated rollout pod spec: 2024-03-21T00:20:12.327647473Z" rollout=dynamic-stable-scale
time="2024-03-21T00:20:13Z" level=info msg="Marked 1 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2024-03-21T00:20:13Z" level=info msg="Waiting for condition: status=Paused" rollout=dynamic-stable-scale
time="2024-03-21T00:20:13Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=dynamic-stable-scale
time="2024-03-21T00:20:13Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2024-03-21T00:20:15Z" level=info msg="Pod expectation 'revision:1 pod count == 3' met" rollout=dynamic-stable-scale
time="2024-03-21T00:20:15Z" level=info msg="Pod expectation 'revision:2 pod count == 1' met" rollout=dynamic-stable-scale
time="2024-03-21T00:20:15Z" level=info msg="Promoted rollout" rollout=dynamic-stable-scale
time="2024-03-21T00:20:16Z" level=info msg="Marked 2 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2024-03-21T00:20:16Z" level=info msg="Waiting for condition: status.currentStepIndex=3" rollout=dynamic-stable-scale
time="2024-03-21T00:20:18Z" level=info msg="Condition 'status.currentStepIndex=3' met after 2s" rollout=dynamic-stable-scale
time="2024-03-21T00:20:18Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2024-03-21T00:20:20Z" level=info msg="Pod expectation 'revision:1 pod count == 1' met" rollout=dynamic-stable-scale
time="2024-03-21T00:20:20Z" level=info msg="Pod expectation 'revision:2 pod count == 3' met" rollout=dynamic-stable-scale
time="2024-03-21T00:20:20Z" level=info msg="Aborted rollout" rollout=dynamic-stable-scale
time="2024-03-21T00:20:22Z" level=info msg="Marked 2 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2024-03-21T00:20:22Z" level=info msg="Waiting for condition: rev=2 podcount=1" rollout=dynamic-stable-scale
time="2024-03-21T00:20:24Z" level=info msg="Condition 'rev=2 podcount=1' met after 2s" rollout=dynamic-stable-scale
time="2024-03-21T00:20:24Z" level=info msg="Pod expectation 'revision:1 pod count == 4' met" rollout=dynamic-stable-scale
time="2024-03-21T00:20:25Z" level=info msg="Marked 1 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2024-03-21T00:20:25Z" level=info msg="Waiting for condition: rev=2 podcount=0" rollout=dynamic-stable-scale
time="2024-03-21T00:20:25Z" level=info msg="Condition 'rev=2 podcount=0' met after 0s" rollout=dynamic-stable-scale
    canary_test.go:663: Expected dynamic-stable-scale-canary selector: map[app:dynamic-stable-scale rollouts-pod-template-hash:868d98995b]. Actual: map[app:dynamic-stable-scale rollouts-pod-template-hash:59f544dc7c]
Name:            dynamic-stable-scale
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/4
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       0
  Ready:         4
  Available:     4

NAME                                              KIND        STATUS         AGE  INFO
⟳ dynamic-stable-scale                            Rollout     �[31m✖�[0m Degraded     19s  
├──# revision:2                                                                   
│  └──⧉ �[33mdynamic-stable-scale-59f544dc7c�[0m           ReplicaSet  �[0m•�[0m ScaledDown   14s  �[33mcanary�[0m
│     └──□ dynamic-stable-scale-59f544dc7c-zmrfv  Pod         �[94m◌�[0m Terminating  14s  ready:1/1
└──# revision:1                                                                   
   └──⧉ �[32mdynamic-stable-scale-868d98995b�[0m           ReplicaSet  �[32m✔�[0m Healthy      19s  �[32mstable�[0m
      ├──□ dynamic-stable-scale-868d98995b-8qgqt  Pod         �[32m✔�[0m Running      19s  ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-48v2t  Pod         �[32m✔�[0m Running      5s   ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-pwbrl  Pod         �[32m✔�[0m Running      5s   ready:1/1
      └──□ dynamic-stable-scale-868d98995b-vj924  Pod         �[32m✔�[0m Running      5s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-03-21T00:20:07Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryDynamicStableScale
  name: dynamic-stable-scale
  namespace: default
  resourceVersion: "6471"
  uid: 26e53c90-cab1-4671-a97c-d53e1d0acf95
spec:
  replicas: 4
  selector:
    matchLabels:
      app: dynamic-stable-scale
  strategy:
    canary:
      canaryService: dynamic-stable-scale-canary
      dynamicStableScale: true
      stableService: dynamic-stable-scale-stable
      steps:
      - setWeight: 25
      - pause: {}
      - setWeight: 75
      - pause: {}
      trafficRouting:
        alb:
          ingress: dynamic-stable-scale-ingress
          rootService: dynamic-stable-scale-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-03-21T00:20:12.327647473Z"
      creationTimestamp: null
      labels:
        app: dynamic-stable-scale
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: dynamic-stable-scale
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
      readinessGates:
      - conditionType: argoproj.io/e2e-readiness
status:
  HPAReplicas: 5
  abort: true
  abortedAt: "2024-03-21T00:20:21Z"
  availableReplicas: 5
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 59f544dc7c
        serviceName: dynamic-stable-scale-canary
        weight: 0
      stable:
        podTemplateHash: 868d98995b
        serviceName: dynamic-stable-scale-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2024-03-21T00:20:12Z"
    lastUpdateTime: "2024-03-21T00:20:12Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-03-21T00:20:12Z"
    lastUpdateTime: "2024-03-21T00:20:12Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-03-21T00:20:12Z"
    lastUpdateTime: "2024-03-21T00:20:12Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-03-21T00:20:18Z"
    lastUpdateTime: "2024-03-21T00:20:18Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2024-03-21T00:20:21Z"
    lastUpdateTime: "2024-03-21T00:20:21Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: 59f544dc7c
  currentStepHash: 7c5b668566
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "2"
  phase: Degraded
  readyReplicas: 5
  replicas: 5
  selector: app=dynamic-stable-scale
  stableRS: 868d98995b
  updatedReplicas: 1

2024-03-21T00:20:07Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/dynamic-stable-scale
2024-03-21T00:20:07Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (868d98995b)
2024-03-21T00:20:07Z         Normal    RolloutUpdated            Rollout updated to revision 1
2024-03-21T00:20:07Z         Normal    NewReplicaSetCreated      Created ReplicaSet dynamic-stable-scale-868d98995b (revision 1)
2024-03-21T00:20:07Z         Normal    PatchingALBIngress        Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '0'
2024-03-21T00:20:07Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2024-03-21T00:20:07Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 0 to 4
2024-03-21T00:20:07Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (868d98995b): Initial deploy
2024-03-21T00:20:12Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-stable' from '' to '868d98995b'
2024-03-21T00:20:12Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-canary' from '' to '868d98995b'
2024-03-21T00:20:12Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (59f544dc7c)
2024-03-21T00:20:12Z         Normal    RolloutUpdated            Rollout updated to revision 2
2024-03-21T00:20:12Z         Normal    NewReplicaSetCreated      Created ReplicaSet dynamic-stable-scale-59f544dc7c (revision 2)
2024-03-21T00:20:12Z (x3)    Normal    TrafficWeightUpdated      Traffic weight updated 
2024-03-21T00:20:12Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet dynamic-stable-scale-59f544dc7c (revision 2) from 0 to 1
2024-03-21T00:20:13Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-canary' from '868d98995b' to '59f544dc7c'
2024-03-21T00:20:13Z         Normal    PatchingALBIngress        Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '25'
2024-03-21T00:20:13Z         Normal    TrafficWeightUpdated      Traffic weight updated from 0 to 25
2024-03-21T00:20:13Z         Normal    RolloutStepCompleted      Rollout step 1/4 completed (setWeight: 25)
2024-03-21T00:20:13Z         Normal    ScalingReplicaSet         Scaled down ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 4 to 3
2024-03-21T00:20:13Z         Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)
2024-03-21T00:20:15Z         Normal    RolloutStepCompleted      Rollout step 2/4 completed (pause)

time="2024-03-21T00:20:26Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
W0321 00:20:26.317241   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0321 00:20:26.321346   22078 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestCanarySuite/TestCanaryDynamicStableScale (19.82s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestCanarySuite/TestCanaryUnScaleDownOnAbort (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 2m 3s]
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryUnScaleDownOnAbort
time="2024-03-21T00:23:27Z" level=info msg="Deleting e2e-test-name=TestCanaryUnScaleDownOnAbort"
time="2024-03-21T00:23:27Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:27Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:27Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:28Z" level=info msg="ingress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:28Z" level=info msg="rollout.argoproj.io/canary-scaledownd-on-abort created\n" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:28Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:29Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:29Z" level=info msg="Updated rollout pod spec: 2024-03-21T00:23:29.304848614Z" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:29Z" level=info msg="Waiting for condition: status=Paused" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:30Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:30Z" level=info msg="Aborted rollout" rollout=canary-scaledownd-on-abort
time="2024-03-21T00:23:30Z" level=info msg="Waiting for condition: status=Degraded" rollout=canary-scaledownd-on-abort
    when.go:455: timeout after 2m0s waiting for condition status=Degraded
Name:            canary-scaledownd-on-abort
Namespace:       default
Status:          �[0m॥�[0m Paused
Message:         CanaryPauseStep
Strategy:        Canary
  Step:          1/2
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       2
  Updated:       1
  Ready:         2
  Available:     2

NAME                                                    KIND        STATUS     AGE   INFO
⟳ canary-scaledownd-on-abort                            Rollout     �[0m॥�[0m Paused   2m2s  
├──# revision:2                                                                      
│  └──⧉ �[33mcanary-scaledownd-on-abort-795f96b9cb�[0m           ReplicaSet  �[32m✔�[0m Healthy  2m1s  �[33mcanary�[0m
│     └──□ canary-scaledownd-on-abort-795f96b9cb-n7fqq  Pod         �[32m✔�[0m Running  2m1s  ready:1/1
└──# revision:1                                                                      
   └──⧉ �[32mcanary-scaledownd-on-abort-66597877b7�[0m           ReplicaSet  �[32m✔�[0m Healthy  2m2s  �[32mstable�[0m
      └──□ canary-scaledownd-on-abort-66597877b7-zhpxj  Pod         �[32m✔�[0m Running  2m2s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-03-21T00:23:28Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryUnScaleDownOnAbort
  name: canary-scaledownd-on-abort
  namespace: default
  resourceVersion: "8130"
  uid: d95a0918-4eb3-4a91-932a-17dd540f0ac0
spec:
  replicas: 1
  selector:
    matchLabels:
      app: canary-scaledowndelay
  strategy:
    canary:
      abortScaleDownDelaySeconds: 0
      canaryService: canary-scaledowndelay-canary
      scaleDownDelayRevisionLimit: 1
      stableService: canary-scaledowndelay-stable
      steps:
      - setCanaryScale:
          replicas: 1
      - pause: {}
      trafficRouting:
        alb:
          ingress: canary-scaledowndelay-ingress
          rootService: canary-scaledowndelay-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-03-21T00:23:29.304848614Z"
      creationTimestamp: null
      labels:
        app: canary-scaledowndelay
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: canary-scaledowndelay
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 2
  abort: true
  availableReplicas: 2
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 795f96b9cb
        serviceName: canary-scaledowndelay-canary
        weight: 0
      stable:
        podTemplateHash: 66597877b7
        serviceName: canary-scaledowndelay-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2024-03-21T00:23:29Z"
    lastUpdateTime: "2024-03-21T00:23:29Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-03-21T00:23:29Z"
    lastUpdateTime: "2024-03-21T00:23:29Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-03-21T00:23:29Z"
    lastUpdateTime: "2024-03-21T00:23:29Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-03-21T00:23:30Z"
    lastUpdateTime: "2024-03-21T00:23:30Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: Unknown
    type: Progressing
  - lastTransitionTime: "2024-03-21T00:23:30Z"
    lastUpdateTime: "2024-03-21T00:23:30Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  controllerPause: true
  currentPodHash: 795f96b9cb
  currentStepHash: 5db8f9b897
  currentStepIndex: 1
  message: CanaryPauseStep
  observedGeneration: "3"
  pauseConditions:
  - reason: CanaryPauseStep
    startTime: "2024-03-21T00:23:30Z"
  phase: Paused
  readyReplicas: 2
  replicas: 2
  selector: app=canary-scaledowndelay
  stableRS: 66597877b7
  updatedReplicas: 1

2024-03-21T00:23:28Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/canary-scaledownd-on-abort
2024-03-21T00:23:28Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (66597877b7)
2024-03-21T00:23:28Z         Normal    RolloutUpdated            Rollout updated to revision 1
2024-03-21T00:23:28Z         Normal    NewReplicaSetCreated      Created ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1)
2024-03-21T00:23:28Z         Normal    PatchingALBIngress        Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2024-03-21T00:23:28Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2024-03-21T00:23:28Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet canary-scaledownd-on-abort-66597877b7 (revision 1) from 0 to 1
2024-03-21T00:23:28Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (66597877b7): Initial deploy
2024-03-21T00:23:29Z         Normal    SwitchService             Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2024-03-21T00:23:29Z         Normal    SwitchService             Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2024-03-21T00:23:29Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (795f96b9cb)
2024-03-21T00:23:29Z         Normal    RolloutUpdated            Rollout updated to revision 2
2024-03-21T00:23:29Z         Normal    NewReplicaSetCreated      Created ReplicaSet canary-scaledownd-on-abort-795f96b9cb (revision 2)
2024-03-21T00:23:29Z (x3)    Normal    TrafficWeightUpdated      Traffic weight updated 
2024-03-21T00:23:29Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet canary-scaledownd-on-abort-795f96b9cb (revision 2) from 0 to 1
2024-03-21T00:23:30Z         Normal    SwitchService             Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to '795f96b9cb'
2024-03-21T00:23:30Z         Normal    RolloutStepCompleted      Rollout step 1/2 completed (setCanaryScale{replicas: 1})
2024-03-21T00:23:30Z         Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)

time="2024-03-21T00:25:30Z" level=info msg="Deleting e2e-test-name=TestCanaryUnScaleDownOnAbort"
    --- FAIL: TestCanarySuite/TestCanaryUnScaleDownOnAbort (123.11s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

4 out of 9 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 18s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 8m 5s]
Raw output
Failed
=== RUN   TestCanarySuite
time="2024-03-21T00:20:06Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (363.36s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

6 skipped tests found

There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

108 tests found

There are 108 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryWithPausedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestNeverScaleDown
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownOnSuccess
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownProgressively
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite