Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add command args for plugin #2992

Merged
merged 3 commits into from
Aug 30, 2023

add doc

74feaea
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

feat: add command args for plugin #2992

add doc
74feaea
Select commit
Loading
Failed to load commit list.
GitHub Actions / E2E Tests Published Test Results succeeded Aug 30, 2023 in 0s

14 fail, 6 skipped, 82 pass in 3h 43m 1s

    4 files      4 suites   3h 43m 1s ⏱️
102 tests   82 ✔️   6 💤 14
426 runs  385 ✔️ 24 💤 17

Results for commit 74feaea.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 14s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 13s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2023-08-30T09:44:38Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2023-08-30T09:44:38Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-08-30T09:44:38Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-08-30T09:44:39Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-08-30T09:44:39Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2023-08-30T09:44:39Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-08-30T09:44:39Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-08-30T09:44:40Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=alb-rollout
time="2023-08-30T09:44:40Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-08-30T09:44:40Z" level=info msg="Updated rollout pod spec: 2023-08-30T09:44:40.618490878Z" rollout=alb-rollout
time="2023-08-30T09:44:40Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:264
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:254
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeight
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  11s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-58bdf5c66b�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-58bdf5c66b-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-58bdf5c66b-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-58bdf5c66b-2-0-experiment-alb-canary-sxxbv  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-58bdf5c66b-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-58bdf5c66b-2-0-experiment-alb-stable-qxtlt  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      11s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-m5g2r                                Pod         �[32m✔�[0m Running      11s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-08-30T09:44:39Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeight
  name: alb-rollout
  namespace: default
  resourceVersion: "4016"
  uid: 708b59ab-4f3e-4e06-897b-63ff2bba1d9d
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingress: alb-rollout-ingress
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-08-30T09:44:40.618490878Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-58bdf5c66b-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 58bdf5c66b
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2023-08-30T09:44:40Z"
    lastUpdateTime: "2023-08-30T09:44:40Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-08-30T09:44:40Z"
    lastUpdateTime: "2023-08-30T09:44:40Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-08-30T09:44:40Z"
    lastUpdateTime: "2023-08-30T09:44:40Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-08-30T09:44:39Z"
    lastUpdateTime: "2023-08-30T09:44:40Z"
    message: Created new replica set "alb-rollout-58bdf5c66b"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 58bdf5c66b
  currentStepHash: 558cc8bf4d
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2023-08-30T09:44:39Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2023-08-30T09:44:39Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-08-30T09:44:39Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T09:44:39Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-08-30T09:44:39Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-08-30T09:44:39Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-08-30T09:44:39Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-08-30T09:44:40Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-08-30T09:44:40Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-08-30T09:44:40Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (58bdf5c66b)
2023-08-30T09:44:40Z         Normal    RolloutUpdated            Rollout updated to revision 2
2023-08-30T09:44:40Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-58bdf5c66b (revision 2)
2023-08-30T09:44:40Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2023-08-30T09:44:40Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-58bdf5c66b-2-0'
2023-08-30T09:44:42Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2023-08-30T09:44:42Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2023-08-30T09:44:50Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (13.21s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 14s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
time="2023-08-30T09:44:51Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
time="2023-08-30T09:44:51Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-08-30T09:44:52Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-08-30T09:44:52Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-08-30T09:44:52Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-1 created\n" rollout=alb-rollout
time="2023-08-30T09:44:52Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-2 created\n" rollout=alb-rollout
time="2023-08-30T09:44:53Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-08-30T09:44:53Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-08-30T09:44:54Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2023-08-30T09:44:54Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-08-30T09:44:54Z" level=info msg="Updated rollout pod spec: 2023-08-30T09:44:54.702380995Z" rollout=alb-rollout
time="2023-08-30T09:44:54Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:298
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:287
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"alb-rollout-65fb698869-2-0-experiment-alb-canary\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"alb-rollout-65fb698869-2-0-experiment-alb-canary\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"alb-rollout-65fb698869-2-0-experiment-alb-canary","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"alb-rollout-65fb698869-2-0-experiment-alb-canary","ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  11s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-65fb698869�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-65fb698869-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-65fb698869-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-65fb698869-2-0-experiment-alb-canary-9zgzs  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-65fb698869-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-65fb698869-2-0-experiment-alb-stable-t5xvx  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      11s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-8f7bp                                Pod         �[32m✔�[0m Running      11s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-08-30T09:44:53Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeightMultiIngress
  name: alb-rollout
  namespace: default
  resourceVersion: "4242"
  uid: 80dd1b96-63e2-420b-b028-2cdec51f39b0
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingresses:
          - alb-rollout-multi-ingress-1
          - alb-rollout-multi-ingress-2
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-08-30T09:44:54.702380995Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-65fb698869-2-0
    weights:
      additional:
      - podTemplateHash: c57999c6c
        serviceName: alb-rollout-65fb698869-2-0-experiment-alb-canary
        weight: 20
      - weight: 20
      canary:
        podTemplateHash: 65fb698869
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2023-08-30T09:44:54Z"
    lastUpdateTime: "2023-08-30T09:44:54Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-08-30T09:44:54Z"
    lastUpdateTime: "2023-08-30T09:44:54Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-08-30T09:44:54Z"
    lastUpdateTime: "2023-08-30T09:44:54Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-08-30T09:44:53Z"
    lastUpdateTime: "2023-08-30T09:44:54Z"
    message: Created new replica set "alb-rollout-65fb698869"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 65fb698869
  currentStepHash: 558cc8bf4d
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2023-08-30T09:44:53Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2023-08-30T09:44:53Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-08-30T09:44:53Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T09:44:53Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-08-30T09:44:53Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-08-30T09:44:53Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-08-30T09:44:53Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-08-30T09:44:54Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-08-30T09:44:54Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-08-30T09:44:54Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (65fb698869)
2023-08-30T09:44:54Z         Normal    RolloutUpdated            Rollout updated to revision 2
2023-08-30T09:44:54Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-65fb698869 (revision 2)
2023-08-30T09:44:54Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2023-08-30T09:44:54Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-65fb698869-2-0'
2023-08-30T09:44:55Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-multi-ingress-1` to desiredWeight '0'
2023-08-30T09:44:55Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-multi-ingress-2` to desiredWeight '0'
2023-08-30T09:44:55Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20 alb-rollout-65fb698869-2-0-experiment-alb-canary c57999c6c} {20  }]

time="2023-08-30T09:45:04Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (14.04s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 7 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 2m 5s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 1m 57s]
Raw output
Failed
=== RUN   TestAWSSuite
--- FAIL: TestAWSSuite (117.25s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAnalysisSuite/TestAnalysisWithSecret (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 2m 26s]
Raw output
Failed
=== RUN   TestAnalysisSuite/TestAnalysisWithSecret
time="2023-08-30T09:40:01Z" level=info msg="Deleting e2e-test-name=TestAnalysisWithSecret"
W0830 09:40:01.431714   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 09:40:01.435269   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-08-30T09:40:01Z" level=info msg="rollout.argoproj.io/rollout-secret created\n" rollout=rollout-secret
time="2023-08-30T09:40:02Z" level=info msg="secret/example-secret configured\n" rollout=rollout-secret
time="2023-08-30T09:40:02Z" level=info msg="analysistemplate.argoproj.io/analysis-secret created\n" rollout=rollout-secret
time="2023-08-30T09:40:02Z" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-secret
time="2023-08-30T09:40:22Z" level=info msg="Condition 'status=Healthy' met after 20s" rollout=rollout-secret
time="2023-08-30T09:40:22Z" level=info msg="AnalysisRun expectation 'analysisrun count == 0' met" rollout=rollout-secret
time="2023-08-30T09:40:22Z" level=info msg="Updated rollout pod spec: 2023-08-30T09:40:22.906187241Z" rollout=rollout-secret
time="2023-08-30T09:40:22Z" level=info msg="Waiting for condition: status=Paused" rollout=rollout-secret
time="2023-08-30T09:40:28Z" level=info msg="Condition 'status=Paused' met after 5s" rollout=rollout-secret
time="2023-08-30T09:40:28Z" level=info msg="Waiting for AnalysisRun rollout-secret-54c9d46f6f-2-1 condition: phase=Successful" rollout=rollout-secret
time="2023-08-30T09:40:28Z" level=info msg="Condition 'phase=Successful' met after 0s" rollout=rollout-secret
time="2023-08-30T09:40:28Z" level=info msg="Promoted rollout" rollout=rollout-secret
time="2023-08-30T09:40:28Z" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-secret
    when.go:443: timeout after 2m0s waiting for condition status=Healthy
Name:            rollout-secret
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout to unpause
Strategy:        Canary
  Step:          2/3
  SetWeight:     25
  ActualWeight:  50
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       2
  Updated:       1
  Ready:         2
  Available:     2

NAME                                        KIND         STATUS         AGE    INFO
⟳ rollout-secret                            Rollout      �[94m◌�[0m Progressing  2m27s  
├──# revision:2                                                                
│  ├──⧉ �[33mrollout-secret-54c9d46f6f�[0m           ReplicaSet   �[32m✔�[0m Healthy      2m6s   �[33mcanary�[0m
│  │  └──□ rollout-secret-54c9d46f6f-62hsk  Pod          �[32m✔�[0m Running      2m6s   ready:1/1
│  └──α �[0mrollout-secret-54c9d46f6f-2-1�[0m       AnalysisRun  �[32m✔�[0m Successful   2m5s   �[32m✔�[0m 2
└──# revision:1                                                                
   └──⧉ �[32mrollout-secret-77bf55959c�[0m           ReplicaSet   �[32m✔�[0m Healthy      2m7s   �[32mstable�[0m
      └──□ rollout-secret-77bf55959c-xh2hq  Pod          �[32m✔�[0m Running      2m7s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-08-30T09:40:01Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestAnalysisWithSecret
  name: rollout-secret
  namespace: default
  resourceVersion: "1028"
  uid: f8d7d36e-1a41-4263-ad1a-226b88237e32
spec:
  replicas: 1
  revisionHistoryLimit: 2
  selector:
    matchLabels:
      app: rollout-secret
  strategy:
    canary:
      steps:
      - setWeight: 25
      - analysis:
          analysisRunMetadata: {}
          templates:
          - templateName: analysis-secret
      - pause: {}
  template:
    metadata:
      annotations:
        update: "2023-08-30T09:40:22.906187241Z"
      creationTimestamp: null
      labels:
        app: rollout-secret
    spec:
      containers:
      - image: nginx:1.19-alpine
        imagePullPolicy: Always
        name: rollouts-demo
        ports:
        - containerPort: 8080
          protocol: TCP
        resources: {}
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-08-30T09:40:22Z"
    lastUpdateTime: "2023-08-30T09:40:22Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-08-30T09:40:22Z"
    lastUpdateTime: "2023-08-30T09:40:22Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-08-30T09:40:22Z"
    lastUpdateTime: "2023-08-30T09:40:22Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-08-30T09:40:28Z"
    lastUpdateTime: "2023-08-30T09:40:28Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: Unknown
    type: Progressing
  - lastTransitionTime: "2023-08-30T09:40:28Z"
    lastUpdateTime: "2023-08-30T09:40:28Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  controllerPause: true
  currentPodHash: 54c9d46f6f
  currentStepHash: 6d67d78fc7
  currentStepIndex: 2
  message: CanaryPauseStep
  observedGeneration: "3"
  phase: Paused
  readyReplicas: 2
  replicas: 2
  selector: app=rollout-secret
  stableRS: 77bf55959c
  updatedReplicas: 1

2023-08-30T09:40:01Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/rollout-secret
2023-08-30T09:40:21Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (77bf55959c)
2023-08-30T09:40:21Z    Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T09:40:21Z    Normal    NewReplicaSetCreated      Created ReplicaSet rollout-secret-77bf55959c (revision 1)
2023-08-30T09:40:21Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet rollout-secret-77bf55959c (revision 1) from 0 to 1
2023-08-30T09:40:21Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (77bf55959c): Initial deploy
2023-08-30T09:40:22Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (54c9d46f6f)
2023-08-30T09:40:22Z    Normal    RolloutUpdated            Rollout updated to revision 2
2023-08-30T09:40:22Z    Normal    NewReplicaSetCreated      Created ReplicaSet rollout-secret-54c9d46f6f (revision 2)
2023-08-30T09:40:22Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet rollout-secret-54c9d46f6f (revision 2) from 0 to 1
2023-08-30T09:40:23Z    Normal    RolloutStepCompleted      Rollout step 1/3 completed (setWeight: 25)
2023-08-30T09:40:23Z    Normal    AnalysisRunRunning        Step Analysis Run 'rollout-secret-54c9d46f6f-2-1' Status New: 'Running' Previous: ''
2023-08-30T09:40:28Z    Normal    AnalysisRunSuccessful     Step Analysis Run 'rollout-secret-54c9d46f6f-2-1' Status New: 'Successful' Previous: 'Running'
2023-08-30T09:40:28Z    Normal    RolloutStepCompleted      Rollout step 2/3 completed (analysis)
2023-08-30T09:40:28Z    Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)

time="2023-08-30T09:42:28Z" level=info msg="Deleting e2e-test-name=TestAnalysisWithSecret"
W0830 09:42:28.288638   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 09:42:28.294562   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestAnalysisSuite/TestAnalysisWithSecret (146.95s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAnalysisSuite/TestCanaryInlineMultipleAnalysis (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 8s]
Raw output
Failed
=== RUN   TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
time="2023-08-30T09:43:50Z" level=info msg="Deleting e2e-test-name=TestCanaryInlineMultipleAnalysis"
time="2023-08-30T09:43:51Z" level=info msg="rollout.argoproj.io/rollout-inline-analysis created\n" rollout=rollout-inline-analysis
time="2023-08-30T09:43:51Z" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-inline-analysis
time="2023-08-30T09:43:52Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=rollout-inline-analysis
time="2023-08-30T09:43:52Z" level=info msg="AnalysisRun expectation 'analysisrun count == 0' met" rollout=rollout-inline-analysis
time="2023-08-30T09:43:52Z" level=info msg="Updated rollout pod spec: 2023-08-30T09:43:52.506834975Z" rollout=rollout-inline-analysis
time="2023-08-30T09:43:52Z" level=info msg="Waiting for condition: status=Paused" rollout=rollout-inline-analysis
time="2023-08-30T09:43:53Z" level=info msg="Condition 'status=Paused' met after 1s" rollout=rollout-inline-analysis
time="2023-08-30T09:43:53Z" level=info msg="Promoted rollout" rollout=rollout-inline-analysis
time="2023-08-30T09:43:53Z" level=info msg="Sleeping 5s" rollout=rollout-inline-analysis
time="2023-08-30T09:43:58Z" level=error msg="AnalysisRun expectation 'analysisrun count == 1' failed" rollout=rollout-inline-analysis
Name:            rollout-inline-analysis
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout to unpause
Strategy:        Canary
  Step:          1/3
  SetWeight:     10
  ActualWeight:  50
Images:          nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       2
  Updated:       1
  Ready:         2
  Available:     2

NAME                                                KIND        STATUS         AGE  INFO
⟳ rollout-inline-analysis                           Rollout     �[94m◌�[0m Progressing  7s   
├──# revision:2                                                                     
│  └──⧉ �[33mrollout-inline-analysis-9549df85b�[0m           ReplicaSet  �[32m✔�[0m Healthy      6s   �[33mcanary�[0m
│     └──□ rollout-inline-analysis-9549df85b-c2wl9  Pod         �[32m✔�[0m Running      6s   ready:1/1
└──# revision:1                                                                     
   └──⧉ �[32mrollout-inline-analysis-5b9ffdfd5�[0m           ReplicaSet  �[32m✔�[0m Healthy      7s   �[32mstable�[0m
      └──□ rollout-inline-analysis-5b9ffdfd5-vlb8x  Pod         �[32m✔�[0m Running      7s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-08-30T09:43:51Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryInlineMultipleAnalysis
  name: rollout-inline-analysis
  namespace: default
  resourceVersion: "2814"
  uid: a9747eb9-8bf7-4977-ab22-0167396b1138
spec:
  replicas: 1
  selector:
    matchLabels:
      app: rollout-inline-analysis
  strategy:
    canary:
      steps:
      - setWeight: 10
      - pause: {}
      - analysis:
          analysisRunMetadata: {}
          templates:
          - templateName: multiple-job
  template:
    metadata:
      annotations:
        update: "2023-08-30T09:43:52.506834975Z"
      creationTimestamp: null
      labels:
        app: rollout-inline-analysis
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: rollouts-demo
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-08-30T09:43:52Z"
    lastUpdateTime: "2023-08-30T09:43:52Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-08-30T09:43:52Z"
    lastUpdateTime: "2023-08-30T09:43:52Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-08-30T09:43:52Z"
    lastUpdateTime: "2023-08-30T09:43:52Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-08-30T09:43:53Z"
    lastUpdateTime: "2023-08-30T09:43:53Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: Unknown
    type: Progressing
  - lastTransitionTime: "2023-08-30T09:43:53Z"
    lastUpdateTime: "2023-08-30T09:43:53Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  controllerPause: true
  currentPodHash: 9549df85b
  currentStepHash: 85d6477764
  currentStepIndex: 1
  message: CanaryPauseStep
  observedGeneration: "3"
  phase: Paused
  readyReplicas: 2
  replicas: 2
  selector: app=rollout-inline-analysis
  stableRS: 5b9ffdfd5
  updatedReplicas: 1

2023-08-30T09:43:51Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/rollout-inline-analysis
2023-08-30T09:43:51Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (5b9ffdfd5)
2023-08-30T09:43:51Z    Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T09:43:51Z    Normal    NewReplicaSetCreated      Created ReplicaSet rollout-inline-analysis-5b9ffdfd5 (revision 1)
2023-08-30T09:43:51Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet rollout-inline-analysis-5b9ffdfd5 (revision 1) from 0 to 1
2023-08-30T09:43:51Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (5b9ffdfd5): Initial deploy
2023-08-30T09:43:52Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (9549df85b)
2023-08-30T09:43:52Z    Normal    RolloutUpdated            Rollout updated to revision 2
2023-08-30T09:43:52Z    Normal    NewReplicaSetCreated      Created ReplicaSet rollout-inline-analysis-9549df85b (revision 2)
2023-08-30T09:43:52Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet rollout-inline-analysis-9549df85b (revision 2) from 0 to 1
2023-08-30T09:43:53Z    Normal    RolloutStepCompleted      Rollout step 1/3 completed (setWeight: 10)
2023-08-30T09:43:53Z    Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)

time="2023-08-30T09:43:58Z" level=info msg="Deleting e2e-test-name=TestCanaryInlineMultipleAnalysis"
    --- FAIL: TestAnalysisSuite/TestCanaryInlineMultipleAnalysis (8.00s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

2 out of 6 runs failed: TestAnalysisSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 6m 35s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 4m 34s]
Raw output
Failed
=== RUN   TestAnalysisSuite
time="2023-08-30T09:39:21Z" level=info msg="analysistemplate.argoproj.io/web-background created\n"
time="2023-08-30T09:39:22Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-08-30T09:39:22Z" level=info msg="analysistemplate.argoproj.io/multiple-job created\n"
time="2023-08-30T09:39:22Z" level=info msg="analysistemplate.argoproj.io/multiple-job-fail created\n"
--- FAIL: TestAnalysisSuite (395.17s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestCanarySuite/TestCanaryDynamicStableScale (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 20s]
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryDynamicStableScale
time="2023-08-30T09:49:44Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
time="2023-08-30T09:49:45Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2023-08-30T09:49:45Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2023-08-30T09:49:46Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2023-08-30T09:49:46Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2023-08-30T09:49:46Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
time="2023-08-30T09:49:47Z" level=info msg="Marked 4 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-08-30T09:49:47Z" level=info msg="Waiting for condition: status=Healthy" rollout=dynamic-stable-scale
time="2023-08-30T09:49:50Z" level=info msg="Condition 'status=Healthy' met after 2s" rollout=dynamic-stable-scale
time="2023-08-30T09:49:50Z" level=info msg="Updated rollout pod spec: 2023-08-30T09:49:50.671286702Z" rollout=dynamic-stable-scale
time="2023-08-30T09:49:51Z" level=info msg="Marked 1 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-08-30T09:49:51Z" level=info msg="Waiting for condition: status=Paused" rollout=dynamic-stable-scale
time="2023-08-30T09:49:52Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=dynamic-stable-scale
time="2023-08-30T09:49:52Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-08-30T09:49:54Z" level=info msg="Pod expectation 'revision:1 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-08-30T09:49:54Z" level=info msg="Pod expectation 'revision:2 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-08-30T09:49:54Z" level=info msg="Promoted rollout" rollout=dynamic-stable-scale
time="2023-08-30T09:49:55Z" level=info msg="Marked 2 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-08-30T09:49:55Z" level=info msg="Waiting for condition: status.currentStepIndex=3" rollout=dynamic-stable-scale
time="2023-08-30T09:49:57Z" level=info msg="Condition 'status.currentStepIndex=3' met after 1s" rollout=dynamic-stable-scale
time="2023-08-30T09:49:57Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-08-30T09:49:59Z" level=info msg="Pod expectation 'revision:1 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-08-30T09:49:59Z" level=info msg="Pod expectation 'revision:2 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-08-30T09:49:59Z" level=info msg="Aborted rollout" rollout=dynamic-stable-scale
time="2023-08-30T09:50:00Z" level=info msg="Marked 2 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-08-30T09:50:00Z" level=info msg="Waiting for condition: rev=2 podcount=1" rollout=dynamic-stable-scale
time="2023-08-30T09:50:02Z" level=info msg="Condition 'rev=2 podcount=1' met after 1s" rollout=dynamic-stable-scale
time="2023-08-30T09:50:02Z" level=info msg="Pod expectation 'revision:1 pod count == 4' met" rollout=dynamic-stable-scale
time="2023-08-30T09:50:03Z" level=info msg="Marked 1 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-08-30T09:50:03Z" level=info msg="Waiting for condition: rev=2 podcount=0" rollout=dynamic-stable-scale
time="2023-08-30T09:50:03Z" level=info msg="Condition 'rev=2 podcount=0' met after 0s" rollout=dynamic-stable-scale
    canary_test.go:620: Expected dynamic-stable-scale-canary selector: map[app:dynamic-stable-scale rollouts-pod-template-hash:868d98995b]. Actual: map[app:dynamic-stable-scale rollouts-pod-template-hash:77c9876d8c]
Name:            dynamic-stable-scale
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/4
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       0
  Ready:         4
  Available:     4

NAME                                              KIND        STATUS         AGE  INFO
⟳ dynamic-stable-scale                            Rollout     �[31m✖�[0m Degraded     17s  
├──# revision:2                                                                   
│  └──⧉ �[33mdynamic-stable-scale-77c9876d8c�[0m           ReplicaSet  �[0m•�[0m ScaledDown   13s  �[33mcanary�[0m
│     └──□ dynamic-stable-scale-77c9876d8c-f294l  Pod         �[94m◌�[0m Terminating  13s  ready:1/1
└──# revision:1                                                                   
   └──⧉ �[32mdynamic-stable-scale-868d98995b�[0m           ReplicaSet  �[32m✔�[0m Healthy      17s  �[32mstable�[0m
      ├──□ dynamic-stable-scale-868d98995b-g8x9j  Pod         �[32m✔�[0m Running      17s  ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-4zpl7  Pod         �[32m✔�[0m Running      4s   ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-dbk9w  Pod         �[32m✔�[0m Running      4s   ready:1/1
      └──□ dynamic-stable-scale-868d98995b-gjbdc  Pod         �[32m✔�[0m Running      4s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-08-30T09:49:46Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryDynamicStableScale
  name: dynamic-stable-scale
  namespace: default
  resourceVersion: "6294"
  uid: dfc96445-4258-4706-870f-ec68890e7855
spec:
  replicas: 4
  selector:
    matchLabels:
      app: dynamic-stable-scale
  strategy:
    canary:
      canaryService: dynamic-stable-scale-canary
      dynamicStableScale: true
      stableService: dynamic-stable-scale-stable
      steps:
      - setWeight: 25
      - pause: {}
      - setWeight: 75
      - pause: {}
      trafficRouting:
        alb:
          ingress: dynamic-stable-scale-ingress
          rootService: dynamic-stable-scale-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-08-30T09:49:50.671286702Z"
      creationTimestamp: null
      labels:
        app: dynamic-stable-scale
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: dynamic-stable-scale
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
      readinessGates:
      - conditionType: argoproj.io/e2e-readiness
status:
  HPAReplicas: 5
  abort: true
  abortedAt: "2023-08-30T09:49:59Z"
  availableReplicas: 5
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 77c9876d8c
        serviceName: dynamic-stable-scale-canary
        weight: 0
      stable:
        podTemplateHash: 868d98995b
        serviceName: dynamic-stable-scale-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-08-30T09:49:50Z"
    lastUpdateTime: "2023-08-30T09:49:50Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-08-30T09:49:50Z"
    lastUpdateTime: "2023-08-30T09:49:50Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-08-30T09:49:50Z"
    lastUpdateTime: "2023-08-30T09:49:50Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-08-30T09:49:57Z"
    lastUpdateTime: "2023-08-30T09:49:57Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2023-08-30T09:49:59Z"
    lastUpdateTime: "2023-08-30T09:49:59Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: 77c9876d8c
  currentStepHash: 7c5b668566
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "2"
  phase: Degraded
  readyReplicas: 5
  replicas: 5
  selector: app=dynamic-stable-scale
  stableRS: 868d98995b
  updatedReplicas: 1

2023-08-30T09:49:46Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/dynamic-stable-scale
2023-08-30T09:49:46Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (868d98995b)
2023-08-30T09:49:46Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T09:49:46Z         Normal    NewReplicaSetCreated      Created ReplicaSet dynamic-stable-scale-868d98995b (revision 1)
2023-08-30T09:49:46Z         Normal    PatchingALBIngress        Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '0'
2023-08-30T09:49:46Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-08-30T09:49:46Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 0 to 4
2023-08-30T09:49:46Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (868d98995b): Initial deploy
2023-08-30T09:49:50Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-stable' from '' to '868d98995b'
2023-08-30T09:49:50Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-canary' from '' to '868d98995b'
2023-08-30T09:49:50Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (77c9876d8c)
2023-08-30T09:49:50Z         Normal    RolloutUpdated            Rollout updated to revision 2
2023-08-30T09:49:50Z         Normal    NewReplicaSetCreated      Created ReplicaSet dynamic-stable-scale-77c9876d8c (revision 2)
2023-08-30T09:49:50Z (x3)    Normal    TrafficWeightUpdated      Traffic weight updated 
2023-08-30T09:49:50Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet dynamic-stable-scale-77c9876d8c (revision 2) from 0 to 1
2023-08-30T09:49:52Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-canary' from '868d98995b' to '77c9876d8c'
2023-08-30T09:49:52Z         Normal    PatchingALBIngress        Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '25'
2023-08-30T09:49:52Z         Normal    TrafficWeightUpdated      Traffic weight updated from 0 to 25
2023-08-30T09:49:52Z         Normal    RolloutStepCompleted      Rollout step 1/4 completed (setWeight: 25)
2023-08-30T09:49:52Z         Normal    ScalingReplicaSet         Scaled down ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 4 to 3
2023-08-30T09:49:52Z         Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)
2023-08-30T09:49:54Z         Normal    RolloutStepCompleted      Rollout step 2/4 completed (pause)

time="2023-08-30T09:50:04Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
    --- FAIL: TestCanarySuite/TestCanaryDynamicStableScale (20.00s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 4m 11s]
Raw output
Failed
=== RUN   TestCanarySuite
time="2023-08-30T09:49:44Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (251.99s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestFunctionalSuite/TestRolloutPDBRestart (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 2m 9s]
Raw output
Failed
=== RUN   TestFunctionalSuite/TestRolloutPDBRestart
time="2023-08-30T10:00:35Z" level=info msg="Deleting e2e-test-name=TestRolloutPDBRestart"
time="2023-08-30T10:00:35Z" level=info msg="poddisruptionbudget.policy/rollout-pdb-restart created\n" rollout=rollout-pdb-restart
time="2023-08-30T10:00:36Z" level=info msg="rollout.argoproj.io/rollout-pdb-restart created\n" rollout=rollout-pdb-restart
time="2023-08-30T10:00:36Z" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-pdb-restart
time="2023-08-30T10:00:44Z" level=info msg="Condition 'status=Healthy' met after 7s" rollout=rollout-pdb-restart
time="2023-08-30T10:00:44Z" level=info msg="Updated rollout pod spec: 2023-08-30T10:00:44.19059227Z" rollout=rollout-pdb-restart
time="2023-08-30T10:00:44Z" level=info msg="Waiting for condition: status=Paused" rollout=rollout-pdb-restart
    when.go:443: timeout after 2m0s waiting for condition status=Paused
Name:            rollout-pdb-restart
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout spec update to be observed
Strategy:        Canary
  Step:          2/2
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       4
  Ready:         4
  Available:     4

NAME                                            KIND        STATUS         AGE   INFO
⟳ rollout-pdb-restart                           Rollout     �[94m◌�[0m Progressing  2m8s  
└──# revision:1                                                                  
   └──⧉ �[32mrollout-pdb-restart-dd7bc8456�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m8s  �[32mstable�[0m
      ├──□ rollout-pdb-restart-dd7bc8456-72djr  Pod         �[32m✔�[0m Running      2m8s  ready:1/1
      ├──□ rollout-pdb-restart-dd7bc8456-9pn4c  Pod         �[32m✔�[0m Running      2m8s  ready:1/1
      ├──□ rollout-pdb-restart-dd7bc8456-kqjc2  Pod         �[32m✔�[0m Running      2m8s  ready:1/1
      └──□ rollout-pdb-restart-dd7bc8456-pr5p7  Pod         �[32m✔�[0m Running      2m8s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "1"
  creationTimestamp: "2023-08-30T10:00:36Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRolloutPDBRestart
  name: rollout-pdb-restart
  namespace: default
  resourceVersion: "12520"
  uid: 76ee3de6-f5e7-48a9-a9c7-f3c2bd68afb7
spec:
  replicas: 4
  selector:
    matchLabels:
      app: rollout-pdb-restart
  strategy:
    canary:
      maxUnavailable: 100%
      steps:
      - setWeight: 25
      - pause: {}
  template:
    metadata:
      annotations:
        update: "2023-08-30T10:00:44.19059227Z"
      creationTimestamp: null
      labels:
        app: rollout-pdb-restart
    spec:
      containers:
      - image: nginx:1.19-alpine
        lifecycle:
          postStart:
            exec:
              command:
              - sleep
              - "5"
          preStop:
            exec:
              command:
              - sleep
              - "5"
        name: rollout-pdb-restart
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 4
  availableReplicas: 4
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-08-30T10:00:36Z"
    lastUpdateTime: "2023-08-30T10:00:36Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-08-30T10:00:44Z"
    lastUpdateTime: "2023-08-30T10:00:44Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-08-30T10:00:36Z"
    lastUpdateTime: "2023-08-30T10:00:44Z"
    message: ReplicaSet "rollout-pdb-restart-dd7bc8456" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-08-30T10:00:44Z"
    lastUpdateTime: "2023-08-30T10:00:44Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  currentPodHash: dd7bc8456
  currentStepHash: 77b4b4f4c6
  currentStepIndex: 2
  observedGeneration: "1"
  phase: Healthy
  readyReplicas: 4
  replicas: 4
  selector: app=rollout-pdb-restart
  stableRS: dd7bc8456
  updatedReplicas: 4

2023-08-30T10:00:36Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/rollout-pdb-restart
2023-08-30T10:00:36Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (dd7bc8456)
2023-08-30T10:00:36Z    Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T10:00:36Z    Normal    NewReplicaSetCreated      Created ReplicaSet rollout-pdb-restart-dd7bc8456 (revision 1)
2023-08-30T10:00:36Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet rollout-pdb-restart-dd7bc8456 (revision 1) from 0 to 4
2023-08-30T10:00:36Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (dd7bc8456): Initial deploy

time="2023-08-30T10:02:44Z" level=info msg="Deleting e2e-test-name=TestRolloutPDBRestart"
    --- FAIL: TestFunctionalSuite/TestRolloutPDBRestart (129.25s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestFunctionalSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 7m 32s]
Raw output
Failed
=== RUN   TestFunctionalSuite
time="2023-08-30T09:56:30Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestFunctionalSuite (452.69s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestIstioSuite/TestIstioHostSplitExperimentStep (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 2m 4s]
Raw output
Failed
=== RUN   TestIstioSuite/TestIstioHostSplitExperimentStep
time="2023-08-30T10:05:27Z" level=info msg="Deleting e2e-test-name=TestIstioHostSplitExperimentStep"
W0830 10:05:28.009362   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 10:05:28.013814   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-08-30T10:05:28Z" level=info msg="service/istio-host-split-canary created\n" rollout=istio-host-split
time="2023-08-30T10:05:28Z" level=info msg="service/istio-host-split-stable created\n" rollout=istio-host-split
time="2023-08-30T10:05:29Z" level=info msg="virtualservice.networking.istio.io/istio-host-split-vsvc created\n" rollout=istio-host-split
time="2023-08-30T10:05:29Z" level=info msg="rollout.argoproj.io/istio-host-split created\n" rollout=istio-host-split
time="2023-08-30T10:05:29Z" level=info msg="Waiting for condition: status=Healthy" rollout=istio-host-split
time="2023-08-30T10:05:31Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=istio-host-split
time="2023-08-30T10:05:31Z" level=info msg="Updated rollout pod spec: 2023-08-30T10:05:31.357614995Z" rollout=istio-host-split
time="2023-08-30T10:05:31Z" level=info msg="Waiting for condition: status.currentStepIndex=1" rollout=istio-host-split
    when.go:443: timeout after 2m0s waiting for condition status.currentStepIndex=1
Name:            istio-host-split
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout spec update to be observed
Strategy:        Canary
  Step:          2/2
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       1
  Ready:         1
  Available:     1

NAME                                          KIND        STATUS         AGE   INFO
⟳ istio-host-split                            Rollout     �[94m◌�[0m Progressing  2m2s  
└──# revision:1                                                                
   └──⧉ �[32mistio-host-split-5b6ddfd769�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m2s  �[32mstable�[0m
      └──□ istio-host-split-5b6ddfd769-842k8  Pod         �[32m✔�[0m Running      2m2s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "1"
  creationTimestamp: "2023-08-30T10:05:29Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestIstioHostSplitExperimentStep
  name: istio-host-split
  namespace: default
  resourceVersion: "14767"
  uid: 7c74dfc0-7497-45f0-8de7-7a3c60df8e68
spec:
  replicas: 1
  selector:
    matchLabels:
      app: istio-host-split
  strategy:
    canary:
      canaryService: istio-host-split-canary
      stableService: istio-host-split-stable
      steps:
      - setWeight: 10
      - experiment:
          templates:
          - metadata: {}
            name: experiment-istio
            specRef: canary
            weight: 20
      trafficRouting:
        istio:
          virtualService:
            name: istio-host-split-vsvc
            routes:
            - primary
  template:
    metadata:
      annotations:
        update: "2023-08-30T10:05:31.357614995Z"
      creationTimestamp: null
      labels:
        app: istio-host-split
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: istio-host-split
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 5b6ddfd769
        serviceName: istio-host-split-canary
        weight: 0
      stable:
        podTemplateHash: 5b6ddfd769
        serviceName: istio-host-split-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-08-30T10:05:29Z"
    lastUpdateTime: "2023-08-30T10:05:29Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-08-30T10:05:31Z"
    lastUpdateTime: "2023-08-30T10:05:31Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-08-30T10:05:29Z"
    lastUpdateTime: "2023-08-30T10:05:31Z"
    message: ReplicaSet "istio-host-split-5b6ddfd769" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-08-30T10:05:31Z"
    lastUpdateTime: "2023-08-30T10:05:31Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  currentPodHash: 5b6ddfd769
  currentStepHash: 67c95595c8
  currentStepIndex: 2
  observedGeneration: "2"
  phase: Healthy
  readyReplicas: 1
  replicas: 1
  selector: app=istio-host-split
  stableRS: 5b6ddfd769
  updatedReplicas: 1

2023-08-30T10:05:29Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/istio-host-split
2023-08-30T10:05:29Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (5b6ddfd769)
2023-08-30T10:05:29Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T10:05:29Z         Normal    NewReplicaSetCreated      Created ReplicaSet istio-host-split-5b6ddfd769 (revision 1)
2023-08-30T10:05:29Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-08-30T10:05:29Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet istio-host-split-5b6ddfd769 (revision 1) from 0 to 1
2023-08-30T10:05:29Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (5b6ddfd769): Initial deploy
2023-08-30T10:05:29Z         Normal    TrafficWeightUpdated      Traffic weight updated 
2023-08-30T10:05:31Z         Normal    SwitchService             Switched selector for service 'istio-host-split-stable' from '' to '5b6ddfd769'
2023-08-30T10:05:31Z         Normal    SwitchService             Switched selector for service 'istio-host-split-canary' from '' to '5b6ddfd769'

time="2023-08-30T10:07:31Z" level=info msg="Deleting e2e-test-name=TestIstioHostSplitExperimentStep"
W0830 10:07:31.884921   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 10:07:31.889824   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestIstioSuite/TestIstioHostSplitExperimentStep (124.02s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestIstioSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 3m 25s]
Raw output
Failed
=== RUN   TestIstioSuite
--- FAIL: TestIstioSuite (205.52s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestRollbackSuite/TestRollbackAnalysisWithinWindow (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 10s]
Raw output
Failed
=== RUN   TestRollbackSuite/TestRollbackAnalysisWithinWindow
time="2023-08-30T10:09:11Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisWithinWindow"
W0830 10:09:12.071834   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 10:09:12.076234   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-08-30T10:09:12Z" level=info msg="rollout.argoproj.io/window created\n" rollout=window
time="2023-08-30T10:09:12Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-08-30T10:09:14Z" level=info msg="Condition 'status=Healthy' met after 2s" rollout=window
time="2023-08-30T10:09:14Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-08-30T10:09:14Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-08-30T10:09:21Z" level=info msg="Condition 'status=Healthy' met after 6s" rollout=window
time="2023-08-30T10:09:21Z" level=info msg="AnalysisRun expectation 'analysisrun count == 1' met" rollout=window
time="2023-08-30T10:09:21Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"three\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"three\"}}}}}" rollout=window
time="2023-08-30T10:09:21Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-08-30T10:09:21Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-08-30T10:09:21Z" level=error msg="AnalysisRun expectation 'analysisrun count == 2' failed" rollout=window
Name:            window
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/2
  SetWeight:     50
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       2
  Current:       2
  Updated:       0
  Ready:         2
  Available:     2

NAME                                                         KIND         STATUS         AGE  INFO
⟳ window                                                     Rollout      �[94m◌�[0m Progressing  9s   
├──# revision:3                                                                               
│  └──⧉ �[33mwindow-6458bcd6fb�[0m                                    ReplicaSet   �[94m◌�[0m Progressing  0s   �[33mcanary�[0m
│     └──□ window-6458bcd6fb-ck8mc                           Pod          �[94m◌�[0m Pending      0s   ready:0/1
├──# revision:2                                                                               
│  ├──⧉ �[32mwindow-5658c69dbb�[0m                                    ReplicaSet   �[32m✔�[0m Healthy      7s   �[32mstable�[0m
│  │  ├──□ window-5658c69dbb-hqgbp                           Pod          �[32m✔�[0m Running      7s   ready:1/1
│  │  └──□ window-5658c69dbb-78fbq                           Pod          �[32m✔�[0m Running      1s   ready:1/1
│  └──α �[0mwindow-5658c69dbb-2-1�[0m                                AnalysisRun  �[32m✔�[0m Successful   5s   �[32m✔�[0m 1
│     └──⊞ �[0m73723f64-29d8-44eb-a3e1-c117390c2c15.sleep-job.1�[0m  Job          �[32m✔�[0m Successful   5s   
└──# revision:1                                                                               
   └──⧉ window-c64cf84f6                                     ReplicaSet   �[0m•�[0m ScaledDown   9s   
      └──□ window-c64cf84f6-v6pvp                            Pod          �[94m◌�[0m Terminating  9s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-08-30T10:09:12Z"
  generation: 4
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRollbackAnalysisWithinWindow
    rev: three
  name: window
  namespace: default
  resourceVersion: "16667"
  uid: a8d3a269-7c51-4252-9853-0818b914a329
spec:
  replicas: 2
  rollbackWindow:
    revisions: 2
  selector:
    matchLabels:
      app: window
  strategy:
    canary:
      steps:
      - setWeight: 50
      - analysis:
          analysisRunMetadata: {}
          args:
          - name: rev
            valueFrom:
              fieldRef:
                fieldPath: metadata.labels['rev']
          templates:
          - templateName: sleep-job
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: window
        rev: three
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: basic
        resources:
          requests:
            cpu: 1m
            memory: 16Mi
status:
  HPAReplicas: 2
  availableReplicas: 2
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2023-08-30T10:09:14Z"
    lastUpdateTime: "2023-08-30T10:09:14Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-08-30T10:09:21Z"
    lastUpdateTime: "2023-08-30T10:09:21Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-08-30T10:09:12Z"
    lastUpdateTime: "2023-08-30T10:09:21Z"
    message: Rollout "window" is progressing.
    reason: ReplicaSetUpdated
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-08-30T10:09:21Z"
    lastUpdateTime: "2023-08-30T10:09:21Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  currentPodHash: 6458bcd6fb
  currentStepHash: 7dd87d6d74
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "4"
  phase: Progressing
  readyReplicas: 2
  replicas: 2
  selector: app=window
  stableRS: 5658c69dbb

2023-08-30T10:09:12Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/window
2023-08-30T10:09:12Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (c64cf84f6)
2023-08-30T10:09:12Z    Normal    RolloutUpdated            Rollout updated to revision 1
2023-08-30T10:09:12Z    Normal    NewReplicaSetCreated      Created ReplicaSet window-c64cf84f6 (revision 1)
2023-08-30T10:09:12Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-08-30T10:09:12Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-08-30T10:09:14Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (5658c69dbb)
2023-08-30T10:09:14Z    Normal    RolloutUpdated            Rollout updated to revision 2
2023-08-30T10:09:14Z    Normal    NewReplicaSetCreated      Created ReplicaSet window-5658c69dbb (revision 2)
2023-08-30T10:09:14Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
2023-08-30T10:09:16Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 2 to 1
2023-08-30T10:09:16Z    Normal    RolloutStepCompleted      Rollout step 1/2 completed (setWeight: 50)
2023-08-30T10:09:16Z    Normal    AnalysisRunRunning        Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Running' Previous: ''
2023-08-30T10:09:20Z    Normal    AnalysisRunSuccessful     Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Successful' Previous: 'Running'
2023-08-30T10:09:20Z    Normal    RolloutStepCompleted      Rollout step 2/2 completed (analysis)
2023-08-30T10:09:20Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet window-5658c69dbb (revision 2) from 1 to 2
2023-08-30T10:09:21Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 1 to 0
2023-08-30T10:09:21Z    Normal    RolloutCompleted          Rollout completed update to revision 2 (5658c69dbb): Completed all 2 canary steps
2023-08-30T10:09:21Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 3 (6458bcd6fb)
2023-08-30T10:09:21Z    Normal    RolloutUpdated            Rollout updated to revision 3
2023-08-30T10:09:21Z    Normal    NewReplicaSetCreated      Created ReplicaSet window-6458bcd6fb (revision 3)

time="2023-08-30T10:09:21Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisWithinWindow"
W0830 10:09:22.035632   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 10:09:22.040144   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-08-30T10:09:22Z" level=info msg="Deleting e2e-test-name"
W0830 10:09:22.244117   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W0830 10:09:22.248456   19124 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestRollbackSuite/TestRollbackAnalysisWithinWindow (10.21s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestRollbackSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 49s]
Raw output
Failed
=== RUN   TestRollbackSuite
time="2023-08-30T10:08:32Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-08-30T10:08:33Z" level=info msg="rollout.argoproj.io/window created\n"
--- FAIL: TestRollbackSuite (49.78s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

6 skipped tests found

There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

102 tests found

There are 102 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite