Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: rollouts getting stuck due to bad rs informer updates #3200

Merged
merged 10 commits into from
Dec 4, 2023

do not double call

938141a
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

fix: rollouts getting stuck due to bad rs informer updates #3200

do not double call
938141a
Select commit
Loading
Failed to load commit list.
GitHub Actions / E2E Tests Published Test Results succeeded Dec 4, 2023 in 0s

5 fail, 6 skipped, 92 pass in 3h 30m 9s

    4 files      4 suites   3h 30m 9s ⏱️
103 tests   92 ✔️   6 💤   5
428 runs  389 ✔️ 24 💤 15

Results for commit 938141a.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

6 out of 10 runs failed: TestCanarySuite/TestCanaryDynamicStableScale (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 20s]
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 21s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 19s]
Raw output
Failed
=== RUN   TestCanarySuite/TestCanaryDynamicStableScale
time="2023-12-04T15:03:44Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
W1204 15:03:44.562387   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1204 15:03:44.565731   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-12-04T15:03:44Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2023-12-04T15:03:44Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2023-12-04T15:03:45Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2023-12-04T15:03:45Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2023-12-04T15:03:45Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
time="2023-12-04T15:03:46Z" level=info msg="Marked 4 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-12-04T15:03:46Z" level=info msg="Waiting for condition: status=Healthy" rollout=dynamic-stable-scale
time="2023-12-04T15:03:49Z" level=info msg="Condition 'status=Healthy' met after 2s" rollout=dynamic-stable-scale
time="2023-12-04T15:03:49Z" level=info msg="Updated rollout pod spec: 2023-12-04T15:03:49.549042014Z" rollout=dynamic-stable-scale
time="2023-12-04T15:03:50Z" level=info msg="Marked 1 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-12-04T15:03:50Z" level=info msg="Waiting for condition: status=Paused" rollout=dynamic-stable-scale
time="2023-12-04T15:03:52Z" level=info msg="Condition 'status=Paused' met after 1s" rollout=dynamic-stable-scale
time="2023-12-04T15:03:52Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-12-04T15:03:54Z" level=info msg="Pod expectation 'revision:1 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-12-04T15:03:54Z" level=info msg="Pod expectation 'revision:2 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-12-04T15:03:54Z" level=info msg="Promoted rollout" rollout=dynamic-stable-scale
time="2023-12-04T15:03:55Z" level=info msg="Marked 2 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-12-04T15:03:55Z" level=info msg="Waiting for condition: status.currentStepIndex=3" rollout=dynamic-stable-scale
time="2023-12-04T15:03:57Z" level=info msg="Condition 'status.currentStepIndex=3' met after 1s" rollout=dynamic-stable-scale
time="2023-12-04T15:03:57Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-12-04T15:03:59Z" level=info msg="Pod expectation 'revision:1 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-12-04T15:03:59Z" level=info msg="Pod expectation 'revision:2 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-12-04T15:03:59Z" level=info msg="Aborted rollout" rollout=dynamic-stable-scale
time="2023-12-04T15:04:00Z" level=info msg="Marked 2 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-12-04T15:04:00Z" level=info msg="Waiting for condition: rev=2 podcount=1" rollout=dynamic-stable-scale
time="2023-12-04T15:04:02Z" level=info msg="Condition 'rev=2 podcount=1' met after 2s" rollout=dynamic-stable-scale
time="2023-12-04T15:04:02Z" level=info msg="Pod expectation 'revision:1 pod count == 4' met" rollout=dynamic-stable-scale
time="2023-12-04T15:04:03Z" level=info msg="Marked 1 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-12-04T15:04:03Z" level=info msg="Waiting for condition: rev=2 podcount=0" rollout=dynamic-stable-scale
time="2023-12-04T15:04:04Z" level=info msg="Condition 'rev=2 podcount=0' met after 0s" rollout=dynamic-stable-scale
    canary_test.go:621: Expected dynamic-stable-scale-canary selector: map[app:dynamic-stable-scale rollouts-pod-template-hash:868d98995b]. Actual: map[app:dynamic-stable-scale rollouts-pod-template-hash:66869d7b86]
Name:            dynamic-stable-scale
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2
Strategy:        Canary
  Step:          0/4
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       0
  Ready:         4
  Available:     4

NAME                                              KIND        STATUS         AGE  INFO
⟳ dynamic-stable-scale                            Rollout     �[31m✖�[0m Degraded     19s  
├──# revision:2                                                                   
│  └──⧉ �[33mdynamic-stable-scale-66869d7b86�[0m           ReplicaSet  �[0m•�[0m ScaledDown   15s  �[33mcanary�[0m
│     └──□ dynamic-stable-scale-66869d7b86-d7gnv  Pod         �[94m◌�[0m Terminating  15s  ready:1/1
└──# revision:1                                                                   
   └──⧉ �[32mdynamic-stable-scale-868d98995b�[0m           ReplicaSet  �[32m✔�[0m Healthy      19s  �[32mstable�[0m
      ├──□ dynamic-stable-scale-868d98995b-tjxrd  Pod         �[32m✔�[0m Running      19s  ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-6l25d  Pod         �[32m✔�[0m Running      5s   ready:1/1
      ├──□ dynamic-stable-scale-868d98995b-98pns  Pod         �[32m✔�[0m Running      5s   ready:1/1
      └──□ dynamic-stable-scale-868d98995b-rvlb2  Pod         �[32m✔�[0m Running      5s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-12-04T15:03:45Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanaryDynamicStableScale
  name: dynamic-stable-scale
  namespace: default
  resourceVersion: "6538"
  uid: 85808bfe-9182-46a1-b2c1-88f139de70dc
spec:
  replicas: 4
  selector:
    matchLabels:
      app: dynamic-stable-scale
  strategy:
    canary:
      canaryService: dynamic-stable-scale-canary
      dynamicStableScale: true
      stableService: dynamic-stable-scale-stable
      steps:
      - setWeight: 25
      - pause: {}
      - setWeight: 75
      - pause: {}
      trafficRouting:
        alb:
          ingress: dynamic-stable-scale-ingress
          rootService: dynamic-stable-scale-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-12-04T15:03:49.549042014Z"
      creationTimestamp: null
      labels:
        app: dynamic-stable-scale
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: dynamic-stable-scale
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
      readinessGates:
      - conditionType: argoproj.io/e2e-readiness
status:
  HPAReplicas: 5
  abort: true
  abortedAt: "2023-12-04T15:03:59Z"
  availableReplicas: 5
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 66869d7b86
        serviceName: dynamic-stable-scale-canary
        weight: 0
      stable:
        podTemplateHash: 868d98995b
        serviceName: dynamic-stable-scale-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-12-04T15:03:49Z"
    lastUpdateTime: "2023-12-04T15:03:49Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-12-04T15:03:49Z"
    lastUpdateTime: "2023-12-04T15:03:49Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-12-04T15:03:49Z"
    lastUpdateTime: "2023-12-04T15:03:49Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-12-04T15:03:57Z"
    lastUpdateTime: "2023-12-04T15:03:57Z"
    message: Rollout is paused
    reason: RolloutPaused
    status: "True"
    type: Paused
  - lastTransitionTime: "2023-12-04T15:03:59Z"
    lastUpdateTime: "2023-12-04T15:03:59Z"
    message: Rollout aborted update to revision 2
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: 66869d7b86
  currentStepHash: 7c5b668566
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2'
  observedGeneration: "2"
  phase: Degraded
  readyReplicas: 5
  replicas: 5
  selector: app=dynamic-stable-scale
  stableRS: 868d98995b
  updatedReplicas: 1

2023-12-04T15:03:45Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/dynamic-stable-scale
2023-12-04T15:03:45Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (868d98995b)
2023-12-04T15:03:45Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-12-04T15:03:45Z         Normal    NewReplicaSetCreated      Created ReplicaSet dynamic-stable-scale-868d98995b (revision 1)
2023-12-04T15:03:45Z         Normal    PatchingALBIngress        Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '0'
2023-12-04T15:03:45Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-12-04T15:03:45Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 0 to 4
2023-12-04T15:03:45Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (868d98995b): Initial deploy
2023-12-04T15:03:49Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-stable' from '' to '868d98995b'
2023-12-04T15:03:49Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-canary' from '' to '868d98995b'
2023-12-04T15:03:49Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (66869d7b86)
2023-12-04T15:03:49Z         Normal    RolloutUpdated            Rollout updated to revision 2
2023-12-04T15:03:49Z         Normal    NewReplicaSetCreated      Created ReplicaSet dynamic-stable-scale-66869d7b86 (revision 2)
2023-12-04T15:03:49Z (x3)    Normal    TrafficWeightUpdated      Traffic weight updated 
2023-12-04T15:03:49Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet dynamic-stable-scale-66869d7b86 (revision 2) from 0 to 1
2023-12-04T15:03:52Z         Normal    SwitchService             Switched selector for service 'dynamic-stable-scale-canary' from '868d98995b' to '66869d7b86'
2023-12-04T15:03:52Z         Normal    PatchingALBIngress        Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '25'
2023-12-04T15:03:52Z         Normal    TrafficWeightUpdated      Traffic weight updated from 0 to 25
2023-12-04T15:03:52Z         Normal    RolloutStepCompleted      Rollout step 1/4 completed (setWeight: 25)
2023-12-04T15:03:52Z         Normal    ScalingReplicaSet         Scaled down ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 4 to 3
2023-12-04T15:03:52Z         Normal    RolloutPaused             Rollout is paused (CanaryPauseStep)
2023-12-04T15:03:54Z         Normal    RolloutStepCompleted      Rollout step 2/4 completed (pause)

time="2023-12-04T15:04:04Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
W1204 15:04:05.008909   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1204 15:04:05.013110   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestCanarySuite/TestCanaryDynamicStableScale (20.53s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestCanarySuite/TestCanarySetCanaryScale (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 2m 11s]
Raw output
Failed
=== RUN   TestCanarySuite/TestCanarySetCanaryScale
time="2023-12-04T15:06:45Z" level=info msg="Deleting e2e-test-name=TestCanarySetCanaryScale"
W1204 15:06:45.125421   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1204 15:06:45.127903   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
=== PAUSE TestCanarySuite/TestCanarySetCanaryScale
=== CONT  TestCanarySuite/TestCanarySetCanaryScale
time="2023-12-04T15:08:02Z" level=info msg="service/set-canary-scale-canary created\n" rollout=set-canary-scale
time="2023-12-04T15:08:02Z" level=info msg="service/set-canary-scale-stable created\n" rollout=set-canary-scale
time="2023-12-04T15:08:03Z" level=info msg="ingress.networking.k8s.io/set-canary-scale-ingress created\n" rollout=set-canary-scale
time="2023-12-04T15:08:03Z" level=info msg="rollout.argoproj.io/set-canary-scale created\n" rollout=set-canary-scale
time="2023-12-04T15:08:03Z" level=info msg="Waiting for condition: status=Healthy" rollout=set-canary-scale
time="2023-12-04T15:08:13Z" level=info msg="Condition 'status=Healthy' met after 9s" rollout=set-canary-scale
time="2023-12-04T15:08:13Z" level=info msg="Updated rollout pod spec: 2023-12-04T15:08:13.150818005Z" rollout=set-canary-scale
time="2023-12-04T15:08:13Z" level=info msg="Waiting for condition: status=Paused" rollout=set-canary-scale
    when.go:455: timeout after 2m0s waiting for condition status=Paused
Name:            set-canary-scale
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         waiting for rollout spec update to be observed
Strategy:        Canary
  Step:          9/9
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       4
  Updated:       4
  Ready:         4
  Available:     4

NAME                                          KIND        STATUS         AGE    INFO
⟳ set-canary-scale                            Rollout     �[94m◌�[0m Progressing  2m10s  
└──# revision:1                                                                 
   └──⧉ �[32mset-canary-scale-5d7d466b9c�[0m           ReplicaSet  �[32m✔�[0m Healthy      2m10s  �[32mstable�[0m
      ├──□ set-canary-scale-5d7d466b9c-fkv5q  Pod         �[32m✔�[0m Running      2m10s  ready:1/1
      ├──□ set-canary-scale-5d7d466b9c-r6556  Pod         �[32m✔�[0m Running      2m10s  ready:1/1
      ├──□ set-canary-scale-5d7d466b9c-v7swt  Pod         �[32m✔�[0m Running      2m10s  ready:1/1
      └──□ set-canary-scale-5d7d466b9c-vv7s2  Pod         �[32m✔�[0m Running      2m10s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "1"
  creationTimestamp: "2023-12-04T15:08:03Z"
  generation: 2
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestCanarySetCanaryScale
  name: set-canary-scale
  namespace: default
  resourceVersion: "9500"
  uid: 29112aec-9c41-4f0b-b7e2-85e35e9adf10
spec:
  replicas: 4
  selector:
    matchLabels:
      app: set-canary-scale
  strategy:
    canary:
      canaryService: set-canary-scale-canary
      stableService: set-canary-scale-stable
      steps:
      - pause: {}
      - setCanaryScale:
          weight: 25
      - pause:
          duration: 100s
      - setWeight: 50
      - pause:
          duration: 10s
      - setCanaryScale:
          replicas: 3
      - pause: {}
      - setCanaryScale:
          matchTrafficWeight: true
      - pause:
          duration: 5s
      trafficRouting:
        nginx:
          stableIngress: set-canary-scale-ingress
  template:
    metadata:
      annotations:
        update: "2023-12-04T15:08:13.150818005Z"
      creationTimestamp: null
      labels:
        app: set-canary-scale
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: set-canary-scale
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 4
  availableReplicas: 4
  blueGreen: {}
  canary:
    weights:
      canary:
        podTemplateHash: 5d7d466b9c
        serviceName: set-canary-scale-canary
        weight: 0
      stable:
        podTemplateHash: 5d7d466b9c
        serviceName: set-canary-scale-stable
        weight: 100
  conditions:
  - lastTransitionTime: "2023-12-04T15:08:03Z"
    lastUpdateTime: "2023-12-04T15:08:03Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2023-12-04T15:08:13Z"
    lastUpdateTime: "2023-12-04T15:08:13Z"
    message: Rollout is healthy
    reason: RolloutHealthy
    status: "True"
    type: Healthy
  - lastTransitionTime: "2023-12-04T15:08:03Z"
    lastUpdateTime: "2023-12-04T15:08:13Z"
    message: ReplicaSet "set-canary-scale-5d7d466b9c" has successfully progressed.
    reason: NewReplicaSetAvailable
    status: "True"
    type: Progressing
  - lastTransitionTime: "2023-12-04T15:08:13Z"
    lastUpdateTime: "2023-12-04T15:08:13Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  currentPodHash: 5d7d466b9c
  currentStepHash: 574c54b58c
  currentStepIndex: 9
  observedGeneration: "1"
  phase: Healthy
  readyReplicas: 4
  replicas: 4
  selector: app=set-canary-scale
  stableRS: 5d7d466b9c
  updatedReplicas: 4

2023-12-04T15:08:03Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/set-canary-scale
2023-12-04T15:08:03Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (5d7d466b9c)
2023-12-04T15:08:03Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-12-04T15:08:03Z         Normal    NewReplicaSetCreated      Created ReplicaSet set-canary-scale-5d7d466b9c (revision 1)
2023-12-04T15:08:03Z         Normal    CreatingCanaryIngress     Creating canary ingress `set-canary-scale-set-canary-scale-ingress-canary` with weight `0`
2023-12-04T15:08:03Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-12-04T15:08:03Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet set-canary-scale-5d7d466b9c (revision 1) from 0 to 4
2023-12-04T15:08:03Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (5d7d466b9c): Initial deploy
2023-12-04T15:08:03Z         Normal    TrafficWeightUpdated      Traffic weight updated 
2023-12-04T15:08:13Z         Normal    SwitchService             Switched selector for service 'set-canary-scale-stable' from '' to '5d7d466b9c'
2023-12-04T15:08:13Z         Normal    SwitchService             Switched selector for service 'set-canary-scale-canary' from '' to '5d7d466b9c'

time="2023-12-04T15:10:13Z" level=info msg="Deleting e2e-test-name=TestCanarySetCanaryScale"
W1204 15:10:13.528686   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1204 15:10:13.534202   21770 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
    --- FAIL: TestCanarySuite/TestCanarySetCanaryScale (131.30s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

6 out of 11 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 4m 18s]
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 21s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 4m 18s]
Raw output
Failed
=== RUN   TestCanarySuite
time="2023-12-04T15:03:44Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (258.04s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 13s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2023-12-04T15:01:34Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2023-12-04T15:01:35Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-12-04T15:01:35Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-12-04T15:01:35Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-12-04T15:01:36Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2023-12-04T15:01:36Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-12-04T15:01:36Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-12-04T15:01:37Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2023-12-04T15:01:37Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-12-04T15:01:37Z" level=info msg="Updated rollout pod spec: 2023-12-04T15:01:37.572041967Z" rollout=alb-rollout
time="2023-12-04T15:01:37Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:264
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:254
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeight
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                 KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                        Rollout     �[94m◌�[0m Progressing  11s  
├──# revision:2                                                                                      
│  ├──⧉ �[33malb-rollout-8c75d9d4b�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-8c75d9d4b-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-8c75d9d4b-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-8c75d9d4b-2-0-experiment-alb-canary-mcdtt  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-8c75d9d4b-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-8c75d9d4b-2-0-experiment-alb-stable-tv4rj  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                      
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                        ReplicaSet  �[32m✔�[0m Healthy      11s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-mv2zj                               Pod         �[32m✔�[0m Running      11s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2023-12-04T15:01:36Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeight
  name: alb-rollout
  namespace: default
  resourceVersion: "4034"
  uid: c4155249-edf3-4890-a802-8e43f799d24d
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingress: alb-rollout-ingress
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2023-12-04T15:01:37.572041967Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-8c75d9d4b-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 8c75d9d4b
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2023-12-04T15:01:37Z"
    lastUpdateTime: "2023-12-04T15:01:37Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2023-12-04T15:01:37Z"
    lastUpdateTime: "2023-12-04T15:01:37Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2023-12-04T15:01:37Z"
    lastUpdateTime: "2023-12-04T15:01:37Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2023-12-04T15:01:36Z"
    lastUpdateTime: "2023-12-04T15:01:37Z"
    message: Created new replica set "alb-rollout-8c75d9d4b"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 8c75d9d4b
  currentStepHash: 558cc8bf4d
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2023-12-04T15:01:36Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2023-12-04T15:01:36Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-12-04T15:01:36Z         Normal    RolloutUpdated            Rollout updated to revision 1
2023-12-04T15:01:36Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-12-04T15:01:36Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated to 0
2023-12-04T15:01:36Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-12-04T15:01:36Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-12-04T15:01:37Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-12-04T15:01:37Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-12-04T15:01:37Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (8c75d9d4b)
2023-12-04T15:01:37Z         Normal    RolloutUpdated            Rollout updated to revision 2
2023-12-04T15:01:37Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-8c75d9d4b (revision 2)
2023-12-04T15:01:37Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2023-12-04T15:01:37Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-8c75d9d4b-2-0'
2023-12-04T15:01:39Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2023-12-04T15:01:39Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2023-12-04T15:01:47Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (13.06s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

1 out of 5 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 1m 58s]
Raw output
Failed
=== RUN   TestAWSSuite
--- FAIL: TestAWSSuite (118.91s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

6 skipped tests found

There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / E2E Tests Published Test Results

103 tests found

There are 103 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite