Releases: Azure/AKS
Release 2023-06-04
Release 2023-06-04
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Docker container runtime for Windows nodepools has been retired as of May 1, 2023. You may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd. In alignment with this retirement, AKS has deleted all published windows 2019 docker images.
- After May 31, 2023, Ubuntu 18.04 will reach end of life. AKS will continue to update the host OS from Canonical into the Kubernetes 1.24 VHD images. Customers will not receive daily security updates from Canonical past the end of May, but will be able to consume those through a node image update only.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- Unattended Upgrades are disabled on Azure Linux when running on a NVIDIA GPU enabled VM sizes.
- SecurityPatch OS Servicing channel is not supported on Azure Linux when running on NVIDIA GPU enabled VM sizes.
- Windows2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows2022.
Release notes
-
Behavior Changes
- Automatic upgrades will now be blocked on clusters that have clients using deprecated API versions. This will be logged into the cluster's activity log. Upgrades will be retried during each upgrade interval and will succeed when usage of deprecated APIs has stopped. Clusters can also be upgraded manually with the deprecated API validation bypassed.
- Konnectivity will now be deployed into clusters using BYOCNI or API Server VNet Integration in combination with Azure CNI Overlay.
-
Component Updates
- ip-masq-agent-v2 has been upgraded to v0.1.6.
- Azure Blob Storage CSI driver has been upgraded to v1.21.3 for AKS 1.26+.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202306.01.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202306.01.0.
Release 2023-05-28
Release 2023-05-28
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Docker container runtime for Windows nodepools has been retired as of May 1, 2023. You may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd. In alignment with this retirement, AKS has deleted all published windows 2019 docker images.
- After May 31, 2023, Ubuntu 18.04 will reach end of life. AKS will continue to update the host OS from Canonical into the Kubernetes 1.24 VHD images. Customers will not receive daily security updates from Canonical past the end of May, but will be able to consume those through a node image update only.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- Unattended Upgrades are disabled on Azure Linux when running on a NVIDIA GPU enabled VM sizes.
- SecurityPatch OS Servicing channel is not supported on Azure Linux when running on NVIDIA GPU enabled VM sizes.
- Windows2019 will be retired in Kubernetes v1.33 and above (ETA March 2026). Customers should upgrade to Windows2022.
Release notes
-
Features
- Azure Linux is now generally available as a container host OS on AKS. The Build announcement can be found here and the documentation for deploying Azure Linux can be found here.
- FIPS image support is now enabled for Azure Linux.
- The AKS devX extension now supports the creation of GitHub Actions.
- Managed Prometheus is now Generally available.
- Kubernetes Apps is now Generally available.
-
Preview Features
- Generation 2 VMs are now supported for Windows node pools.
- Custom Node Configuration for kubelet parameters is now supported for Windows node pools.
- Automated deployments now supports draft. Take your application and automatically create dockerfiles, kubernetes manifests, and github actions to deploy it onto your AKS cluster with ease.
-
Behavior Changes
- PodSecurityPolicy is removed in AKS clusters v1.25 and higher. Customers may not upgrade to v1.25 and above if PSP is enabled, an error will occur if attempted. PSP needs to be disabled before upgrading.
- Added installhint to help guide users to install kubelogin if not already in their PATH. Users will see this hint when they get the user kubeconfig for their cluster in exec format and when a tool they use in conjunction with that kubeconfig chooses to display that hint.
- Added configmap hash to cilium agent and operator annotations. The configmap hash will appear in the k8s manifests for cilium-operator and cilium-agent.
- Improved error messages and public documentation for errors 50, 51, and 52. Now when customers encounter these errors, they should be able to resolve them by accessing the appropriate section in our troubleshooting documentation.
- Web Application Routing now supports configuration through the Azure portal.
- During cluster upgrade to v1.26.0 or a later version, disk PV node affinity check will cause the upgrade to fail if there are disk PVs still using deprecated labels: failure-domain.beta.kubernetes.io/zone and failure-domain.beta.kubernetes.io/region
-
Bug Fixes
- Fixed a bug to resolve an upstream issue where the volume is not detached after the pod and PVC objects are deleted. See resolved issue here.
-
Component Updates
- Azure File CSI driver has been upgraded to v1.24.2.
- Azure Linux image has been updated to AzureLinux-202305.24.0.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202305.24.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202305.24.0.
Release 2023-05-21
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Docker container runtime for Windows nodepools has been retired as of May 1, 2023. You may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd. In alignment with this retirement, AKS has deleted all published windows 2019 docker images.
- After May 31, 2023, Ubuntu 18.04 will reach end of life. AKS will continue to update the host OS from Canonical into the Kubernetes 1.24 VHD images. Customers will not receive daily security updates from Canonical past the end of May, but will be able to consume those through a node image update only.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- Unattended Upgrades are disabled on Mariner when running on a NVIDIA GPU enabled VM sizes.
- SecurityPatch OS Servicing channel is not supported on Mariner when running on NVIDIA GPU enabled VM sizes.
Release notes
-
Behavior Changes
- Added get permissions for ciliumnetworkpolicy, ciliumclusterwidenetworkpolicy,ciliumendpoint ciliumidentity, and ciliumnode api-resources to the aks-service ClusterRole to enable support workflows.
- After a cluster has been stopped for 30 days, etcd backup storage is no longer deleted. Deletion of etcd backup now only happens when the cluster is deleted.
- For arm clients that use the location header instead of the async-operation header, return bad request 400 if the async operation failed for a client error rather than 500 according to this spec.
- Enable the toggle to use ForcePodDrain option in Stop MC operation to give some grace period for the pod to stop before deleting the node.
-
Bug Fixes
- Fixed bug that will recreate IPv6 SLB backend pools if missing on dual-stack clusters.
- Fixed bug to prevent customers from listing secrets in agent nodes.
- Fixed a bug where disabling the Open Service Mesh add-on was leaving behind the HorizontalPodAutoscaler resources
osm-controller-hpa
andosm-injector-hpa
-
Component Updates
- Decrease default CPU request of Image Cleaner's vulnerability scanner from 1 core to half core which may cause client's scanning take longer time.
- Updated
azure-cns
image to v1.4.44_hotfix - Update container insights addon to version 3.1.8.
- Upgrade Azure Disk CSI driver to v1.26.4 to fix CVE.
- AKS Mariner image has been updated to AKSMariner-202305.15.0.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202305.15.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202305.15.0.
Release 2023-05-14
Release 2023-05-14
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Docker container runtime for Windows nodepools has been retired as of May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- AKS is gradually rolling out a change that will rotate the token in the kubeconfig credentials. It shall not incur any impact since kubeconfig has the client certificate. Should you see any issue, retrieve the kubeconfig again with
az aks get-credentials
. - Unattended Upgrades are disabled on Mariner when running on a NVIDIA GPU enabled VM sizes.
- SecurityPatch OS Servicing channel is not supported on Mariner when running on NVIDIA GPU enabled VM sizes.
Release notes
-
Behavior Changes
- Customers can now upgrade AKS private clusters to apiserver vnet integrated clusters in all public cloud regions.
-
Bug Fixes
- Now returning a clientError "Could not find the Public IP in resource group %s in subscription %s" when creating agent pool with invalid nodePublicIPPrefixID.
- For Node Restriction enabled clusters running window calico, we added a new role "windows-calico-node-role" to grant windows containers permission to get secret from calico-system only.
- Now returning a clientError "Could not find any load balancer in resource group %s in subscription %s" when Stop Cluster fails with ScaleVMSSAgentPoolFailed when there is no LB on the cluster.
-
Component Updates
- Blob CSI driver upgraded to v1.21.2 for AKS 1.26.
- CSI image liveness-probe upgraded to v2.10.0 and the node-driver-registrar image upgraded to v2.8.0 for CVE fixes.
- Azure File CSI driver upgraded to v1.24.1 for AKS 1.24, 1.25.
- CoreDNS upgraded to 1.9.4 for AKS clusters of versions >= 1.24.0.
- AKS Windows 2019 image has been updated to 17763.4377.230510.
- AKS Windows 2022 image has been updated to 20348.1726.230510.
Release 2023-05-07
Release 2023-05-07
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Docker container runtime for Windows nodepools has been retired as of May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- The Docker Bridge CIDR field in the AKS API was made redundant during our change from Docker to containerD in Kubernetes version 1.19. Starting with the 2023-04-01 AKS API version, the Docker Bridge CIDR field will be removed.
- AKS is gradually rolling out a change that will rotate the token in the kubeconfig credentials. It shall not incur any impact since kubeconfig has the client certificate. Should you see any issue, retrieve the kubeconfig again with
az aks get-credentials
.
Release notes
-
Preview Features
- Mariner is now supported in NodeOSUpgradeChannel (preview). This change is currently rolling out and expected to be in all regions by May 12th.
-
Bug Fixes
- Updated 'cilium', 'cilium-operator', 'cilium-pre-flight' ClusterRoles to include 'update' permission for 'ciliumidentities' api-resource. This addresses the issue where cilium-operator and cilium-agent could not garbage collect unused identities. identities.
- Now returning a clientError, when you do a Stop/RunCommand action on a cluster that was never successfully provisioned and was stuck in failed state. Error message returned is "The cluster is being deleted or hasn't been fully provisioned yet.".
- The CPU limit of Windows DaemonSet for Azure Monitor Metrics Addon is updated from 200m to 500m to fix throttling issue.
- In cases where an Azure CNI Overlay cluster's podCIDR becomes exhausted (i.e does not have enough ip addresses for the node count across all nodepools)then based on nodepools.MaxCount value only for those nodepools that have AutoScaling enabled - customer will get an already existing error message 'i18n.InsufficientSubnetSize error Target fieldnames.NetworkProfile_PodCIDR'.
- In case customer deploys an Azure CNI Overlay cluster into a nodeCIDR, where the nodeCIDR doesn't have enough ip addresses for the number of nodes across the nodepools on the same subnet. Then for nodepools that have autoscaling enabled and based on maxcount, customer will get the same 'i18n.InsufficientSubnetSize error message with an error target fieldnames.AgentPoolProfile_VnetSubnetID'.
-
Component Updates
- Open Service Mesh add-on images updated from v1.2.3 to v1.2.4 for AKS clusters of versions >= 1.24.0.
- Istio-based service mesh add-on's istiod and ingress images updated from v1.17.1 to v1.17.2. User needs to restart the workload pods to trigger re-injection of the newer patch version of istio-proxy. More information can be found here.
- Cilium upgraded to 1.12.8 for AKS clusters with Azure CNI Powered by Cilium.
- Blob csi driver upgraded to v1.19.5 on AKS 1.24, 1.25 to fix blobfuse install failures.
- Csi-provisioner version updated to v3.5.0 in order to fix a volume deletion issue, details
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202305.08.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202305.08.0.
- AKS Mariner image has been updated to AKSMariner-202305.08.0.
2023-04-30
Release 2023-04-30
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Starting on March 21, 2023, traffic to k8s.gcr.io will be redirected to registry.k8s.io, following the community announcement.
- Docker container runtime will be retired for Windows nodepools on May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- We are no longer offering support for Azure Disk and Azure File in-tree drivers in Kubernetes 1.26. Please migrate to csi.
- AKS is gradually rolling out a change that will rotate the token in the kubeconfig credentials. It shall not incur any impact since kubeconfig has the client certificate. Should you see any issue, retrieve the kubeconfig again with
az aks get-credentials
.
Release notes
-
Preview Features
- Mariner is now supported in NodeOSUpgradeChannel (preview). This change is currently rolling out and expected to be in all regions by May 12th.
-
Component Updates
- AKS Container Insights monitoring addon has been updated to v3.1.7.
- The Prometheus addon image for linux and windows has been updated to v6.6.0-main-04-25-2023-2eb2a81c and v6.6.0-main-04-25-2023-2eb2a81c-win respectively.
- Metrics-server has been updated to version v0.6.3.
- Linux NPM has been updated to version v1.4.45.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202304.24.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202304.24.0.
- AKS Mariner image has been updated to AKSMariner-202304.24.0.
Release 2023-04-23
Release 2023-04-23
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Starting on March 21, 2023, traffic to k8s.gcr.io will be redirected to registry.k8s.io, following the community announcement.
- Docker container runtime will be retired for Windows nodepools on May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
- We are no longer offering support for Azure Disk and Azure File in-tree drivers in 1.26. Please migrate to csi.
Release notes
-
Behavior Changes
- Added certificate validation for the reset service principal operation for cert rotation operations where both certs and service principal are expired.
- Changed the maxUnavailable pod to 5% from 2% for Large Scale clusters upgrade issues when running Cilium.
- Mariner is now rebranded to Azure Linux. Customers can deploy with Mariner or Azure Linux, as both point to the same sku.
- The Azure Kubernetes Service RBAC Admin role definition has been updated to contain explicit references to dataActions instead of the broad "Microsoft.ContainerService/managedClusters/*" dataAction. This role is now equivalent to the permissions specified in the Kubernetes built-in admin role.
-
Component Updates
- Updated Blob CSI driver to 1.19.4 on AKS clusters of versions >= 1.24.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202304.20.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202304.20.0.
- AKS Mariner image has been updated to AKSMariner-202304.20.0.
Release 2023-04-16
Release 2023-04-16
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Starting on March 21, 2023, traffic to k8s.gcr.io will be redirected to registry.k8s.io, following the community announcement.
- Docker container runtime will be retired for Windows nodepools on May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- Each Kubernetes version is supported for 12 months. After 12 months, the minor version will shift to platform support only. Our new platform support policy provides customers with Azure infrastructure support while the cluster is in an n-3 version (where n is the latest supported AKS GA minor version). Platform support does not include anything related to Kubernetes functionality and components, but provides customers with additional support beyond what was previously provided for unsupported versions.
Release notes
-
Features
- Dual-stack networking (IPv4/IPv6) on kubenet is now generally available.
-
Preview Features
- Istio-based service mesh add-on for Azure Kubernetes Service is now available in preview.
-
Bug Fix
- Fixed an issue that prevented the user-assigned managed identity of the AKS cluster from being updated from identity to another user-assigned managed identity.
- Disabled kubelet-registration-probe on Windows nodes of AKS version 1.26 to reduce CPU consumption.
- For clusters using Image Cleaner preview feature, the unused role
eraser-leader-election-role
and rolebindingeraser-leader-election-rolebinding
have been deleted. - Reduced Azure Blob CSI driver memory limit on agent node from 2100Mi to 400Mi.
- For dual-stack networking (IPv4/IPv6) clusters, fixed an issue where the Standard Load Balancer couldn't have IPv6 public prefixes.
-
Behavior Changes
- For AKS clusters of version >= 1.23, RuntimeDefault is set as the default seccomp profile for all workloads.
-
Component Updates
- Azure cloud controller manager image updated to v1.23.30, v1.24.17, v1.25.11 and v1.26.7.
- Updated Azure Disk CSI driver to 1.26.3 on AKS clusters of versions >= 1.24.
- Azure Monitor Container Insights image has been updated to 3.1.6
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202304.10.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202304.10.0.
- AKS Mariner image has been updated to AKSMariner-202304.10.0.
- AKS Windows 2019 image has been updated to 17763.4252.230412.
- AKS Windows 2022 image has been updated to 20348.1668.230412.
Release 2023-04-09
Release 2023-04-09
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Starting on March 21, 2023, traffic to k8s.gcr.io will be redirected to registry.k8s.io, following the community announcement.
- Docker container runtime will be retired for Windows nodepools on May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- Kubernetes version 1.26 is now Generally Available with AKS. AKS has deprecated Kubernetes version 1.23 on April 2, 2023. Please upgrade your AKS clusters to version 1.24 or above.
Release notes
-
Features
- AAD workload identity is now Generally Available.
-
Preview Features
- Stop cluster minor version upgrades on API breaking changes is now available in preview. AKS will fail fast on minor version manual upgrades if it detects usages of deprecated APIs in the target version of the upgrade. This is available when target cluster for upgrade is >= 1.26.0, when the API request for cluster is using API version >= 2023-01-02-preview, and when usage of API breaking changes has been detected in the 12 hours prior to the upgrade.
-
Bug Fix
- Fixed an issue where
kube-scheduler
would crash on AKS clusters of version 1.25+ when there are inline volumes in the cluster. - Fixed an issue where it was not possible to rotate certificates for stopped AKS clusters.
- When installing Cilium Enterprise through Azure Marketplace, AKS validates that if the extension is from an Isovalent offer, then the extension name must be "cilium". The extension name error message has been clarified to reflect this requirement.
- Fixed an issue where
-
Component Updates
- Azure Monitor managed service for Prometheus addon's
kube-state-metrics
image has been updated from 2.6.0 to 2.8.1. - Kubernetes Event-driven Autoscaling (KEDA) add-on has been updated to version 2.10.0 and is now available on AKS version 1.26.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202304.05.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202304.05.0.
- AKS Mariner image has been updated to AKSMariner-202304.05.0.
- Azure Monitor managed service for Prometheus addon's
Release 2023-04-02
Release 2023-04-02
Monitor the release status by regions at AKS-Release-Tracker.
Announcements
- Starting on March 21, 2023, traffic to k8s.gcr.io will be redirected to registry.k8s.io, following the community announcement.
- Docker container runtime will be retired for Windows nodepools on May 1, 2023. After docker container runtime is retired, you may remain on existing deployed instances but scaling operations will fail, nodepool creation will fail, and you will be out of support. Follow the detailed steps in our documentation to upgrade to containerd.
- AKS has deprecated Kubernetes version 1.23 on April 2, 2023. Please upgrade your AKS clusters to version 1.24 or above.
Release notes
-
Feature
- Terminating a long running operation on an AKS cluster is now Generally available.
-
Bug Fix
- Fixed an issue that network connectivity lost on systemd-networkd restart.
-
Behavior Changes
- L7 proxy for Azure CNI powered by Cilium is disabled and not supported for GA
-
Component Updates
- Workload Identity has been updated to version v1.0.0.
- Azure File CSI driver has been updated to version v1.26.1 on AKS 1.26 which has CVE fixes
- Add action to clean up orphaned disks in node management group. These disks were created by VMAS node and will not be used after VMs are deleted.
- AKS Ubuntu 18.04 image has been updated to AKSUbuntu-1804-202303.28.0.
- AKS Ubuntu 22.04 image has been updated to AKSUbuntu-2204-202303.28.0.
- AKS Mariner image has been updated to AKSMariner-202303.28.0.