Version Skew Policy
This document describes the maximum version skew supported between various Kubernetes components. Specific cluster deployment tools may place additional restrictions on version skew.
Supported versions
Kubernetes versions are expressed as x.y.z, where x is the major version, y is the minor version, and z is the patch version, following Semantic Versioning terminology. For more information, see Kubernetes Release Versioning.
The Kubernetes project maintains release branches for the most recent three minor releases (1.34, 1.33, 1.32). Kubernetes 1.19 and newer receive approximately 1 year of patch support. Kubernetes 1.18 and older received approximately 9 months of patch support.
Applicable fixes, including security fixes, may be backported to those three release branches, depending on severity and feasibility. Patch releases are cut from those branches at a regular cadence, plus additional urgent releases, when required.
The Release Managers group owns this decision.
For more information, see the Kubernetes patch releases page.
Supported version skew
kube-apiserver
In highly-available (HA) clusters,
the newest and oldest kube-apiserver instances must be within one minor version.
Example:
- newest
kube-apiserveris at 1.34 - other
kube-apiserverinstances are supported at 1.34 and 1.33
kubelet
kubeletmust not be newer thankube-apiserver.kubeletmay be up to three minor versions older thankube-apiserver(kubelet< 1.25 may only be up to two minor versions older thankube-apiserver).
Example:
kube-apiserveris at 1.34kubeletis supported at 1.34, 1.33, 1.32, and 1.31
Note:
If version skew exists betweenkube-apiserver instances in an HA cluster, this narrows the allowed kubelet versions.Example:
kube-apiserverinstances are at 1.34 and 1.33kubeletis supported at 1.33, 1.32, and 1.31 (1.34 is not supported because that would be newer than thekube-apiserverinstance at version 1.33)
kube-proxy
kube-proxymust not be newer thankube-apiserver.kube-proxymay be up to three minor versions older thankube-apiserver(kube-proxy< 1.25 may only be up to two minor versions older thankube-apiserver).kube-proxymay be up to three minor versions older or newer than thekubeletinstance it runs alongside (kube-proxy< 1.25 may only be up to two minor versions older or newer than thekubeletinstance it runs alongside).
Example:
kube-apiserveris at 1.34kube-proxyis supported at 1.34, 1.33, 1.32, and 1.31
Note:
If version skew exists betweenkube-apiserver instances in an HA cluster, this narrows the allowed kube-proxy versions.Example:
kube-apiserverinstances are at 1.34 and 1.33kube-proxyis supported at 1.33, 1.32, and 1.31 (1.34 is not supported because that would be newer than thekube-apiserverinstance at version 1.33)
kube-controller-manager, kube-scheduler, and cloud-controller-manager
kube-controller-manager, kube-scheduler, and cloud-controller-manager must not be newer than the
kube-apiserver instances they communicate with. They are expected to match the kube-apiserver minor version,
but may be up to one minor version older (to allow live upgrades).
Example:
kube-apiserveris at 1.34kube-controller-manager,kube-scheduler, andcloud-controller-managerare supported at 1.34 and 1.33
Note:
If version skew exists betweenkube-apiserver instances in an HA cluster, and these components
can communicate with any kube-apiserver instance in the cluster (for example, via a load balancer),
this narrows the allowed versions of these components.Example:
kube-apiserverinstances are at 1.34 and 1.33kube-controller-manager,kube-scheduler, andcloud-controller-managercommunicate with a load balancer that can route to anykube-apiserverinstancekube-controller-manager,kube-scheduler, andcloud-controller-managerare supported at 1.33 (1.34 is not supported because that would be newer than thekube-apiserverinstance at version 1.33)
kubectl
kubectl is supported within one minor version (older or newer) of kube-apiserver.
Example:
kube-apiserveris at 1.34kubectlis supported at 1.35, 1.34, and 1.33
Note:
If version skew exists betweenkube-apiserver instances in an HA cluster, this narrows the supported kubectl versions.Example:
kube-apiserverinstances are at 1.34 and 1.33kubectlis supported at 1.34 and 1.33 (other versions would be more than one minor version skewed from one of thekube-apiservercomponents)
Supported component upgrade order
The supported version skew between components has implications on the order in which components must be upgraded. This section describes the order in which components must be upgraded to transition an existing cluster from version 1.33 to version 1.34.
Optionally, when preparing to upgrade, the Kubernetes project recommends that you do the following to benefit from as many regression and bug fixes as possible during your upgrade:
- Ensure that components are on the most recent patch version of your current minor version.
- Upgrade components to the most recent patch version of the target minor version.
For example, if you're running version 1.33, ensure that you're on the most recent patch version. Then, upgrade to the most recent patch version of 1.34.
kube-apiserver
Pre-requisites:
- In a single-instance cluster, the existing
kube-apiserverinstance is 1.33 - In an HA cluster, all
kube-apiserverinstances are at 1.33 or 1.34 (this ensures maximum skew of 1 minor version between the oldest and newestkube-apiserverinstance) - The
kube-controller-manager,kube-scheduler, andcloud-controller-managerinstances that communicate with this server are at version 1.33 (this ensures they are not newer than the existing API server version, and are within 1 minor version of the new API server version) kubeletinstances on all nodes are at version 1.33 or 1.32 (this ensures they are not newer than the existing API server version, and are within 2 minor versions of the new API server version)- Registered admission webhooks are able to handle the data the new
kube-apiserverinstance will send them:ValidatingWebhookConfigurationandMutatingWebhookConfigurationobjects are updated to include any new versions of REST resources added in 1.34 (or use thematchPolicy: Equivalentoption available in v1.15+)- The webhooks are able to handle any new versions of REST resources that will be sent to them, and any new fields added to existing versions in 1.34
Upgrade kube-apiserver to 1.34
Note:
Project policies for API deprecation and API change guidelines requirekube-apiserver to not skip minor versions when upgrading, even in single-instance clusters.kube-controller-manager, kube-scheduler, and cloud-controller-manager
Pre-requisites:
- The
kube-apiserverinstances these components communicate with are at 1.34 (in HA clusters in which these control plane components can communicate with anykube-apiserverinstance in the cluster, allkube-apiserverinstances must be upgraded before upgrading these components)
Upgrade kube-controller-manager, kube-scheduler, and
cloud-controller-manager to 1.34. There is no
required upgrade order between kube-controller-manager, kube-scheduler, and
cloud-controller-manager. You can upgrade these components in any order, or
even simultaneously.
kubelet
Pre-requisites:
- The
kube-apiserverinstances thekubeletcommunicates with are at 1.34
Optionally upgrade kubelet instances to 1.34 (or they can be left at
1.33, 1.32, or 1.31)
Note:
Before performing a minor versionkubelet upgrade, drain pods from that node.
In-place minor version kubelet upgrades are not supported.Warning:
Running a cluster withkubelet instances that are persistently three minor versions behind
kube-apiserver means they must be upgraded before the control plane can be upgraded.kube-proxy
Pre-requisites:
- The
kube-apiserverinstanceskube-proxycommunicates with are at 1.34
Optionally upgrade kube-proxy instances to 1.34
(or they can be left at 1.33, 1.32,
or 1.31)
Warning:
Running a cluster withkube-proxy instances that are persistently three minor versions behind
kube-apiserver means they must be upgraded before the control plane can be upgraded.