- Detailed schedule
- Determining if your change is in production
- Cherry picks
- AMP Dev Channel
- AMP Release Candidate (RC) Channel
- Release cadence
- Release freezes
A new release of AMP is pushed to all AMP pages every week on Tuesday. Once a change in AMP is merged into the master branch of the amphtml repository, it will typically take 1-2 weeks for the change be live for all users.
"Type: Release" GitHub issues are used to track the status of current and past releases (from the initial cut to canary testing to production). Announcements about releases are made on the AMP Slack #release channel (sign up for Slack).
We try to stick to this schedule as closely as possible, though complications may cause delays. You can track the latest status about any release in the "Type: Release" GitHub issues and the AMP Slack #release channel (sign up for Slack).
- Tuesday @ 11am Pacific: a new canary release build is created from the latest master build that passes all of our tests and is pushed to users of AMP who opted into the AMP Dev Channel
- Wednesday: we check bug reports for Dev Channel users and if everything looks fine, we push the canary to 1% of AMP pages
- Thursday-Monday: we continue to monitor error rates and bug reports for Dev Channel users and the 1% of pages with the canary build
- Tuesday (about a week after the canary release build was cut): the canary is fully pushed to production (i.e. all AMP pages will now use this build)
You can determine what is in a given build using one of the following:
- The "Type: Release" GitHub issues for each release build will include a link to the specific release page which lists the PRs in that release.
- The most recent "Type: Release" issue with
(Production)
in the title is the build currently in production. - The "Type: Release" issue with
(Canary)
in the title tracks the current canary.
- The most recent "Type: Release" issue with
- The PR Use: In Canary and PR Use: In Production labels are added to PRs when they've made it into a canary/production build. There may be a delay between when the build is created and when it goes live.
We have a well-defined process for handling requests for changes to the canary release build or to the current production release build. These changes are known as "cherry picks".
The bar for getting a cherry pick into canary or production is very high because our goal is to produce high quality launches on a predictable schedule.
Keep in mind that performing a cherry pick requires a significant amount of work from you and the onduty person and they can take a long time to process.
- In general only fixes for P0 issues (causing "an outage or a critical production issue") may be cherry picked. P0 issues are those that:
- cause privacy or security issues
- cause user data loss
- break existing AMP web pages in a significant way
- or would otherwise cause a significant harm to AMP's reputation if left unresolved
- Regressions found in the canary that are not P0 may be approved if they can be resolved with a rollback. Fixes other than rollbacks--no matter how simple they may seem--will not be approved because these can cause cascading problems and delay the release of canary to production for everyone.
Use the following process to request a cherry pick if you have a change that you believe meets the cherry pick criteria.
If you run into any issues or have any questions when requesting a cherry pick, please use the AMP Slack #release channel (sign up for Slack).
- Ensure there is a GitHub issue filed for the problem that needs to be resolved before filing the cherry pick request issue.
- File the cherry pick request issue using the Cherry pick request template. Follow the instructions in the template, providing all of the requested data. Make sure you fill out this issue completely or your cherry pick may not be seen or acted upon.
- Get the necessary approval for your cherry pick (indicated via comments on the cherry pick request issue).
- For cherry picks into canary, at least one member of the Approvers WG must approve the cherry pick.
- For cherry picks into prod:
- if the fix is a clean rollback that does not require any other changes, at least one member of the Approvers WG must approve the cherry pick.
- otherwise, at least one member from the Cherry Pick Approvers group must approve the cherry pick.
- After the cherry pick has been approved, the person currently handling releases (onduty) will work with you to ensure the cherry pick is made.
- Once the cherry pick is made you are responsible for verifying that the cherry pick you requested fixes the reported issue and that it does not cause other issues.
If you are requesting a cherry pick to fix an issue in production it is very likely you will also need a cherry pick into the canary release since otherwise the problem your cherry pick addresses would reappear as soon as the canary release is pushed to production. Work with the onduty person to determine if you need a cherry pick to both and make sure your cherry pick request issue reflects what you determine.
The AMP Dev Channel is a way to opt a browser into using the canary release build of the AMP JS libraries. The Dev Channel may be less stable and it may contain features not yet available to all users.
Opting into the Dev Channel is great to:
- test and play with new features not yet available to all users
- use in Quality Assurance (QA) to ensure that your site is compatible with upcoming features of AMP that are still under development
When you opt into the AMP Dev Channel you are only affecting the AMP JS libraries in your browser; there is no way to force visitors to your site to use the AMP Dev Channel version of AMP.
To opt your browser into the AMP Dev Channel, go to the AMP experiments page and activate the "AMP Dev Channel" experiment. Please subscribe to our low-volume announcements mailing list to get notified about important/breaking changes about AMP.
If you find an issue that appears to only occur in the Dev Channel version of AMP:
- please file an issue with a description of the problem
- include a note that the problem is new to the Dev Channel build so that it can be properly prioritized
- include a URL to a page that reproduces the problem
- ping the AMP Slack #release channel (sign up for Slack) with the issue you filed so we can delay the push of the Dev Channel version to production if needed
The AMP Release Candidate (RC) Channel is a way to opt a browser into using the build of the AMP JS libraries that will be released during the subsequent release cycle (typically, a week later). It is similar to the Dev Channel described above, but it will not contain the experimental features that are still under development.
Opting into the RC Channel is great to:
- test and play with the version of the AMP runtime that will be released soon
- use in Quality Assurance (QA) to ensure that your site is compatible with the next version of AMP
Similar to the Dev channel, when you opt into the AMP RC Channel you are only affecting the AMP JS libraries in your browser; there is no way to force visitors to your site to use the AMP RC Channel version of AMP.
To opt your browser into the AMP RC Channel, go to the AMP experiments page and activate the "AMP RC Channel" experiment. Please subscribe to our low-volume announcements mailing list to get notified about important/breaking changes about AMP.
If you find an issue that appears to only occur in the RC Channel version of AMP:
- please file an issue with a description of the problem
- include a note that the problem is new to the RC Channel build so that it can be properly prioritized
- include a URL to a page that reproduces the problem
- ping the AMP Slack #release channel (sign up for Slack) with the issue you filed so we can delay the push of the RC Channel version to production if needed
We are intentionally cautious with our release cadence.
In determining how often we should push new versions of AMP to everyone, we have to weigh many factors including:
- stability for the millions of sites/billions of pages built using AMP
- cache busting that might happen when we push a new version
- the desire to get new features out quickly
After considering all of these factors we have arrived at the 1-2 week push cycle. Thus far we have found this to be a reasonable compromise, but we will continue to evaluate all of these factors and may make changes in the future.
There are occasions when we will skip a release of AMP to production, known as a release freeze.
If a one week release freeze is announced for Week N:
- The previous week's release build remains in canary/RC for an extra week, i.e. the release cut in Week N-1 is not pushed to production in Week N as would normally be the case. Instead, it will be pushed to production in Week N+1.
- A new release build is not made in the production freeze week (Week N).
- The normal schedule will resume in Week N+1, i.e. a canary is cut in Week N+1 and pushed to production in Week N+2.
A release freeze will happen due to:
- Times when there are not enough people available to push the AMP release to production and monitor it. Currently most of the people performing AMP releases are based in the United States, so this will usually be the weeks of the major US holidays of Independence Day (July 4), Thanksgiving (fourth Thursday in November), Christmas (25 December) and New Year's Eve/Day (December 31/January 1).
- An emergency situation, such as a security or privacy issue as determined by the Technical Steering Committee (TSC) or the people performing the release.
- Other situations when stability of the codebase is deemed to be particularly important as determined by the TSC.
In all cases except emergencies the release freezes will be announced at least one month in advance.
Note that unless otherwise announced a release freeze does not imply a code freeze. Code may still be written, reviewed and merged during a release freeze.