[AIRFLOW-6701] Rat is downloaded from stable backup/mirrors #7323
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
potiuk
force-pushed
the
AIRFLOW-6701-download-rat-from-stable-mirrors
branch
from
a2d2436
to
840be8b
Compare
potiuk
changed the title
|
We had quite a lot of failures in cron master job (where the Dockerfile is rebuilt) and the reason was RAT download failures - it was from maven repos and those repos were not stable, so I figured we need to do it "properly" using abache backup servers + apache mirrors. It should succeed (as it does not touch .py nor kubernetes related files, so we can merge it even before we find and fix the kubernetes/kerberos failures. |
potiuk
force-pushed
the
AIRFLOW-6701-download-rat-from-stable-mirrors
branch
from
840be8b
to
369223e
Compare
|
The sooner we get it - the better - the CRON job overnight will become much more stable. |
|
All green ! pls take a look |
Also curl options are now using long format and include --fail to protect against some temporary errors (5xx). Also RAT download uses now two possible sources of downloads and fallbacks to the second if first is not available.
potiuk
force-pushed
the
AIRFLOW-6701-download-rat-from-stable-mirrors
branch
from
369223e
to
6a46efe
Compare
kaxil
approved these changes
Feb 2, 2020
potiuk
added a commit
that referenced
this pull request
Feb 2, 2020
Also curl options are now using long format and include --fail to protect against some temporary errors (5xx). Also RAT download uses now two possible sources of downloads and fallbacks to the second if first is not available. (cherry picked from commit d7d2794)
kaxil
pushed a commit
that referenced
this pull request
Feb 3, 2020
Also curl options are now using long format and include --fail to protect against some temporary errors (5xx). Also RAT download uses now two possible sources of downloads and fallbacks to the second if first is not available. (cherry picked from commit d7d2794)
kaxil
pushed a commit
to astronomer/airflow
that referenced
this pull request
Mar 30, 2020
) Also curl options are now using long format and include --fail to protect against some temporary errors (5xx). Also RAT download uses now two possible sources of downloads and fallbacks to the second if first is not available. (cherry picked from commit d7d2794) (cherry picked from commit a2b8204)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Also curl options are now using long format and include --fail
to protect against some temporary errors (5xx). Also RAT download
uses now two possible sources of downloads and fallbacks to the
second if first is not available.
Issue link: AIRFLOW-6701
Make sure to mark the boxes below before creating PR: [x]
[AIRFLOW-NNNN]. AIRFLOW-NNNN = JIRA ID** For document-only changes commit message can start with
[AIRFLOW-XXXX].In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.