Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Makes multi-namespace mode optional #9570

Merged
merged 1 commit into from
Aug 10, 2020

Conversation

dimberman
Copy link
Contributor

@dimberman dimberman commented Jun 29, 2020

Running the airflow k8sexecutor with multiple namespace abilities
requires creating a ClusterRole which can break existing deployments


Make sure to mark the boxes below before creating PR: [x]

  • Description above provides context of the change
  • Unit tests coverage for changes (not needed for documentation changes)
  • Target Github ISSUE in description if exists
  • Commits follow "How to write a good git commit message"
  • Relevant documentation is updated including usage instructions.
  • I will engage committers as explained in Contribution Workflow Example.

In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.

@boring-cyborg boring-cyborg bot added area:Scheduler including HA (high availability) scheduler k8s labels Jun 29, 2020
@dimberman dimberman requested review from ashb, potiuk and kaxil June 29, 2020 17:27
Dockerfile.ci Outdated
"https://github.com/${AIRFLOW_REPO}/archive/${AIRFLOW_BRANCH}.tar.gz#egg=apache-airflow[${AIRFLOW_EXTRAS}]" \
--constraint "https://raw.githubusercontent.com/${AIRFLOW_REPO}/${AIRFLOW_BRANCH}/requirements/requirements-python${PYTHON_MAJOR_MINOR_VERSION}.txt" \
&& pip uninstall --yes apache-airflow;
# And is automatically reinstalled from the scratch every month
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this brings some old Dockerfile code back which is not valid any more.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Earlier this change was not here, as I did reviews.

self._concurrency: int = dag.concurrency
self._pickle_id: Optional[str] = pickle_id
self._task_special_args: Dict[str, Any] = {}
def __init__(self, dag, pickle_id=None):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it related?

Running the airflow k8sexecutor with multiple namespace abilities
requires creating a ClusterRole which can break existing deployments
@dimberman dimberman merged commit 2e3c878 into apache:master Aug 10, 2020
@dimberman dimberman deleted the fix-multi-namespace branch August 10, 2020 20:41
dimberman added a commit that referenced this pull request Aug 11, 2020
Running the airflow k8sexecutor with multiple namespace abilities
requires creating a ClusterRole which can break existing deployments

Co-authored-by: Daniel Imberman <[email protected]>
(cherry picked from commit 2e3c878)
kaxil pushed a commit that referenced this pull request Aug 11, 2020
Running the airflow k8sexecutor with multiple namespace abilities
requires creating a ClusterRole which can break existing deployments

Co-authored-by: Daniel Imberman <[email protected]>
(cherry picked from commit 2e3c878)
kaxil pushed a commit that referenced this pull request Aug 15, 2020
Running the airflow k8sexecutor with multiple namespace abilities
requires creating a ClusterRole which can break existing deployments

Co-authored-by: Daniel Imberman <[email protected]>
(cherry picked from commit 2e3c878)
cfei18 pushed a commit to cfei18/incubator-airflow that referenced this pull request Mar 5, 2021
Running the airflow k8sexecutor with multiple namespace abilities
requires creating a ClusterRole which can break existing deployments

Co-authored-by: Daniel Imberman <[email protected]>
(cherry picked from commit 2e3c878)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Scheduler including HA (high availability) scheduler
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants