Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AIRFLOW-6662] Switch to --init docker flag for signal propagation #7278

Merged

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Jan 28, 2020

We are now using native --init flag of docker run and init: parameter
of docker compose to pass signals and reap child processes


Issue link: AIRFLOW-6662

Make sure to mark the boxes below before creating PR: [x]

  • Description above provides context of the change
  • Commit message/PR title starts with [AIRFLOW-NNNN]. AIRFLOW-NNNN = JIRA ID*
  • Unit tests coverage for changes (not needed for documentation changes)
  • Commits follow "How to write a good git commit message"
  • Relevant documentation is updated including usage instructions.
  • I will engage committers as explained in Contribution Workflow Example.

* For document-only changes commit message can start with [AIRFLOW-XXXX].


In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.

@codecov-io
Copy link

codecov-io commented Jan 28, 2020

Codecov Report

Merging #7278 into master will increase coverage by 0.26%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #7278      +/-   ##
==========================================
+ Coverage    85.2%   85.46%   +0.26%     
==========================================
  Files         840      851      +11     
  Lines       40336    40403      +67     
==========================================
+ Hits        34367    34531     +164     
+ Misses       5969     5872      -97
Impacted Files Coverage Δ
airflow/providers/postgres/operators/postgres.py 100% <0%> (ø) ⬆️
airflow/operators/generic_transfer.py 100% <0%> (ø) ⬆️
airflow/operators/postgres_to_gcs.py 85.29% <0%> (ø) ⬆️
airflow/providers/postgres/hooks/postgres.py 94.36% <0%> (ø) ⬆️
airflow/utils/sqlalchemy.py 96.66% <0%> (ø) ⬆️
airflow/hooks/dbapi_hook.py 91.73% <0%> (+0.82%) ⬆️
airflow/utils/dag_processing.py 87.93% <0%> (ø) ⬆️
airflow/jobs/scheduler_job.py 89.34% <0%> (+0.14%) ⬆️
airflow/contrib/operators/s3_to_sftp_operator.py 100% <0%> (ø) ⬆️
airflow/operators/google_api_to_s3_transfer.py 100% <0%> (ø) ⬆️
... and 20 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ceea293...ff50596. Read the comment docs.

We are now using native --init flag of docker run and init: parameter
of docker compose to pass signals and reap child processes
@potiuk potiuk force-pushed the AIRFLOW-6662-install-dumb-init branch from 9343807 to ff50596 Compare January 28, 2020 21:57
@potiuk potiuk changed the title [AIRFLOW-6662] Add dumb-init to CI images [AIRFLOW-6662] Switch to --init docker flag for signal propagation Jan 28, 2020
@potiuk
Copy link
Member Author

potiuk commented Jan 28, 2020

@ashb @nuclearpinguin @mik-laj @feluelle -> I fixed it all by --init flag.

@potiuk
Copy link
Member Author

potiuk commented Jan 28, 2020

@ashb @mik-laj @nuclearpinguin -> Seems the init flag is good now. I tested it and it all works fine including killing the running local builds with Ctrl-C. That was the biggest problem before dumb-init introduction and it works perfectly now.

@potiuk potiuk requested a review from turbaszek January 29, 2020 05:25
@potiuk potiuk merged commit d1bf343 into apache:master Jan 29, 2020
potiuk added a commit that referenced this pull request Jan 29, 2020
…7278)

We are now using native --init flag of docker run and init: parameter
of docker compose to pass signals and reap child processes

(cherry picked from commit d1bf343)
potiuk added a commit to PolideaInternal/airflow that referenced this pull request Feb 2, 2020
potiuk added a commit that referenced this pull request Feb 2, 2020
* Revert "[AIRFLOW-6662] Switch to --init docker flag for signal propagation (#7278)"

This reverts commit d1bf343.

* [AIRFLOW-6662] return back the dumb-init - installed by apt

We had stability problems with tests with --init flag so we are
going back to it
potiuk added a commit that referenced this pull request Feb 2, 2020
* Revert "[AIRFLOW-6662] Switch to --init docker flag for signal propagation (#7278)"

This reverts commit d1bf343.

* [AIRFLOW-6662] return back the dumb-init - installed by apt

We had stability problems with tests with --init flag so we are
going back to it

(cherry picked from commit 945b988)
kaxil pushed a commit that referenced this pull request Feb 3, 2020
…7278)

We are now using native --init flag of docker run and init: parameter
of docker compose to pass signals and reap child processes

(cherry picked from commit d1bf343)
kaxil pushed a commit that referenced this pull request Feb 3, 2020
* Revert "[AIRFLOW-6662] Switch to --init docker flag for signal propagation (#7278)"

This reverts commit d1bf343.

* [AIRFLOW-6662] return back the dumb-init - installed by apt

We had stability problems with tests with --init flag so we are
going back to it

(cherry picked from commit 945b988)
galuszkak pushed a commit to FlyrInc/apache-airflow that referenced this pull request Mar 5, 2020
…pache#7278)

We are now using native --init flag of docker run and init: parameter
of docker compose to pass signals and reap child processes
galuszkak pushed a commit to FlyrInc/apache-airflow that referenced this pull request Mar 5, 2020
* Revert "[AIRFLOW-6662] Switch to --init docker flag for signal propagation (apache#7278)"

This reverts commit d1bf343.

* [AIRFLOW-6662] return back the dumb-init - installed by apt

We had stability problems with tests with --init flag so we are
going back to it
kaxil pushed a commit to astronomer/airflow that referenced this pull request Mar 30, 2020
…pache#7278)

We are now using native --init flag of docker run and init: parameter
of docker compose to pass signals and reap child processes

(cherry picked from commit d1bf343)
(cherry picked from commit 85cde61)
kaxil pushed a commit to astronomer/airflow that referenced this pull request Mar 30, 2020
* Revert "[AIRFLOW-6662] Switch to --init docker flag for signal propagation (apache#7278)"

This reverts commit d1bf343.

* [AIRFLOW-6662] return back the dumb-init - installed by apt

We had stability problems with tests with --init flag so we are
going back to it

(cherry picked from commit 945b988)
(cherry picked from commit 3ca84ec)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants