Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AIRFLOW-6839] even more mypy speed improvements #7460

Merged

Conversation

potiuk
Copy link
Member

@potiuk potiuk commented Feb 19, 2020

Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false = 13s


Issue link: AIRFLOW-6839

Make sure to mark the boxes below before creating PR: [x]

  • Description above provides context of the change
  • Commit message/PR title starts with [AIRFLOW-NNNN]. AIRFLOW-NNNN = JIRA ID*
  • Unit tests coverage for changes (not needed for documentation changes)
  • Commits follow "How to write a good git commit message"
  • Relevant documentation is updated including usage instructions.
  • I will engage committers as explained in Contribution Workflow Example.

* For document-only changes commit message can start with [AIRFLOW-XXXX].


In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.

Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false =  13s
@potiuk potiuk merged commit 3089812 into apache:master Feb 19, 2020
potiuk added a commit that referenced this pull request Feb 19, 2020
Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false =  13s

(cherry picked from commit 3089812)
kaxil pushed a commit that referenced this pull request Feb 21, 2020
Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false =  13s

(cherry picked from commit 3089812)
galuszkak pushed a commit to FlyrInc/apache-airflow that referenced this pull request Mar 5, 2020
Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false =  13s
kaxil pushed a commit that referenced this pull request Mar 19, 2020
Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false =  13s

(cherry picked from commit 3089812)
kaxil pushed a commit to astronomer/airflow that referenced this pull request Mar 19, 2020
Require_serial:true is better choice than pass_filename: false as it can
speed-up mypy for single file changes.

Significant gains can be achieved for single file changes and no cache for all
other files. This is majority of cases for our users who have pre-commits
installed as hooks because most people change only few files and never run
check with --all-files

When just one file is changed and no cache is built, the difference is drastic:

require_serial: true = 4s

pass_filenames: false =  13s

(cherry picked from commit 3089812)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants