Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve XComObjectStoreBackend implementation #38608

Conversation

uranusjr
Copy link
Member

Repeated configuration access is moved to cached functions so the string literals don't need to be written repeatedly. The path configuration is made mandatory since it more or less is; using this backend without a path configured is most likely an unintended user error.

Various functions are rewritten to take advantage of early returns, and more localized try-except blocks to improve code quality.

@uranusjr uranusjr force-pushed the xcom-objectstorage-backend-improvements branch 2 times, most recently from c196629 to 78ec6e4 Compare March 29, 2024 10:33
Repeated configuration access is moved to cached functions so the string
literals don't need to be written repeatedly. The path configuration is
made mandatory since it more or less is; using this backend without a
path configured is most likely an unintended user error.

Various functions are rewritten to take advantage of early returns, and
more localized try-except blocks to improve code quality.
@uranusjr uranusjr force-pushed the xcom-objectstorage-backend-improvements branch from 78ec6e4 to fbdfedd Compare April 1, 2024 00:05
@eladkal eladkal added this to the Airflow 2.9.1 milestone Apr 2, 2024
@jedcunningham jedcunningham merged commit 62f948c into apache:main Apr 2, 2024
40 checks passed
@jedcunningham jedcunningham deleted the xcom-objectstorage-backend-improvements branch April 2, 2024 22:00
idantepper pushed a commit to idantepper/airflow that referenced this pull request Apr 3, 2024
Repeated configuration access is moved to cached functions so the string
literals don't need to be written repeatedly. The path configuration is
made mandatory since it more or less is; using this backend without a
path configured is most likely an unintended user error.

Various functions are rewritten to take advantage of early returns, and
more localized try-except blocks to improve code quality.
idantepper pushed a commit to idantepper/airflow that referenced this pull request Apr 3, 2024
Repeated configuration access is moved to cached functions so the string
literals don't need to be written repeatedly. The path configuration is
made mandatory since it more or less is; using this backend without a
path configured is most likely an unintended user error.

Various functions are rewritten to take advantage of early returns, and
more localized try-except blocks to improve code quality.
mathiaHT pushed a commit to mathiaHT/airflow that referenced this pull request Apr 4, 2024
Repeated configuration access is moved to cached functions so the string
literals don't need to be written repeatedly. The path configuration is
made mandatory since it more or less is; using this backend without a
path configured is most likely an unintended user error.

Various functions are rewritten to take advantage of early returns, and
more localized try-except blocks to improve code quality.
utkarsharma2 pushed a commit to astronomer/airflow that referenced this pull request Apr 22, 2024
Repeated configuration access is moved to cached functions so the string
literals don't need to be written repeatedly. The path configuration is
made mandatory since it more or less is; using this backend without a
path configured is most likely an unintended user error.

Various functions are rewritten to take advantage of early returns, and
more localized try-except blocks to improve code quality.
@jedcunningham jedcunningham removed this from the Airflow 2.9.1 milestone Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants