Skip to content
This repository has been archived by the owner on Oct 11, 2021. It is now read-only.

Creative Cell
Compare
Choose a tag to compare
@villasv villasv released this 12 Feb 00:06
· 197 commits to master since this release
v3
8fdf288

The third official release focuses on more robust deployments and safer auto scaling with graceful shutdown.

New features:

  • Deployment with CodeDeploy, giving more control and speed
  • Airflow logs now are stored in a dedicated S3 bucket
  • Parameter allowing to opt out of loading example DAGs
  • Parameter allowing to opt out of loading default connections

Stack improvements

  • EC2 instances now have an attached IAM role, making it easier to attach policies
  • Celery now uses that role with narrower queue permissions
  • EC2 instances now have an env var specifying its kind (worker, scheduler, webserver)
  • Celery broker transport options are now enforced, no need to specify on airflow.cfg

Fixes:

  • No more race conditions running initdb
  • No more terminating instances killing tasks

Misc:

  • Upgraded to apache-airflow==1.10.2
Assets 2
Loading