Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Destroying "google_composer_environment" terraform resource disables cloud composer API #7849

Closed
keerthi0489 opened this issue Nov 18, 2020 · 2 comments
Labels

Comments

@keerthi0489
Copy link

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
  • Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment.
  • If an issue is assigned to the modular-magician user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If an issue is assigned to a user, that user is claiming responsibility for the issue. If an issue is assigned to hashibot, a community member has claimed the issue already.

Terraform Version

Terraform v0.12.19

Affected Resource(s)

google_composer_environment

Terraform Configuration Files

data "google_composer_image_versions" "all" {
}

resource "google_composer_environment" "composer_environment" {
  name   = "${var.resource_prefix}${var.project}-airflow-heap-export${var.resource_suffix}"
  region = var.location
  #python_version = var.composer_python
  config {
    node_count = var.composer_node_count

    node_config {
      zone            = var.zone
      machine_type    = var.composer_machine_type
      disk_size_gb    = var.composer_disk_size_gb
      service_account = google_service_account.composer.name
    }
    software_config {
      image_version = data.google_composer_image_versions.all.image_versions[0].image_version_id
      airflow_config_overrides = {
        smtp-smtp_port      = "25"
        smtp-smtp_mail_from = "[email protected]"
        smtp-smtp_host      = "localhost"
        smtp-starttls       = "True"
        smtp-ssl            = "False"
        smtp-smtp_user      = "airflow"
        email-email_backend = "airflow.contrib.utils.sendgrid.send_email"

      }
      pypi_packages = {
        boto3    = "==1.14.60"
        botocore = "==1.17.60"
      }

      env_variables = {
        GCS_EXPORT_HEAP    = var.composer_gcs_export_heap
        S3_EXPORT_HEAP     = var.composer_s3_export_heap
        HEAP_DATASET_NAME  = var.composer_heap_ds
        SENDGRID_MAIL_FROM = var.composer-email_id
        SENDGRID_API_KEY   = var.composer-sendgrid_api_key
      }
      python_version = var.composer_python
    }
  }

  depends_on = [google_project_iam_member.composer]
}

Debug Output

Panic Output

Expected Behavior

Only the composer environment should have been destroyed

Actual Behavior

The composer environment is destroyed and the Cloud Composer API is disabled

Steps to Reproduce

Important Factoids

References

  • #0000
@ghost ghost added the bug label Nov 18, 2020
@keerthi0489
Copy link
Author

Not a bug, config error in the setup.

@ghost
Copy link

ghost commented Dec 19, 2020

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. If you feel I made an error 🤖 🙉 , please reach out to my human friends 👉 [email protected]. Thanks!

@ghost ghost locked as resolved and limited conversation to collaborators Dec 19, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant