Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Datastream Stream resource #13385

Conversation

modular-magician
Copy link
Collaborator

Initial implementation of datastream stream resource. Resolved #10810

This does not cover all the fields in this very large resource. In particular I'm excluding CMEK fields and oracle & postgres (because those require specific handwritten tests) and oracle & postgres support (because that requires separate, non-automated testing.)

If this PR is for Terraform, I acknowledge that I have:

  • Searched through the issue tracker for an open issue that this either resolves or contributes to, commented on it to claim it, and written "fixes {url}" or "part of {url}" in this PR description. If there were no relevant open issues, I opened one and commented that I would like to work on it (not necessary for very small changes).
  • Generated Terraform, and ran make test and make lint to ensure it passes unit and linter tests.
  • Ensured that all new fields I added that can be set by a user appear in at least one example (for generated resources) or third_party test (for handwritten resources or update tests).
  • Ran relevant acceptance tests (If the acceptance tests do not yet pass or you are unable to run them, please let your reviewer know).
  • Read the Release Notes Guide before writing my release note below.

Release Note Template for Downstream PRs (will be copied)

`google_datastream_stream`

Derived from GoogleCloudPlatform/magic-modules#6806

* Added initial datastream Stream structure

* Added basic test for datastream

* Removed oracle support since it's hard to test

* Added some additional fields that could not previously be handled

* Added full example for datastream stream with MySQL -> GCS

* Removed additional references to oracle on datastream stream

* cleaned up api.yaml and terraform.yaml

* Revert "Removed additional references to oracle on datastream stream"

This reverts commit 6ce0d705e309f79f8372e9f9706c9c21d34a1415.

* Revert "Removed oracle support since it's hard to test"

This reverts commit 732cf3036db07192046cda17c85fcec3247b8588.

* Added oracleSourceConfig.dropLargeObjects and oracleSourceConfig.streamLargeObjects

* Require a value inside jsonFileFormat

* Require a value inside bigqueryDestinationConfig

* Corrected type of fileRotationMb

* Added state field and added default_from_api to a few fields

* Fixed typo

* Corrected name of default_value property

* Removed support for oracle and postgres from Datastream Stream

This simplifies the PR; also they are not automatically testable

* Converted status field to be computed

We will likely want to use either default_from_api or use a desired_state field because this field is only partially specified

* Added desired_state field

* removed input: true from stream

* ignore read on stream connection profiles

* Added update test

* Added unit test for customizediff

* Added unit tests for customize diff

* Added external providers

* gofmt

* Corrected deletion_protection usage

* Updates due to code review

* Cleaned up test issues

* Corrections to tests

* Fixed test issues

* Added gcs file format to fix tests

* Added projectNumberDiffSuppress

* Added default_from_api for fileRotationMb

* Corrected labels usage in tests

* Corrected stream update verb

* Cleaned up references to google_storage_bucket.bucket.name

* Source / destination profile are not updatable

* Marked column length fields as output-only

* Made update test use checks instead of importstateverify for state / desired_state

* gofmt

* Add state to update mask if desired_state is changed

Signed-off-by: Modular Magician <[email protected]>
@github-actions
Copy link

github-actions bot commented Feb 4, 2023

I'm going to lock this pull request because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems related to this change, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Feb 4, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add support for datastream resources
1 participant