Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Terraform deployment files #111

Merged
merged 4 commits into from
Jan 26, 2021
Merged

Conversation

mtojek
Copy link
Contributor

@mtojek mtojek commented Jan 20, 2021

What does this PR do?

This PR introduces new Terraform-based deployment service definitions. Deployment definitions will enabled for both data stream and package (reuse).

Why is it important?

We're moving on with service deployer for AWS, GCP, etc.

Checklist

Related issues

@mtojek mtojek self-assigned this Jan 20, 2021
@elasticmachine
Copy link

elasticmachine commented Jan 20, 2021

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #111 updated

    • Start Time: 2021-01-26T15:04:37.843+0000
  • Duration: 2 min 7 sec

  • Commit: 48cef2a

name: deploy
required: false
$ref: "./../../_dev/deploy/spec.yml" # Use "deploy" spec for package
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this what we want? It implies that there can be data stream level deployment definitions for Docker Compose-based deployments as well, not just Terraform-based deployments. Having such consistency is really nice but I want to make sure it's something that's actually going to be supported by elastic-package as well. Otherwise the spec is a bit misleading.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I modified the elastic-package here: elastic/elastic-package#228 .

As you noticed, It means that we will support deploy definitions on the data stream level. Actually we may leverage from this change, as currently developers build a single Docker image for multiple data streams. See: https://github.com/elastic/integrations/tree/master/packages/zeek/_dev/deploy/docker

If you prefer to support tf only, I can adjust the spec.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah nice, I hadn't studied elastic/elastic-package#228 in depth before, sorry! Given what you have there, what you have here is good as-is. Thanks!

@mtojek
Copy link
Contributor Author

mtojek commented Jan 26, 2021

I will solve all conflicts (statik.go and changelog.yml) once everything else is fine.

Copy link
Contributor

@ycombinator ycombinator left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM once merge conflicts are addressed and CI is green.

@mtojek mtojek merged commit 08a493a into elastic:master Jan 26, 2021
rw-access pushed a commit to rw-access/package-spec that referenced this pull request Mar 23, 2021
* Adding apache test package

* Fixing filenames

* Adding system test config for apache/error dataset

* Only sleep before destructing in debug mode

* WIP: testing a fake host variable name

* Fleshing out config

* Updating parsing logic

* Alternative parsing

* Fixing syntax for array item lookup

* Adding delete test policy handler

* Adding Port to service context

* Using Port from service context

* Consistent terminology

* Fixing some naming

* Fixing more naming

* Reducing teardown sleep duration

* Adding explanatory comment
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants