Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skymarshal: Add Bitbucket flags #2631

Merged
merged 1 commit into from
Oct 19, 2018
Merged

Conversation

edtan
Copy link
Contributor

@edtan edtan commented Sep 27, 2018

This adds Bitbucket flags to support the Bitbucket Dex connector in concourse/dex#3.

ref. #2567

Note: To test this locally, I added the following to the end of my go.mod:

replace github.com/concourse/dex => ./dex

@marco-m
Copy link
Contributor

marco-m commented Sep 28, 2018

The CI errors are

go: finding github.com/concourse/dex/connector/bitbucket latest
go: finding github.com/concourse/dex/connector latest
go: finding github.com/concourse/dex latest
skymarshal/skycmd/bitbucket_flags.go:7:2: unknown import path
    "github.com/concourse/dex/connector/bitbucket":
    cannot find module providing package github.com/concourse/dex/connector/bitbucket

This looks like a chicken and egg problem. Can anything be done by @edtan or is this needing something from The Great Project Restructuring of 2018 (#2534) ?

@marco-m
Copy link
Contributor

marco-m commented Oct 17, 2018

@edtan any news ?

@edtan
Copy link
Contributor Author

edtan commented Oct 17, 2018

@marco-m Thanks for the reminder, I forgot about this. Now that the Dex changes are in, I've rebased and renamed everything to Bitbucket Cloud to keep the naming consistent with the Dex changes.

@vito
Copy link
Member

vito commented Oct 19, 2018

thanks!

@vito vito merged commit 265d355 into concourse:master Oct 19, 2018
@marco-m
Copy link
Contributor

marco-m commented Oct 19, 2018

Thanks @vito, and thanks @edtan ❤️

@edtan edtan deleted the add-bitbucket-support branch October 19, 2018 17:19
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Dec 11, 2018
In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
authenticator (see [1]).

This commit includes the variables necessary for doing so, as well as
the necessary keys under `secrets` to have those variables injected into
web's environment.

[1]: concourse/concourse#2631

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Jan 6, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Jan 18, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Jan 18, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

- Add captureErrorMetrics and rebalanceInterval flags

	- RebalanceInterval: concourse/concourse#2312
	- CaptureErrorMetrics: concourse/concourse#2754

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Jan 18, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

- Add captureErrorMetrics and rebalanceInterval flags

	- RebalanceInterval: concourse/concourse#2312
	- CaptureErrorMetrics: concourse/concourse#2754

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Jan 23, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

- Add captureErrorMetrics and rebalanceInterval flags

	- RebalanceInterval: concourse/concourse#2312
	- CaptureErrorMetrics: concourse/concourse#2754

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Feb 16, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

- Add captureErrorMetrics and rebalanceInterval flags

	- RebalanceInterval: concourse/concourse#2312
	- CaptureErrorMetrics: concourse/concourse#2754

Signed-off-by: Ciro S. Costa <[email protected]>
cirocosta pushed a commit to cirocosta/charts that referenced this pull request Mar 1, 2019
- Make use of the worker healthcheck endpoint

	Previously, the liveness probe of the worker was based on logs, which
	could end up killing the whole worker in the case of a malformed
	pipeline.

	Now, making use of the native concourse healthchecking that the workers
	provide, we can delegate to concourse the task of telling k8s if it's
	alive or not.

	Signed-off-by: Ciro S. Costa <[email protected]>
	Signed-off-by: Saman Alvi <[email protected]>

- Make use of signals to terminate workers

	Instead of making use of `concourse retire-worker` which initiates a
	connection to the TSA to then retire the worker, we can instead make use
	of the newly introduced mechanism of sending signals to the worker to
	tell it to retire, being less error-prone.

	The idea of this commit is to do similar to what's done for Concourse's
	official BOSH releases (see
	concourse/concourse-bosh-release@a3ebf6a?diff=split)

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes GARDEN_ env in favor of config file

	On the 5.x series of Concourse, there's no need to have all the garden
	flags specified as environment variables anymore.

	That's because the new image assumes that a `gdn` binary is shipped
	together, which can look for a set of configurations from a specific
	config file.

	The set of possible values that can be used in the configuration file
	can be found here [1].

	[1]: https://github.com/cloudfoundry/guardian/blob/c1f268e69cd204e891f29bb020e32284a0054606/gqt/runner/runner.go#L41-L93

	Signed-off-by: Ciro S. Costa <[email protected]>

- Removes references to fatal errors

	Previously, the Helm chart made use of a set of possible fatal errors
	that either `garden` or `baggageclaim` would produce, terminating the
	worker pod in those cases.

	Now, making use of the worker probing endpoint (see [1]), we're able to
	implement better strategies for determining whether the worker is up or
	not while not changing the contract that `health_ip:health_port` gives
	back the info that the worker is alive or not.

	[1]: concourse/concourse@c3b26a0

	Signed-off-by: Ciro S. Costa <[email protected]>

- Updates env to match concourse 5.x

	There were some changes to some variables in the next release of
	concourse.

- Introduces bitbucket cloud auth variables

	In Concourse 5 it becomes possible to make use of Bitbucket cloud as an
	authenticator (see [1]).

	This commit includes the variables necessary for doing so, as well as
	the necessary keys under `secrets` to have those variables injected into
	web's environment.

	[1]: concourse/concourse#2631

	Signed-off-by: Ciro S. Costa <[email protected]>

- Add captureErrorMetrics and rebalanceInterval flags

	- RebalanceInterval: concourse/concourse#2312
	- CaptureErrorMetrics: concourse/concourse#2754

- Removes flags in web cmd and add missing flags
- Introduce TSA_DEBUG* variables
- uses *bind for healthcheck variables
- update worker debug flags
- update debug-bind-* variables for baggageclaim

Signed-off-by: Ciro S. Costa <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants