Add enableMetrics configuration

[torredil]

What is this PR about? / Why do we need it?

• This PR adds a Helm chart configuration which facilitates scraping AWS metrics when enableMetrics is set to true and the Prometheus Operator is installed, by deploying:

  1. A Service object that exposes the EBS CSI Driver's controller metric port through a ClusterIP.

  2. A ServiceMonitor object which updates the Prometheus scrape configuration and allows scraping metrics from the endpoint defined. For more information, see the manifest metrics.yaml.

• httpEndpoint is deprecated.

What testing is done?

• See docs/metrics.md.

Signed-off-by: Eddie Torres [email protected]

[ConnorJC3]

current version lgtm

[rdpsin]

/lgtm
/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ConnorJC3, rdpsin, torredil, wmesard

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ConnorJC3,rdpsin,torredil]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[stevo-f3]

It would be great if these labels were configurable / overridable without needing to use helm's kustomize post-renderers support.

In my setup release label should have a different value. Maybe app label can remain fixed, but release: prometheus one should ideally be part of e.g. controller.serviceMonitor.additionalLabels, to allow for overrides. Then also enable switch can be moved under controller.serviceMonitor.enabled

WDYT @torredil ?

[torredil]

@stevo-f3 Thanks for the feedback, included this improvement in #1419.