Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Metricbeat] Add GCP CloudSQL region filter #32943

Merged
merged 14 commits into from
Sep 19, 2022
Merged

[Metricbeat] Add GCP CloudSQL region filter #32943

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
e9914b6
add cloudsql region filter
gpop63 Aug 31, 2022
b4d42c2
add changelog entry
gpop63 Aug 31, 2022
0e82c01
fix comment for golangci-lint
gpop63 Aug 31, 2022
e3ea3b8
fix get filter for metric tests
gpop63 Aug 31, 2022
117cfa7
better AlignersMapToGCP comment
gpop63 Sep 1, 2022
7353ae3
Merge remote-tracking branch 'upstream/main' into add_gcp-cloudsql_re…
gpop63 Sep 10, 2022
1e85834
revert to zone and add comment
gpop63 Sep 10, 2022
b02b11f
Revert "fix get filter for metric tests"
gpop63 Sep 10, 2022
0b7d558
Merge remote-tracking branch 'upstream/main' into add_gcp-cloudsql_re…
gpop63 Sep 11, 2022
69a3921
Merge remote-tracking branch 'upstream/main' into add_gcp-cloudsql_re…
gpop63 Sep 15, 2022
4e92cfb
add cloudsql region label
gpop63 Sep 15, 2022
35196aa
add regions filter
gpop63 Sep 15, 2022
46e33df
fix changelog
gpop63 Sep 19, 2022
2be3f1c
remove comment from metrics requester
gpop63 Sep 19, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.next.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,6 +87,7 @@ https://github.com/elastic/beats/compare/v8.2.0\...main[Check the HEAD diff]
- in module/windows/perfmon, changed collection method of the second counter value required to create a displayable value {pull}32305[32305]
- Fix and improve AWS metric period calculation to avoid zero-length intervals {pull}32724[32724]
- Add missing cluster metadata to k8s module metricsets {pull}32979[32979] {pull}33032[33032]
- Add GCP CloudSQL region filter {pull}32943[32943]

*Packetbeat*

Expand Down
2 changes: 2 additions & 0 deletions x-pack/metricbeat/module/gcp/constants.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ const (
ServiceStorage = "storage"
ServiceFirestore = "firestore"
ServiceDataproc = "dataproc"
ServiceCloudSQL = "cloudsql"
)

//Paths within the GCP monitoring.TimeSeries response, if converted to JSON, where you can find each ECS field required for the output event
Expand Down Expand Up @@ -81,6 +82,7 @@ const (
ComputeResourceLabelZone = "resource.labels.zone"
GKEResourceLabelLocation = "resource.label.location"
StorageResourceLabelLocation = "resource.label.location"
CloudSQLResourceLabelRegion = "resource.labels.region"
)

// AlignersMapToGCP map contains available perSeriesAligner
Expand Down
13 changes: 13 additions & 0 deletions x-pack/metricbeat/module/gcp/metrics/metrics_requester.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -190,6 +190,19 @@ func (r *metricsRequester) getFilterForMetric(serviceName, m string) string {
regionsFilter := r.buildRegionsFilter(r.config.Regions, gcp.StorageResourceLabelLocation)
f = fmt.Sprintf("%s AND %s", f, regionsFilter)
}
case gcp.ServiceCloudSQL:
if r.config.Region != "" && len(r.config.Regions) != 0 {
r.logger.Warnf("when region %s and regions config parameters are both provided, use region", r.config.Region)
}

switch {
case r.config.Region != "":
region := strings.TrimSuffix(r.config.Region, "*")
f = fmt.Sprintf("%s AND %s = starts_with(\"%s\")", f, gcp.CloudSQLResourceLabelRegion, region)
case len(r.config.Regions) != 0:
regionsFilter := r.buildRegionsFilter(r.config.Regions, gcp.CloudSQLResourceLabelRegion)
f = fmt.Sprintf("%s AND %s", f, regionsFilter)
}
default:
if r.config.Region != "" && r.config.Zone != "" {
r.logger.Warnf("when region %s and zone %s config parameter "+
Expand Down