[7.12] sampling: use a data stream for sampled trace docs (#4707) #4820
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* beater: add Managed and Namespace to ServerParams This enables x-pack/apm-server code to alter behaviour based on whether APM Server is managed or not, and to create data streams with the configured namespace. * sampling: use a data stream for sampled trace docs Update tail-based sampling to index into and search a data stream. The data stream will be associated with an ILM policy that takes care of rollover and deletion. When running in Fleet-managed mode, apm-server will expect the data stream and ILM policy to exist for the data stream called `traces-sampled-<namespace>`. Servers participating in tail-based sampling are required to be configured with the same namespace. When running in standalone mode, apm-server will attempt to create an index template and ILM policy for a data stream called `apm-sampled-traces`. This is added for minimal support while we transition things to Fleet, and is intended to be removed in a future release. The data stream is not intended to adhere to the standard indexing strategy. * apmpackage: add traces-sampled-* data stream Add a data stream for sampled trace documents, along with an ILM policy which rolls over after 1h, and then deletes after 1h. * systemtest: fetch most recent beats monitoring doc When searching for beats monitoring docs, make sure we get the most recent one by sorting on 'timestamp'. * systemtest: update tail-based sampling test Update test to rely on apm-server to create its own data stream index template. * Cross-reference sampling/pubsub and apmpackage # Conflicts: # changelogs/head.asciidoc # systemtest/elasticsearch.go
💚 Build Succeeded
Expand to view the summary
Build stats
Test stats 🧪
Trends 🧪Steps errors
Expand to view the steps failures
|
|
jenkins run the tests please |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Backports the following commits to 7.12: