Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.12] sampling: use a data stream for sampled trace docs (#4707) #4820

Merged
merged 1 commit into from
Feb 19, 2021

Commits on Feb 19, 2021

  1. sampling: use a data stream for sampled trace docs (elastic#4707)

    * beater: add Managed and Namespace to ServerParams
    
    This enables x-pack/apm-server code to alter behaviour
    based on whether APM Server is managed or not, and to
    create data streams with the configured namespace.
    
    * sampling: use a data stream for sampled trace docs
    
    Update tail-based sampling to index into and search a
    data stream. The data stream will be associated with an
    ILM policy that takes care of rollover and deletion.
    
    When running in Fleet-managed mode, apm-server will expect
    the data stream and ILM policy to exist for the data stream
    called `traces-sampled-<namespace>`. Servers participating
    in tail-based sampling are required to be configured with
    the same namespace.
    
    When running in standalone mode, apm-server will attempt
    to create an index template and ILM policy for a data
    stream called `apm-sampled-traces`. This is added for
    minimal support while we transition things to Fleet, and
    is intended to be removed in a future release. The data
    stream is not intended to adhere to the standard indexing
    strategy.
    
    * apmpackage: add traces-sampled-* data stream
    
    Add a data stream for sampled trace documents,
    along with an ILM policy which rolls over after
    1h, and then deletes after 1h.
    
    * systemtest: fetch most recent beats monitoring doc
    
    When searching for beats monitoring docs, make sure
    we get the most recent one by sorting on 'timestamp'.
    
    * systemtest: update tail-based sampling test
    
    Update test to rely on apm-server to create its
    own data stream index template.
    
    * Cross-reference sampling/pubsub and apmpackage
    # Conflicts:
    #	changelogs/head.asciidoc
    #	systemtest/elasticsearch.go
    axw committed Feb 19, 2021
    Configuration menu
    Copy the full SHA
    3738a74 View commit details
    Browse the repository at this point in the history