Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reference implementation: vertical query sharding #5342

Merged
merged 6 commits into from
Aug 1, 2022
Merged

Reference implementation: vertical query sharding #5342

merged 6 commits into from
Aug 1, 2022

Commits on Jul 22, 2022

  1. Update faillint to v1.10.0 

    Signed-off-by: Filip Petkovski <[email protected]>
    @fpetkovski
    fpetkovski committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    55483ab View commit details
    Browse the repository at this point in the history

  2. Implement query sharding 

    This commit implements query sharding for grouping PromQL expressions.

Sharding is initiated by analyzing the PromQL and extracting
grouping labels. Extracted labels are propagated down to Stores which
partition the response by hashmoding all series on those labels.

If a query is shardable, the partitioning and merging process will be
initiated by the Query Frontend. The Query Frontend will make N distinct
queries across a set of Queriers and merge the results back before
presenting them to the user.

Signed-off-by: Filip Petkovski <[email protected]>
    @fpetkovski
    fpetkovski committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    6587346 View commit details
    Browse the repository at this point in the history

  3. First code review pass 

    Signed-off-by: Filip Petkovski <[email protected]>
    @fpetkovski
    fpetkovski committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    2ec5aae View commit details
    Browse the repository at this point in the history

  4. Use sync pool to reuse sharding buffers 

    Signed-off-by: Filip Petkovski <[email protected]>
    @fpetkovski
    fpetkovski committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    bdc0923 View commit details
    Browse the repository at this point in the history

  5. Add test for binary expression with constant 

    Signed-off-by: Filip Petkovski <[email protected]>
    @fpetkovski
    fpetkovski committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    ffdb615 View commit details
    Browse the repository at this point in the history

  6. Include external labels in series sharding 

    Signed-off-by: Filip Petkovski <[email protected]>
    @fpetkovski
    fpetkovski committed Jul 22, 2022
    Configuration menu
    Copy the full SHA
    6d0489b View commit details
    Browse the repository at this point in the history