Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve stats convert performance for Binary/String/Boolean arrays #11319

Merged
merged 15 commits into from
Jul 8, 2024
Merged

Improve stats convert performance for Binary/String/Boolean arrays #11319

merged 15 commits into from
Jul 8, 2024
+130 −85

Commits on Jul 7, 2024

  1. add u64 poc.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    cb1cfad View commit details
    Browse the repository at this point in the history

  2. use env to support the quick bench.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    c67e21d View commit details
    Browse the repository at this point in the history

  3. use flatten in builder mode yet.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    fc1bf8c View commit details
    Browse the repository at this point in the history

  4. add new mode.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    4140eb0 View commit details
    Browse the repository at this point in the history

  5. use Builder in Utf8 and LargeUtf8 page level stats' convert.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    88e3957 View commit details
    Browse the repository at this point in the history

  6. use Builder in row group level stats.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    c09912f View commit details
    Browse the repository at this point in the history

  7. eliminate some unnecessary tmp Vecs.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    4a32df1 View commit details
    Browse the repository at this point in the history

  8. remove the quick modify in bench.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    4f419ca View commit details
    Browse the repository at this point in the history

  9. process the result return from append_value of FixedSizeBinaryBuilder.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    a0eb9cd View commit details
    Browse the repository at this point in the history

  10. remove the modification of FixedSizeBinary&Bool, and fix the String c… 

    …ase.
    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    c293be5 View commit details
    Browse the repository at this point in the history

  11. fix and re-enable the modification of FixedSizeBinary.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    441d6ab View commit details
    Browse the repository at this point in the history

  12. fix comments.

    @Rachelint
    Rachelint committed Jul 7, 2024
    Configuration menu
    Copy the full SHA
    a6d28d9 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. Merge branch 'main' into improve-page-stats-convert

    @Rachelint
    Rachelint committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    6a239d3 View commit details
    Browse the repository at this point in the history

  2. use BooleanBuilder to eliminate the collect in BooleanArray case.

    @Rachelint
    Rachelint committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    2e4c87b View commit details
    Browse the repository at this point in the history

  3. fix compile.

    @Rachelint
    Rachelint committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    651656a View commit details
    Browse the repository at this point in the history