Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add DELTA_BINARY_PACKED encoder for Parquet writer #14100

Merged
merged 62 commits into from
Oct 20, 2023
Merged

Add DELTA_BINARY_PACKED encoder for Parquet writer #14100

merged 62 commits into from
Oct 20, 2023

Commits on Sep 13, 2023

  1. add DELTA_BINARY_PACKED encoder

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    91f7943 View commit details
    Browse the repository at this point in the history

  2. clean up some consts and change kernel mask to enum class

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    478f8ac View commit details
    Browse the repository at this point in the history

  3. more cleanup

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    cd4df51 View commit details
    Browse the repository at this point in the history

  4. remove some FIXMEs

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    2e33420 View commit details
    Browse the repository at this point in the history

  5. change FIXME to TODO for TS scaling

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    0bd64c8 View commit details
    Browse the repository at this point in the history

  6. use switch rather than if/else block

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    fffc659 View commit details
    Browse the repository at this point in the history

  7. get rid of some magic numbers

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    a98b338 View commit details
    Browse the repository at this point in the history

  8. replace operator overload with templated function

    @etseidl
    etseidl committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    9d1b2f2 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 13, 2023
    Configuration menu
    Copy the full SHA
    dc14171 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Merge branch 'rapidsai:branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 14, 2023
    Configuration menu
    Copy the full SHA
    39b498c View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. redo typing of the delta bit packer

    @etseidl
    etseidl committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    ea6f3c0 View commit details
    Browse the repository at this point in the history

  2. add const

    @etseidl
    etseidl committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    2d41d3a View commit details
    Browse the repository at this point in the history

  3. add test for delta binary writer

    @etseidl
    etseidl committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    1d94621 View commit details
    Browse the repository at this point in the history

  4. remove unsupported types from delta test

    @etseidl
    etseidl committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    4e2c4a5 View commit details
    Browse the repository at this point in the history

  5. make second column unordered

    @etseidl
    etseidl committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    b3b25de View commit details
    Browse the repository at this point in the history

  6. Merge branch 'rapidsai:branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 15, 2023
    Configuration menu
    Copy the full SHA
    ce5378f View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. remove leftover experiment

    @etseidl
    etseidl committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    00b248f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'encode_delta_binary' of github.com:etseidl/cudf into en… 

    …code_delta_binary
    @etseidl
    etseidl committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    1c75898 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.10' into encode_delta_binary

    @PointKernel
    PointKernel authored Sep 18, 2023
    Configuration menu
    Copy the full SHA
    dd526fa View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Merge branch 'branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 20, 2023
    Configuration menu
    Copy the full SHA
    4c54ff6 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. change put_zz128 to void

    @etseidl
    etseidl committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    8b95a78 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 21, 2023
    Configuration menu
    Copy the full SHA
    24ca047 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Merge branch 'rapidsai:branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 27, 2023
    Configuration menu
    Copy the full SHA
    727762d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Sep 27, 2023
    Configuration menu
    Copy the full SHA
    9d2aa84 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Sep 27, 2023
    Configuration menu
    Copy the full SHA
    71b8eca View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Merge branch 'rapidsai:branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 28, 2023
    Configuration menu
    Copy the full SHA
    5647bb2 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-23.12' into encode_delta_… 

    …binary
    @etseidl
    etseidl committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    f1b8314 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'rapidsai:branch-23.10' into encode_delta_binary

    @etseidl
    etseidl authored Sep 28, 2023
    Configuration menu
    Copy the full SHA
    4ad772c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-23.12' into encode_delta_binary

    @vuule
    vuule authored Sep 28, 2023
    Configuration menu
    Copy the full SHA
    1c22317 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. fix typo 

    Co-authored-by: Vukasin Milovanovic <[email protected]>
    @etseidl @vuule
    etseidl and vuule authored Sep 29, 2023
    Configuration menu
    Copy the full SHA
    0150236 View commit details
    Browse the repository at this point in the history

  2. another typo 

    Co-authored-by: Vukasin Milovanovic <[email protected]>
    @etseidl @vuule
    etseidl and vuule authored Sep 29, 2023
    Configuration menu
    Copy the full SHA
    6477543 View commit details
    Browse the repository at this point in the history

  3. implement suggestions from review

    @etseidl
    etseidl committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    60df88e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Sep 29, 2023
    Configuration menu
    Copy the full SHA
    ac29dac View commit details
    Browse the repository at this point in the history

  5. use template foo to get a single BitAnd

    @etseidl
    etseidl committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    e6cc71e View commit details
    Browse the repository at this point in the history

  6. remove TODO

    @etseidl
    etseidl committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    7fff8f0 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Sep 29, 2023
    Configuration menu
    Copy the full SHA
    4eee6a0 View commit details
    Browse the repository at this point in the history

  8. add an ifdef around is_scoped_enum

    @etseidl
    etseidl committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    8a20836 View commit details
    Browse the repository at this point in the history

  9. avoid UB when calculating deltas

    @etseidl
    etseidl committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    cf1289b View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2023

  1. remove unnecessary sync

    @etseidl
    etseidl committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    068a017 View commit details
    Browse the repository at this point in the history

  2. lost some constants somewhere

    @etseidl
    etseidl committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    6be661e View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. address some review comments

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    bd19be0 View commit details
    Browse the repository at this point in the history

  2. reduce register pressure a bit

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    84f02a7 View commit details
    Browse the repository at this point in the history

  3. add some comments and sanity checks

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    806bca2 View commit details
    Browse the repository at this point in the history

  4. add test with sliced table

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    ffe2d90 View commit details
    Browse the repository at this point in the history

  5. make comment match reality

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    4f47bdd View commit details
    Browse the repository at this point in the history

  6. remove some template declarations

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    c60a4a9 View commit details
    Browse the repository at this point in the history

  7. implement suggestion from review 

    Co-authored-by: Vukasin Milovanovic <[email protected]>
    @etseidl @vuule
    etseidl and vuule authored Oct 2, 2023
    Configuration menu
    Copy the full SHA
    9049b7d View commit details
    Browse the repository at this point in the history

  8. Merge branch 'encode_delta_binary' of github.com:etseidl/cudf into en… 

    …code_delta_binary
    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a29b70b View commit details
    Browse the repository at this point in the history

  9. remove another template param

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    2a9d5d9 View commit details
    Browse the repository at this point in the history

  10. replace encoder struct with function

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    8604b53 View commit details
    Browse the repository at this point in the history

  11. add sliced list test

    @etseidl
    etseidl committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    307017a View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Merge remote-tracking branch 'origin/branch-23.12' into encode_delta_… 

    …binary
    @etseidl
    etseidl committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    dbbc58d View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Merge remote-tracking branch 'origin/branch-23.12' into encode_delta_… 

    …binary
    @etseidl
    etseidl committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    24ca06d View commit details
    Browse the repository at this point in the history

  2. finish merge

    @etseidl
    etseidl committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    3db131b View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. Merge branch 'rapidsai:branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    057dc00 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-23.12' into encode_delta_… 

    …binary
    @etseidl
    etseidl committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    d766012 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. Merge branch 'branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Oct 11, 2023
    Configuration menu
    Copy the full SHA
    44ec4ff View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Merge branch 'rapidsai:branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Oct 16, 2023
    Configuration menu
    Copy the full SHA
    28ed028 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Merge remote-tracking branch 'origin/branch-23.12' into encode_delta_… 

    …binary
    @etseidl
    etseidl committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    0bc8169 View commit details
    Browse the repository at this point in the history

  2. clean ups suggested in review

    @etseidl
    etseidl committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    5db6312 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. get rid of TODO

    @etseidl
    etseidl committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    c1445ed View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-23.12' into encode_delta_binary

    @etseidl
    etseidl authored Oct 19, 2023
    Configuration menu
    Copy the full SHA
    fab105a View commit details
    Browse the repository at this point in the history