Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose some Parquet per-column configuration options via the python API #15613

Merged
merged 47 commits into from
May 22, 2024
Merged

Expose some Parquet per-column configuration options via the python API #15613

merged 47 commits into from
May 22, 2024

Commits on Apr 25, 2024

  1. round trip fixed_len_byte_array data properly

    @etseidl
    etseidl committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    9bb6c6a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-24.06' into fixed_len_rou… 

    …ndtrip
    @etseidl
    etseidl committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    3a3ea7b View commit details
    Browse the repository at this point in the history

  3. address review comments

    @etseidl
    etseidl committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b475084 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. checkpoint metadata paths

    @etseidl
    etseidl committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    ad45ee1 View commit details
    Browse the repository at this point in the history

  2. add some column_in_metadata methods

    @etseidl
    etseidl committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    101ea2d View commit details
    Browse the repository at this point in the history

  3. finish first cut at new options

    @etseidl
    etseidl committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    a774553 View commit details
    Browse the repository at this point in the history

  4. add doc stubs

    @etseidl
    etseidl committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    92a1fe0 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. Merge branch 'rapidsai:branch-24.06' into python_metadata

    @etseidl
    etseidl authored Apr 27, 2024
    Configuration menu
    Copy the full SHA
    79f5008 View commit details
    Browse the repository at this point in the history

  2. clean up docs and change skip_compression to a set

    @etseidl
    etseidl committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    1974f12 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. do not build full_path if it is not needed

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    f43dae2 View commit details
    Browse the repository at this point in the history

  2. formatting

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    1a44944 View commit details
    Browse the repository at this point in the history

  3. skip setting element names too

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    4c4b224 View commit details
    Browse the repository at this point in the history

  4. add test that uses new option

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    cee8c9c View commit details
    Browse the repository at this point in the history

  5. add output_as_binary as separate option

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    4ad48cd View commit details
    Browse the repository at this point in the history

  6. add to documentation of column_type_length

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    ee9f414 View commit details
    Browse the repository at this point in the history

  7. flesh out documentation

    @etseidl
    etseidl committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    c75b301 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'rapidsai:branch-24.06' into fixed_len_roundtrip

    @etseidl
    etseidl authored Apr 29, 2024
    Configuration menu
    Copy the full SHA
    eae6b04 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. add test for encoding and compression override

    @etseidl
    etseidl committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    4c9b8a4 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    aebd86f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-24.06' into fixed_len_roundtrip

    @etseidl
    etseidl authored Apr 30, 2024
    Configuration menu
    Copy the full SHA
    79a93c3 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Merge branch 'rapidsai:branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 2, 2024
    Configuration menu
    Copy the full SHA
    d7b23ab View commit details
    Browse the repository at this point in the history

  2. Merge branch 'rapidsai:branch-24.06' into fixed_len_roundtrip

    @etseidl
    etseidl authored May 2, 2024
    Configuration menu
    Copy the full SHA
    e41cd04 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Merge branch 'branch-24.06' into fixed_len_roundtrip

    @etseidl
    etseidl authored May 3, 2024
    Configuration menu
    Copy the full SHA
    7934e31 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 3, 2024
    Configuration menu
    Copy the full SHA
    48d5de6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-24.06' into fixed_len_roundtrip

    @vuule
    vuule authored May 3, 2024
    Configuration menu
    Copy the full SHA
    64dc418 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'github/fixed_len_roundtrip' into python… 

    …_metadata
    @etseidl
    etseidl committed May 3, 2024
    Configuration menu
    Copy the full SHA
    60e4e0a View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 7, 2024
    Configuration menu
    Copy the full SHA
    2a79298 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 8, 2024
    Configuration menu
    Copy the full SHA
    fba79f5 View commit details
    Browse the repository at this point in the history

  2. remove todo

    @etseidl
    etseidl committed May 8, 2024
    Configuration menu
    Copy the full SHA
    bed11f2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 8, 2024
    Configuration menu
    Copy the full SHA
    6e36578 View commit details
    Browse the repository at this point in the history

  4. add USE_DEFAULT and remove non-parquet encodings from _get_encoding_t… 

    …ype()
    @etseidl
    etseidl committed May 8, 2024
    Configuration menu
    Copy the full SHA
    df4a593 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'branch-24.06' into python_metadata

    @vuule
    vuule authored May 8, 2024
    Configuration menu
    Copy the full SHA
    9cc159e View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Merge branch 'rapidsai:branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 9, 2024
    Configuration menu
    Copy the full SHA
    05d8194 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 10, 2024
    Configuration menu
    Copy the full SHA
    782e4ff View commit details
    Browse the repository at this point in the history

  2. check that the other column is compressed

    @etseidl
    etseidl committed May 10, 2024
    Configuration menu
    Copy the full SHA
    0a316df View commit details
    Browse the repository at this point in the history

  3. update docs to include USE_DEFAULT

    @etseidl
    etseidl committed May 10, 2024
    Configuration menu
    Copy the full SHA
    a273c43 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 11, 2024
    Configuration menu
    Copy the full SHA
    30d9eb3 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 13, 2024
    Configuration menu
    Copy the full SHA
    e188af2 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Merge branch 'branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 14, 2024
    Configuration menu
    Copy the full SHA
    3d30b4d View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 14, 2024
    Configuration menu
    Copy the full SHA
    b53933b View commit details
    Browse the repository at this point in the history

  3. change enum to PEP 435 style

    @etseidl
    etseidl committed May 14, 2024
    Configuration menu
    Copy the full SHA
    f0183ff View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Merge branch 'branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 15, 2024
    Configuration menu
    Copy the full SHA
    78100f4 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'branch-24.06' into python_metadata

    @vuule
    vuule authored May 16, 2024
    Configuration menu
    Copy the full SHA
    bc06472 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Merge branch 'rapidsai:branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 20, 2024
    Configuration menu
    Copy the full SHA
    1348779 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'branch-24.06' into python_metadata

    @etseidl
    etseidl authored May 20, 2024
    Configuration menu
    Copy the full SHA
    c797b56 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Merge remote-tracking branch 'origin/branch-24.06' into python_metadata

    @etseidl
    etseidl committed May 21, 2024
    Configuration menu
    Copy the full SHA
    39023c5 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Merge branch 'branch-24.06' into python_metadata

    @galipremsagar
    galipremsagar authored May 22, 2024
    Configuration menu
    Copy the full SHA
    bd99301 View commit details
    Browse the repository at this point in the history