Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Perform S3 directory deletion with batch requests #13974

Merged
merged 6 commits into from
Dec 9, 2022
Merged

Perform S3 directory deletion with batch requests #13974

merged 6 commits into from
Dec 9, 2022

Commits on Dec 1, 2022

  1. Test S3 path deletion

    @findinpath
    findinpath committed Dec 1, 2022
    Configuration menu
    Copy the full SHA
    9208595 View commit details
    Browse the repository at this point in the history

  2. Extract listObjects logic to a separate method

    @findinpath
    findinpath committed Dec 1, 2022
    Configuration menu
    Copy the full SHA
    3a9708c View commit details
    Browse the repository at this point in the history

  3. Perform S3 directory deletion with batch requests 

    Delete all the objects which are found under the specified path
prefix in batches in order to improve the performance of
the operation.

This operation is customised for the needs of Trino and does
intentionally not intend to add unnecessary complexity
for dealing with the various quirks of s3 compatible object
storage systems that are not relevant for the use cases of Trino.
    @findinpath
    findinpath committed Dec 1, 2022
    Configuration menu
    Copy the full SHA
    9cabfc0 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2022

  1. empty

    @findepi
    findepi committed Dec 5, 2022
    Configuration menu
    Copy the full SHA
    ba2d0b6 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2022

  1. empty

    @findinpath
    findinpath committed Dec 6, 2022
    Configuration menu
    Copy the full SHA
    52e69aa View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2022

  1. empty

    @findinpath
    findinpath committed Dec 7, 2022
    Configuration menu
    Copy the full SHA
    62a4412 View commit details
    Browse the repository at this point in the history