Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ENH] multipart S3 file uploads #2590

Merged
merged 10 commits into from
Aug 1, 2024
Merged

[ENH] multipart S3 file uploads #2590

merged 10 commits into from
Aug 1, 2024

Commits on Jul 30, 2024

  1. draft impl

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    5378576 View commit details
    Browse the repository at this point in the history

  2. More tests

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    5ec3be2 View commit details
    Browse the repository at this point in the history

  3. Make part size configurable, default to 8MB

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    e0872ca View commit details
    Browse the repository at this point in the history

  4. Use multipart upload for put_bytes

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    11f44fd View commit details
    Browse the repository at this point in the history

  5. Move part_size_bytes into config

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    8ab22c6 View commit details
    Browse the repository at this point in the history

  6. Update config

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    7fded1e View commit details
    Browse the repository at this point in the history

  7. Fix tests

    @codetheweb
    codetheweb committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    bd0e286 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. Avoid copy during part upload

    @codetheweb
    codetheweb committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    a38b817 View commit details
    Browse the repository at this point in the history

  2. Rename part_size_bytes -> upload_part_size_bytes

    @codetheweb
    codetheweb committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    adb5028 View commit details
    Browse the repository at this point in the history

  3. Use closure

    @codetheweb
    codetheweb committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    58a42fe View commit details
    Browse the repository at this point in the history