Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(storage/dataflux): run worksteal listing parallel to sequential listing #10966

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open

feat(storage/dataflux): run worksteal listing parallel to sequential listing #10966

wants to merge 28 commits into from
+549 −88

Commits on Sep 30, 2024

  1. test case for fast-list

    @akansha1812
    akansha1812 committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    3ab3831 View commit details
    Browse the repository at this point in the history

  2. resolve comments

    @akansha1812
    akansha1812 committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    559ae40 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. add object_lister and worksteal to fast_list

    @akansha1812
    akansha1812 committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    1cdc956 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'googleapis:main' into main

    @akansha1812
    akansha1812 authored Oct 7, 2024
    Configuration menu
    Copy the full SHA
    7eb0471 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. add unit tests with emulator

    @akansha1812
    akansha1812 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    1f05177 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'googleapis:main' into main

    @akansha1812
    akansha1812 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    05b1515 View commit details
    Browse the repository at this point in the history

  3. resolve PR errors

    @akansha1812
    akansha1812 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    5bed09c View commit details
    Browse the repository at this point in the history

  4. reduce numobjects to resolve timeout error

    @akansha1812
    akansha1812 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    80054bf View commit details
    Browse the repository at this point in the history

  5. reduce objects created for timeout error

    @akansha1812
    akansha1812 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e33adf5 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. remove env variables for grpc and http

    @akansha1812
    akansha1812 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    b1b69b9 View commit details
    Browse the repository at this point in the history

  2. run dataflux emulator tests

    @akansha1812
    akansha1812 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    c2e56f8 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Merge branch 'main' into main

    @akansha1812
    akansha1812 authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    c78aaba View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Merge branch 'main' into main

    @akansha1812
    akansha1812 authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b714222 View commit details
    Browse the repository at this point in the history

  2. resolve comments

    @akansha1812
    akansha1812 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    4028cb6 View commit details
    Browse the repository at this point in the history

  3. update ranges to nil when sequential listing is faster

    @akansha1812
    akansha1812 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    4851cc8 View commit details
    Browse the repository at this point in the history

  4. default page size for seq listing is 5000

    @akansha1812
    akansha1812 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    0d494e0 View commit details
    Browse the repository at this point in the history

  5. remove version enabled from TestDoSeqListingEmulated

    @akansha1812
    akansha1812 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    722e961 View commit details
    Browse the repository at this point in the history

  6. increase emulator time

    @akansha1812
    akansha1812 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    f3c1571 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. make next_page more readable

    @akansha1812
    akansha1812 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    db1a757 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into main

    @akansha1812
    akansha1812 authored Oct 22, 2024
    Configuration menu
    Copy the full SHA
    56ab509 View commit details
    Browse the repository at this point in the history

  3. to resolve race conditions

    @akansha1812
    akansha1812 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    2b72b0e View commit details
    Browse the repository at this point in the history

  4. rename goroutineID to id

    @akansha1812
    akansha1812 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    692e74e View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Merge branch 'main' into main

    @akansha1812
    akansha1812 authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    a6cb0f4 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. move counter from beginning of the loop

    @akansha1812
    akansha1812 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    1998873 View commit details
    Browse the repository at this point in the history

  2. add mutex to error counter

    @akansha1812
    akansha1812 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    7583e16 View commit details
    Browse the repository at this point in the history

  3. emulator test for error counter and remove worker to track error from… 

    … all workers as it can nott be reached
    @akansha1812
    akansha1812 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    4b1dcf0 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into main

    @akansha1812
    akansha1812 authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    34f0840 View commit details
    Browse the repository at this point in the history

  5. test emulator error

    @akansha1812
    akansha1812 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    564bbd3 View commit details
    Browse the repository at this point in the history