Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Snapshot V2] Support pinned timestamp in delete flow #15256

Merged
merged 67 commits into from
Sep 4, 2024
Merged

[Snapshot V2] Support pinned timestamp in delete flow #15256

merged 67 commits into from
Sep 4, 2024

Commits on Aug 6, 2024

  1. Initial Commit to support centralize snapshot creation and implicit l… 

    …ocking mechanism

Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    9142a25 View commit details
    Browse the repository at this point in the history

  2. Fix deserilization error 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d9bbc65 View commit details
    Browse the repository at this point in the history

  3. Fix gradle spotless check 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    f72702f View commit details
    Browse the repository at this point in the history

  4. Fix listener 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    8e85231 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Merge branch 'main' into snapshot-pinned-timestamp

    Anshu Agarwal committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    8a507ad View commit details
    Browse the repository at this point in the history

  2. Fix test 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    2d404e8 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Fix snapshot generation 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    90c860c View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Modify cluster setting name 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    193da65 View commit details
    Browse the repository at this point in the history

  2. Add more tests 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    fe2aaaf View commit details
    Browse the repository at this point in the history

  3. Snapshot V2 delete changes 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    afcc37a View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. Merge branch 'main' into snapshot-pinned-timestamp

    Anshu Agarwal committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    14c08ae View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Merge branch 'main' into snapshot-pinned-timestamp

    Anshu Agarwal committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    ec17028 View commit details
    Browse the repository at this point in the history

  2. Uncomment pin timestamp code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    6504169 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'snapshot-pinned-timestamp' into snapshot-pinned-timesta… 

    …mp-delete
    Anshu Agarwal committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    ebfb9d9 View commit details
    Browse the repository at this point in the history

  4. Add code to unpin timestamp on deletion 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    c91f1b5 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Modify log messages 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    626c2fa View commit details
    Browse the repository at this point in the history

  2. Add spotless check failure fix 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    be65f6d View commit details
    Browse the repository at this point in the history

  3. Fix completion listener for snapshot v2 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    62452ee View commit details
    Browse the repository at this point in the history

  4. Elevate cluster state update priority for repository metadata update … 

    …task

Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    00031ec View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Add test for missing snapshot 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    a59e980 View commit details
    Browse the repository at this point in the history

  2. Add more integ tests 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    0c636ef View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. Add priority as IMMEDIATE for cluster state repo update task only for… 

    … v2 snapshots

Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    623f994 View commit details
    Browse the repository at this point in the history

  2. Fix build error 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    2e4795b View commit details
    Browse the repository at this point in the history

  3. Fix spotless error 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    a6090a7 View commit details
    Browse the repository at this point in the history

  4. Add repository setting for snapshot v2 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    b5d012f View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into snapshot-pinned-timestamp

    Anshu Agarwal committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    1394d8c View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into snapshot-pinned-timestamp-delete

    Anshu Agarwal committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    0b1a52e View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Add integ test on multiple snapshots deletion in one delete request 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    51c1cdf View commit details
    Browse the repository at this point in the history

  2. Address review comments 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    80bf6cc View commit details
    Browse the repository at this point in the history

  3. Add integ test to verify snapshot creation if shallow copy repo setti… 

    …ng is disabled

Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    b0cbc08 View commit details
    Browse the repository at this point in the history

  4. Fix spotless vilation error 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    38af0f6 View commit details
    Browse the repository at this point in the history

  5. Address review comment 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    73376a8 View commit details
    Browse the repository at this point in the history

  6. Address review comments 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    39b57e3 View commit details
    Browse the repository at this point in the history

  7. Add min version check for backward compatibility 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    e1eecbd View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Merge branch 'snapshot-pinned-timestamp' into snapshot-pinned-timesta… 

    …mp-delete
    Anshu Agarwal committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    e986243 View commit details
    Browse the repository at this point in the history

  2. Move integ tests to DeleteSnapshotIT 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    ea71855 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge branch 'main' into snapshot-pinned-timestamp-delete

    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    9694dec View commit details
    Browse the repository at this point in the history

  2. Refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    14e7539 View commit details
    Browse the repository at this point in the history

  3. refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f4b4122 View commit details
    Browse the repository at this point in the history

  4. refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    cb03f59 View commit details
    Browse the repository at this point in the history

  5. fix tests 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    1f966fd View commit details
    Browse the repository at this point in the history

  6. fix build failure 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    b97707a View commit details
    Browse the repository at this point in the history

  7. Refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    a94642c View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Add support to cleanup remote store segments for deleted index 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    27f7554 View commit details
    Browse the repository at this point in the history

  2. refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    f1adb8e View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    32ed74f View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Merge branch 'main' into snapshot-pinned-timestamp-delete

    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    2221437 View commit details
    Browse the repository at this point in the history

  2. Fix tests 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    4998174 View commit details
    Browse the repository at this point in the history

  3. remove pinned timestamp after updating repository data 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    52573e0 View commit details
    Browse the repository at this point in the history

  4. refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    6d5fd21 View commit details
    Browse the repository at this point in the history

  5. Add tests for deleted index cleanup 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    e36786a View commit details
    Browse the repository at this point in the history

  6. Address review comments 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    2b987b0 View commit details
    Browse the repository at this point in the history

  7. Refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    4b7376b View commit details
    Browse the repository at this point in the history

  8. modify java doc 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    5fa4237 View commit details
    Browse the repository at this point in the history

  9. fix test 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    88c3be8 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. modify integ test for deleted index 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    8db5790 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into snapshot-pinned-timestamp-delete 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    1f49456 View commit details
    Browse the repository at this point in the history

  3. remove merge conflict 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    3fca63c View commit details
    Browse the repository at this point in the history

  4. Add cleanup for deleted index if there are snapshots referencing it 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    f7e2609 View commit details
    Browse the repository at this point in the history

  5. fix integ test 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    d075b6b View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into snapshot-pinned-timestamp-delete 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    f621384 View commit details
    Browse the repository at this point in the history

  7. fix spotless failure 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    de457b6 View commit details
    Browse the repository at this point in the history

  8. address review comments 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    1f38f23 View commit details
    Browse the repository at this point in the history

  9. address review comments 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    8fe6a24 View commit details
    Browse the repository at this point in the history

  10. refactor code 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    5b33e85 View commit details
    Browse the repository at this point in the history

  11. fix precommit failure 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    54bee31 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' into snapshot-pinned-timestamp-delete 

    Signed-off-by: Anshu Agarwal <[email protected]>
    Anshu Agarwal committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c5ef40f View commit details
    Browse the repository at this point in the history