Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Remote Store] Change of behaviour in replica recovery for remote translog enabled indices #4527

Closed
Tracked by #5671
ashking94 opened this issue Sep 15, 2022 · 0 comments
Labels
distributed framework enhancement Enhancement or improvement to existing feature or request Storage:Durability Issues and PRs related to the durability framework v2.5.0 'Issues and PRs related to version v2.5.0'

Comments

@ashking94
Copy link
Member

ashking94 commented Sep 15, 2022

Is your feature request related to a problem? Please describe.
During the current replica recovery process, the high level flow goes like this -
image
and then
image

With the existing recovery mechanism, we rely on both the segments and the translog for deciding the sequence number upto which the replica already has got the data. This is also the seq no that is sent across transport service to the primary for starting the recovery process.

Now, with remote translog, the translog will not be stored on replicas any more for durability and that also necessitates the need for changing the recovery process to not account for translog anymore on replicas.

Describe the solution you'd like
image
Since underlying replication is segment replication, the segment files would be present and that would be used to start the recovery process from the max seq no in the last committed segment infos.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

@ashking94 ashking94 added enhancement Enhancement or improvement to existing feature or request untriaged labels Sep 15, 2022
@ashking94 ashking94 changed the title Change of behaviour in replica recovery for remote translog enabled indices [Remote Store] Change of behaviour in replica recovery for remote translog enabled indices Sep 15, 2022
@ashking94 ashking94 added Storage:Durability Issues and PRs related to the durability framework v2.5.0 'Issues and PRs related to version v2.5.0' labels Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
distributed framework enhancement Enhancement or improvement to existing feature or request Storage:Durability Issues and PRs related to the durability framework v2.5.0 'Issues and PRs related to version v2.5.0'
Projects
None yet
Development

No branches or pull requests

2 participants