Add _source
-only snapshot repository (#32844)
#33652
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This change adds a
_source
only snapshot repository that allows to wrapany existing repository as a backend to snapshot only the
_source
partincluding live docs markers. Snapshots taken with the
source
repositorywon't include any indices, doc-values or points. The snapshot will be reduced in size and
functionality such that it requires full re-indexing after it's successfully restored.
The restore process will copy the
_source
data locally starts a special shard and engineto allow
match_all
scrolls and searches. Any other query, or get call will fail with and unsupported operation exception. The restored index is also marked as read-only.This feature aims mainly for disaster recovery use-cases where snapshot size is
a concern or where time to restore is less of an issue.
NOTE: The snapshot produced by this repository is still a valid lucene index. This change doesn't allow for any longer retention policies which is out of scope for this change.