forked from elastic/elasticsearch
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Paginate persisted cluster state (elastic#78875)
Today we allocate a contiguous chunk of memory for the global metadata each time we write it to disk. The size of this chunk is unbounded and in practice it can be pretty large. This commit splits the metadata document up into pages (1MB by default) that are streamed to disk at write time, bounding the memory usage of cluster state persistence. Since the memory usage is now bounded we can allocate a single buffer up front and re-use it for every write.
- Loading branch information
1 parent
86c9ced
commit 56a9b36
Showing
14 changed files
with
615 additions
and
530 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
137 changes: 0 additions & 137 deletions
137
server/src/main/java/org/elasticsearch/common/bytes/RecyclingBytesStreamOutput.java
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.