-
Notifications
You must be signed in to change notification settings - Fork 2.1k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Support throttling vstreamer copy table work on source tablets (#9923)
* Support throttling vstream work on source tablets This provides mechanisms to limit the impact of large vreplication workflows on production source tablets. It supports throttling based on the InnoDB history list length and the replication lag seen. Signed-off-by: Matt Lord <[email protected]> * Add unit and e2e test for copy table throttling Signed-off-by: Matt Lord <[email protected]> * Use shorter internal name for max replica lag seconds Signed-off-by: Matt Lord <[email protected]> * Use consistent case for json vars in config test Signed-off-by: Matt Lord <[email protected]> * Add MySQL specific context to flags Signed-off-by: Matt Lord <[email protected]> * Add copy table row streamer stats Signed-off-by: Matt Lord <[email protected]> * Rearrange things to wait for MySQL in initial row stream and copy phase cycles Signed-off-by: Matt Lord <[email protected]> * Correct & improve on e2e and unit tests Signed-off-by: Matt Lord <[email protected]> * Update test config I spent way too much time trying to get both tests to work within the same go test run... giving up for now. Signed-off-by: Matt Lord <[email protected]> * Adding additional stats work Signed-off-by: Matt Lord <[email protected]> * Add ability to modify the RowStreamerConfig at runtime via /debug/env Signed-off-by: Matt Lord <[email protected]> * Add current RowStreamerConfig values to /debug/vars Signed-off-by: Matt Lord <[email protected]> * Add waitingForMySQL stats to vreplication phase timings Signed-off-by: Matt Lord <[email protected]> * Track waitForMySQL by table on vstreamer side Signed-off-by: Matt Lord <[email protected]> * Move row streamer config export to vstreamer engine And make it a gauge so that it's always showing the current value as we allow this to be changed in the running process via /debug/env. Signed-off-by: Matt Lord <[email protected]> * Minor changes after self review Signed-off-by: Matt Lord <[email protected]> * Shorten/generalize InnoDB row history test func names Signed-off-by: Matt Lord <[email protected]>
- Loading branch information
Showing
16 changed files
with
441 additions
and
15 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.