Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add recommendations options to mydumper #828

Merged
merged 3 commits into from
Aug 29, 2019

Conversation

weekface
Copy link
Contributor

What problem does this PR solve?

add recommendations options to mydumper:

https://pingcap.com/docs/v3.0/how-to/maintain/backup-and-restore/#best-practices-of-full-backup-and-restoration-using-mydumper-loader

  • -t 16: means 16 threads are used to export the data.
  • -F 64: means a table is partitioned into chunks and one chunk is 64MB.
  • --skip-tz-utc: the purpose of adding this parameter is to ignore the inconsistency of time zone setting between MySQL and the data exporting machine and to disable automatic conversion.

What is changed and how does it work?

Check List

Tests

Code changes

  • Has Helm charts change

Side effects

Related changes

  • Need to cherry-pick to the release branch

Does this PR introduce a user-facing change?:

add recommendations options to mydumper: `-t 16 -F 64 --skip-tz-utc`

@weekface
Copy link
Contributor Author

/run-e2e-in-kind

@weekface weekface force-pushed the refine-mydumper-options branch 2 times, most recently from ff42121 to 6baf0ad Compare August 27, 2019 02:44
@weekface
Copy link
Contributor Author

/run-e2e-in-kind

@@ -42,7 +42,7 @@ storage:
size: 100Gi

# backupOptions is the options of mydumper https://github.com/maxbube/mydumper/blob/master/docs/mydumper_usage.rst#options
backupOptions: "--verbose=3"
backupOptions: "-t 16 -F 256 --skip-tz-utc --verbose=3"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add simple descriptions for these default options.

  • -t is thread count, larger thread count will speed up the backup, but may impact the performance of the upstream TiDB.
  • -F is the chunk size, a big table is partitioned into many chunks.

Other useful options are -B for database, and -T for tables. See https://github.com/maxbube/mydumper/blob/master/docs/mydumper_usage.rst#options for more options.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

Copy link
Contributor

@aylei aylei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@weekface
Copy link
Contributor Author

/run-e2e-in-kind

Copy link
Contributor

@DanielZhangQD DanielZhangQD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tennix tennix merged commit 07ccb5b into pingcap:master Aug 29, 2019
@sre-bot
Copy link
Contributor

sre-bot commented Aug 29, 2019

cherry pick to release-1.0 in PR #844

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants