Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

checker(dm): move checker from tidb-tools to dm #3770

Merged
merged 15 commits into from
Dec 9, 2021

Conversation

okJiang
Copy link
Member

@okJiang okJiang commented Dec 7, 2021

What problem does this PR solve?

close https://github.com/pingcap/ticdc/issues/3768

What is changed and how it works?

Check List

Tests

  • Unit test
  • Integration test

Release note

None

…p-master

Conflicts:
	.github/workflows/dm_binlog_999999.yaml
	.github/workflows/dm_chaos.yaml
	.github/workflows/dm_upstream_switch.yaml
	.github/workflows/ticdc_chaos.yaml
	.github/workflows/ticdc_integration.yaml
	.github/workflows/upgrade_dm_via_tiup.yaml
@ti-chi-bot
Copy link
Member

ti-chi-bot commented Dec 7, 2021

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • Ehco1996
  • GMHDBJD

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@ti-chi-bot ti-chi-bot added release-note-none Denotes a PR that doesn't merit a release note. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. labels Dec 7, 2021
@lance6716 lance6716 added the area/dm Issues or PRs related to DM. label Dec 7, 2021
Copy link
Contributor

@lance6716 lance6716 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you explain what's the modification you made to get this PR? it's a bit long to review 😵

},
"mariadb": {
MySQLVersion{10, 1, 2},
MaxVersion,
Copy link
Contributor

@lance6716 lance6716 Dec 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I remember that newer MariaDB doesn't fit DM well. maybe we should be more strict about the version and this check could raise warning not error?

cc @sunzhaoyang

https://github.com/pingcap/dm/issues/2266

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MariaDB seems to have a very different permission limit than MySQL, I wonder if we can not report MariaDB error.

Or we could just not support MariaDB in pre-check until we sorted out a better MariaDB support scheme.

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

could you explain what's the modification you made to get this PR? it's a bit long to review 😵

No modification for the checker. Just move it. @lance6716

So I think the IT passed is enough to merge.

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/run-verify

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/run-dm-compatibility-test
/run-dm-integration-test

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/run-leak-test

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/run-dm-compatibility-test
/run-dm-integration-test
/run-integration-test
/run-kafka-integration-test

@okJiang okJiang added the status/ptal Could you please take a look? label Dec 8, 2021
@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/cc @lance6716 @Ehco1996 @glorv

Copy link
Contributor

@Ehco1996 Ehco1996 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this too large too review 😂 but if you just copy code from tidb/tidb-tools i think this pr is ready to merge becase CI passed

// See the License for the specific language governing permissions and
// limitations under the License.

package checker
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe move this package to ticdc/pkg/checker or ticdc/dm/pkg/ ? https://github.com/golang-standards/project-layout#pkg

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/run-dm-compatibility-test
/run-dm-integration-test
/run-integration-test
/run-kafka-integration-test

@codecov-commenter
Copy link

codecov-commenter commented Dec 8, 2021

Codecov Report

Merging #3770 (d7b1875) into master (eed6f9b) will increase coverage by 0.2279%.
The diff coverage is 59.8099%.

Flag Coverage Δ
cdc 59.2884% <79.4793%> (+0.8512%) ⬆️
dm 56.0591% <44.1463%> (-0.3161%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

@@               Coverage Diff                @@
##             master      #3770        +/-   ##
================================================
+ Coverage   57.3452%   57.5731%   +0.2279%     
================================================
  Files           460        472        +12     
  Lines         54927      56113      +1186     
================================================
+ Hits          31498      32306       +808     
- Misses        20180      20524       +344     
- Partials       3249       3283        +34     

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

/run-kafka-integration-test
/run-verify

@okJiang
Copy link
Member Author

okJiang commented Dec 8, 2021

The CI passed all. ptal again, thank you❤️ @Ehco1996 @lance6716

@ti-chi-bot ti-chi-bot added the status/LGT1 Indicates that a PR has LGTM 1. label Dec 8, 2021
Copy link
Contributor

@GMHDBJD GMHDBJD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-chi-bot ti-chi-bot added status/LGT2 Indicates that a PR has LGTM 2. and removed status/LGT1 Indicates that a PR has LGTM 1. labels Dec 9, 2021
@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-dm-compatibility-test
/run-dm-integration-test
/run-integration-test
/run-kafka-integration-test

@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-dm-integration-test
/run-integration-test
/run-kafka-integration-test

@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-dm-integration-test

2 similar comments
@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-dm-integration-test

@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-dm-integration-test

@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/merge

@ti-chi-bot
Copy link
Member

@okJiang: /merge is only allowed for the committers, you can assign this pull request to the committer in list by filling /assign @committer in the comment to help merge this pull request.

In response to this:

/merge

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

@lance6716
Copy link
Contributor

/merge

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: d7b1875

@ti-chi-bot ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Dec 9, 2021
@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-dm-compatibility-test
/run-dm-integration-test
/run-integration-test
/run-kafka-integration-test

@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-integration-test
/run-leak-test

@okJiang
Copy link
Member Author

okJiang commented Dec 9, 2021

/run-integration-test

@ti-chi-bot ti-chi-bot merged commit 9110fe0 into pingcap:master Dec 9, 2021
@okJiang okJiang deleted the pre-check-00 branch December 9, 2021 08:20
zhaoxinyu pushed a commit to zhaoxinyu/ticdc that referenced this pull request Dec 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/dm Issues or PRs related to DM. release-note-none Denotes a PR that doesn't merit a release note. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2. status/ptal Could you please take a look?
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Move checker from tidb-tools to dm
6 participants