Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] mysql-cdc动态加表 全量同步完成后不增量(在数据量超1000万的情况下) #2421

Closed
1 of 2 tasks
13011006997 opened this issue Aug 22, 2023 · 0 comments · Fixed by #2482
Closed
1 of 2 tasks
Assignees
Labels
bug Something isn't working

Comments

@13011006997
Copy link

Search before asking

  • I searched in the issues and found nothing similar.

Flink version

1.16.0和1.17.0

Flink CDC version

2.4.0和2.4.1

Database and its version

5.6.16-log

Minimal reproduce step

动态加表scanNewlyAddedTableEnabled(true)
A表1000万数据同步完成后可以增量执行
动态新增加B表 后 两个表 全量同步完成后 不增量同步

如果把A表降到百万级别的就不会出现这种现象

What did you expect to see?

千万级别 动态加表后 全量同步完成后 能增量同步

What did you see instead?

A表千万级别的数据量动态加表后全量完成后不增量

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@13011006997 13011006997 added the bug Something isn't working label Aug 22, 2023
@13011006997 13011006997 changed the title [Bug] [Bug] 动态加表 全量同步完成后不增量(在数据量超1000万的情况下) Aug 24, 2023
@13011006997 13011006997 changed the title [Bug] 动态加表 全量同步完成后不增量(在数据量超1000万的情况下) [Bug] mysql-cdc动态加表 全量同步完成后不增量(在数据量超1000万的情况下) Aug 24, 2023
@leonardBang leonardBang self-assigned this Sep 14, 2023
leonardBang added a commit that referenced this issue Sep 14, 2023
e-mhui pushed a commit to e-mhui/flink-cdc-connectors that referenced this issue Oct 18, 2023
GOODBOY008 pushed a commit to GOODBOY008/flink-cdc that referenced this issue Oct 30, 2023
… calculation

This closes apache#2421.

Co-authored-by: Leonard Xu <[email protected]>
(cherry picked from commit dddab4d)
GOODBOY008 pushed a commit to GOODBOY008/flink-cdc that referenced this issue Oct 30, 2023
… calculation

This closes apache#2421.

Co-authored-by: Leonard Xu <[email protected]>
(cherry picked from commit dddab4d)
GOODBOY008 pushed a commit to GOODBOY008/flink-cdc that referenced this issue Oct 30, 2023
… calculation

This closes apache#2421.

Co-authored-by: Leonard Xu <[email protected]>
(cherry picked from commit dddab4d)
leonardBang pushed a commit that referenced this issue Oct 31, 2023
… calculation

This closes #2421.

Co-authored-by: Leonard Xu <[email protected]>
(cherry picked from commit dddab4d)
zhongqishang pushed a commit to zhongqishang/flink-cdc that referenced this issue Dec 7, 2023
… calculation

This closes apache#2421.

Co-authored-by: Leonard Xu <[email protected]>
(cherry picked from commit dddab4d)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants