Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimize the synchronization behavior of the lossy DDL operation #8686

Closed
nongfushanquan opened this issue Mar 27, 2023 · 7 comments · Fixed by #8859, #8912 or #8926
Closed

Optimize the synchronization behavior of the lossy DDL operation #8686

nongfushanquan opened this issue Mar 27, 2023 · 7 comments · Fixed by #8859, #8912 or #8926
Assignees
@Rustin170506
Labels
affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. type/enhancement The issue or PR belongs to an enhancement.

Comments

@nongfushanquan
Copy link
Contributor

nongfushanquan commented Mar 27, 2023 •
edited
Loading

Is your feature request related to a problem?

When a customer runs certain DDLs on a big table, such as modifying a column that affects all rows of the table, all rows will replicate to the downstream

Describe the feature you'd like

the ticdc will ignore the dml and only sync ddl to the downstream.

Describe alternatives you've considered

No response

Teachability, Documentation, Adoption, Migration Strategy

No response
@nongfushanquan nongfushanquan added the type/feature Issues about a new feature label Mar 27, 2023
@nongfushanquan
Copy link
Contributor Author

/area cdc

@ti-chi-bot
Copy link
Member

@nongfushanquan: The label(s) area/cdc cannot be applied, because the repository doesn't have them.

In response to this:

/area cdc

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

@nongfushanquan
Copy link
Contributor Author

/area ticdc

@ti-chi-bot ti-chi-bot added the area/ticdc Issues or PRs related to TiCDC. label Mar 27, 2023
@nongfushanquan
Copy link
Contributor Author

/assign @hi-rustin

@benmaoer benmaoer mentioned this issue Apr 11, 2023
Merged
15 tasks
@ti-chi-bot ti-chi-bot bot assigned amyangfei and unassigned Rustin170506 Apr 25, 2023
@nongfushanquan
Copy link
Contributor Author

/assign @hi-rustin
/unassign @amyangfei

@ti-chi-bot ti-chi-bot bot assigned Rustin170506 and unassigned amyangfei Apr 25, 2023
@Rustin170506 Rustin170506 mentioned this issue Apr 26, 2023
Merged
@Rustin170506 Rustin170506 added type/enhancement The issue or PR belongs to an enhancement. and removed type/feature Issues about a new feature labels Apr 26, 2023
@nongfushanquan nongfushanquan changed the title optimize the behavior of sync the DDL when the downstream is tidb/mysql Optimize the synchronization behavior of the lossy DDL operation Apr 27, 2023
ti-chi-bot bot pushed a commit that referenced this issue Apr 27, 2023
@Rustin170506
tests(ticdc): add lossy_ddl test (#8859)
c5add2f 
close #8686
@CharlesCheung96 CharlesCheung96 mentioned this issue Apr 28, 2023
Merged
ti-chi-bot bot pushed a commit that referenced this issue Apr 28, 2023
@CharlesCheung96
tests(ticdc): add comment to storage sink (#8876)
07d5313 
ref #8686
@Rustin170506 Rustin170506 mentioned this issue May 8, 2023
Merged
ti-chi-bot bot pushed a commit that referenced this issue May 8, 2023
@Rustin170506
tests(ticdc): add exchange partition test to lossy DDL case (#8912)
4dc30e9 
close #8686
@Rustin170506 Rustin170506 mentioned this issue May 9, 2023
Merged
ti-chi-bot bot pushed a commit that referenced this issue May 10, 2023
@Rustin170506
tests(ticdc): add reorganize partition test to lossy DDL case (#8926)
7b06881 
close #8686
This was referenced May 17, 2023
Closed
Merged
Merged
@nongfushanquan
Copy link
Contributor Author

/label affects-6.5

@nongfushanquan
Copy link
Contributor Author

/label affects-7.1

Rustin170506 added a commit to ti-chi-bot/tiflow that referenced this issue May 19, 2023
@Rustin170506
tests(ticdc): add exchange partition test to lossy DDL case (pingcap#…
9001ec1 
…8912)

close pingcap#8686
Rustin170506 added a commit to ti-chi-bot/tiflow that referenced this issue May 19, 2023
@Rustin170506
tests(ticdc): add reorganize partition test to lossy DDL case (pingca…
5ff8e6b 
…p#8926)

close pingcap#8686
ti-chi-bot bot pushed a commit that referenced this issue May 19, 2023
@ti-chi-bot
tests(ticdc): add lossy_ddl test (#8859) (#8985)
29afa87 
close #8686
Rustin170506 pushed a commit to ti-chi-bot/tiflow that referenced this issue May 19, 2023
@ti-chi-bot @Rustin170506
tests(ticdc): add lossy_ddl test (pingcap#8859) (pingcap#8985)
e3e921f 
close pingcap#8686

Signed-off-by: hi-rustin <[email protected]>
ti-chi-bot bot pushed a commit that referenced this issue May 20, 2023
@ti-chi-bot
tests(ticdc): add lossy_ddl test (#8859) (#8986)
1881877 
close #8686
@nongfushanquan nongfushanquan mentioned this issue May 25, 2023
Merged
16 tasks
@nongfushanquan nongfushanquan mentioned this issue Jun 9, 2023
Merged
17 tasks
@nongfushanquan nongfushanquan mentioned this issue Jun 21, 2023
Merged
16 tasks
@asddongmen asddongmen mentioned this issue Jan 20, 2024
Closed
@flowbehappy flowbehappy mentioned this issue Apr 23, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Rustin170506 Rustin170506

Labels
affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
4 participants
@amyangfei @Rustin170506 @ti-chi-bot @nongfushanquan