-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-35243] Extends schema change event types support #3521
Conversation
83be39c
to
5b03ad1
Compare
c2b8489
to
b33362c
Compare
Marked it as draft for now, need to add more tests to verify if table-level schema change event works as expected. |
f8656bd
to
e277a1c
Compare
e277a1c
to
d8f31b7
Compare
d8f31b7
to
bb7288a
Compare
Rebased & improved test coverage. @leonardBang @ruanhang1993 PTAL |
bb7288a
to
95ec5b0
Compare
95ec5b0
to
c2a8bf8
Compare
5f0fb45
to
7e97e83
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @yuxiqian for the contribution, I left some general comments
flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/TruncateTableEvent.java
Outdated
Show resolved
Hide resolved
flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/DropTableEvent.java
Outdated
Show resolved
Hide resolved
flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/DropTableEvent.java
Show resolved
Hide resolved
flink-cdc-common/src/main/java/org/apache/flink/cdc/common/event/SchemaChangeEventVisitor.java
Outdated
Show resolved
Hide resolved
Thanks for Leonard's review, I've made the following changes:
|
...eline-e2e-tests/src/test/java/org/apache/flink/cdc/pipeline/tests/SchemaEvolveE2eITCase.java
Show resolved
Hide resolved
e137bdf
to
bfcf820
Compare
...eline-e2e-tests/src/test/java/org/apache/flink/cdc/pipeline/tests/SchemaEvolveE2eITCase.java
Outdated
Show resolved
Hide resolved
.../org/apache/flink/cdc/runtime/operators/schema/coordinator/SchemaRegistryRequestHandler.java
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @yuxiqian for the update, LGTM
CI passed, merging... |
This PR closes FLINK-35243.
Recreated one since the last PR (#3296) has so many conflicts with
master
and isn't worth rebasing.DropTableEvent
andTruncateTableEvent
in pipeline frameworkSchemaChangeEventWithPreSchema
interface, allowing SchemaRegistry backfilling schema before change payload