Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TEST] [WIP] reproduce oracle issue #2167

Closed
wants to merge 514 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
514 commits
Select commit Hold shift + click to select a range
0e4f835
[cdc-connector][Postgres] Add SNAPSHOT_ONLY mode for Postgres CDC Source
loserwang1024 Dec 16, 2023
e3f6829
[cdc-connector][mongodb] Add SNAPSHOT_ONLY mode for Mongodb CDC Source
loserwang1024 Dec 18, 2023
44692aa
[docs][hotfix] Update dependency version from 2.5-SNAPSHOT to 3.0-SNA…
gong Jan 13, 2024
9abf2cf
[hotfix][cdc-connector][mysql] Skip SchemaChangeEvents that were not …
lvyanquan Jan 15, 2024
e3d6c7e
[cdc-connector][postgres] Apply DBZ-5398 postgres connector to handle…
loserwang1024 Jan 18, 2024
9ce3656
[cdc-connector][postgres] Fix data lost problem when new lsn committe…
lzshlzsh Jan 21, 2024
a2d36a8
[cdc-connector][mongodb][hotfix] Stop executing log reading in MongoD…
loserwang1024 Jan 23, 2024
c98f899
[cdc-common][cdc-pipelines][cdc-runtime] Use name instead of column i…
joyCurry30 Jan 24, 2024
20e44e6
[cdc-connector][oracle] Oracle supports user specific chunk column (#…
gong Jan 24, 2024
3be3417
[cdc-connector][postgres] Fix potential PostgresSQL database connecti…
loserwang1024 Jan 24, 2024
10e542c
[cdc-connector][sqlserver] sqlserver support use specific chunk colum…
gong Jan 25, 2024
7ea1972
[debezium] Upgrade to Debezium 1.9.8.Final(#3033) (#3034)
loserwang1024 Jan 26, 2024
82ccf00
[hotfix][cdc-connector][mongodb] Fix scanFullChangelog requires all c…
yuxiqian Jan 30, 2024
d058102
[cdc-connector][oracle]Add oracle 21 version to OracleValidator (#3054)
GOODBOY008 Feb 2, 2024
0ca718c
[cdc-connector][oracle] Expose SNAPSHOT_ONLY mode for Oracle CDC Sour…
loserwang1024 Feb 3, 2024
167bb40
[hotfix][docs] fix typo 'escription' to 'description' (#3050)
jiamin13579 Feb 5, 2024
1562bc2
[cdc-base] Support Scan Newly Added Tables feature
sap1ens Dec 18, 2023
1eeda75
[cdc-connector][cdc-base] Support capture newly added tables with un-…
loserwang1024 Feb 23, 2024
03a287a
[cdc-connector][postgres] Expose capture newly added tables ability t…
loserwang1024 Feb 23, 2024
a2ad627
[cdc-connector][mongodb] Expose capture newly added tables ability to…
loserwang1024 Feb 23, 2024
ea7b0e8
[cdc-base] Support to parse Oracle/SqlServer/PostgresSQL CDC schema c…
e-mhui Feb 28, 2024
6da9684
[cdc-connector][oracle] Use database name in upper case at the snapsh…
e-mhui Feb 28, 2024
f7fa317
[FLINK-34187][cdc][build] Setup Github CI for Flink CDC project
GOODBOY008 Mar 5, 2024
99a86fb
[FLINK-34578][cdc][build] Remove outdated issue templates
GOODBOY008 Mar 5, 2024
96888b2
[FLINK-34577] Add IssueNavigationLink for IDEA git log (#3096)
GOODBOY008 Mar 5, 2024
eeb4bab
[FLINK-34184][cdc][license] Update Copyright from Ververica to Apache
ruanhang1993 Mar 4, 2024
f1461f2
[hotfix][cdc][docs] Update LICENSE file
ruanhang1993 Mar 4, 2024
a6c1b06
[FLINK-34184][cdc][docs] Add license for all document files
ruanhang1993 Mar 5, 2024
e10c869
[FLINK-34584][cdc][build] Rename package from com.ververica to org.ap…
ruanhang1993 Mar 6, 2024
86272bf
[FLINK-34183][cdc][license] Update NOTICE files (#3107)
ruanhang1993 Mar 7, 2024
1dc201f
[FLINK-34180] Migrate doc website from ververica to flink (#3028)
GOODBOY008 Mar 7, 2024
26eb6a9
[hotfix][cdc][build] Include cdc-common module when shaded for module…
lvyanquan Mar 11, 2024
dba0062
[FLINK-34180][cdc] Add issue template to remind users about the new b…
PatrickRen Mar 14, 2024
88c23b5
[FLINK-34664][cdc] Add .asf.yaml file for project
PatrickRen Mar 14, 2024
84ca4dd
[FLINK-34677][cdc][dcos] Refactor the structure of Flink CDC website …
PatrickRen Mar 17, 2024
9988cae
[FLINK-34687][cdc][docs] Build the home page of Flink CDC documentation
leonardBang Mar 18, 2024
aa9e91c
[FLINK-34687][cdc][docs][zh] Build the home page of Flink CDC documen…
leonardBang Mar 18, 2024
bd760b1
[FLINK-34678][cdc][docs] Add introduction page for Flink CDC docs
PatrickRen Mar 18, 2024
96909ea
[FLINK-34683][cdc][docs] Add contributing page for Flink CDC docs
ruanhang1993 Mar 18, 2024
776dcba
[FLINK-34684][cdc][docs] Add licenses page for Flink CDC docs
ruanhang1993 Mar 18, 2024
14b81dc
[FLINK-34715][cdc][cdc-connector][mysql] Correctly close BinlogSplitR…
gong Mar 18, 2024
4d3da26
[FLINK-34682][cdc][docs] Add "Understand Flink CDC API" page for Flin…
PatrickRen Mar 18, 2024
8fd28f1
[FLINK-34680][cdc][docs] Add overview page for CDC connectors and opt…
PatrickRen Mar 18, 2024
e73f3ad
[FLINK-34679][cdc][docs] Add core concept pages for Flink CDC docs
LYanquan Mar 18, 2024
a332fad
[FLINK-34671][cdc][docs] Update README file of Flink CDC project
LYanquan Mar 18, 2024
a954dab
[minor][cdc][docs] Improve the quickstart examples for Flink CDC docs
leonardBang Mar 19, 2024
1fd0cfe
[FLINK-34685][cdc][doc] add kubernetes.md under deployment directory.…
lvyanquan Mar 19, 2024
e93cc83
[FLINK-34681][cdc][doc] add standalone.md under deployment directory.…
lvyanquan Mar 19, 2024
32c8e0b
[FLINK-34686][cdc] add docs about yarn deployment (#3163)
Shawn-Hx Mar 19, 2024
8098a9c
[FLINK-34724][docs] Fix broken web link in document of legacy Flink C…
loserwang1024 Mar 19, 2024
88c9cf2
[FLINK-34677][cdc] Synchronize Chinese documentations for Flink CDC (…
PatrickRen Mar 19, 2024
8fdd151
[FLINK-34734][cdc][doc] Translate the title of content.zh to Chinese
lvyanquan Mar 20, 2024
18fa3c5
[FLINK-34742][cdc][docs] Translate "FAQ" Page for Flink CDC Chinese D…
loserwang1024 Mar 20, 2024
bacb6a3
[FLINK-34740][cdc][doc-zh] Translate legacy cdc source docs to Chinese
lvyanquan Mar 20, 2024
43a5887
[FLINK-34741][cdc][docs] Translate get-started page for Flink CDC doc…
loserwang1024 Mar 20, 2024
e3e0241
[FLINK-34739][cdc][docs] Translate "Connectors" page to Chinese
loserwang1024 Mar 20, 2024
0ab57ac
[FLINK-34770][cdc][doc] Fix outdated download links of legacy connect…
lvyanquan Mar 22, 2024
1c69a65
[FLINK-34732][cdc][ci] Add document dead link check for Flink CDC Doc…
GOODBOY008 Mar 25, 2024
5f4f86f
[hotfix] Change old com.ververica dependencies to org.apache.flink (#…
xleoken Mar 27, 2024
f7f248c
[build] fix inconsistent Kafka shading among cdc connectors (#2988)
link3280 Mar 28, 2024
927a0ec
[FLINK-34753][cdc][docs] Improve and update outdated mongodb cdc FAQ
Shawn-Hx Mar 29, 2024
d099603
[FLINK-34948][cdc][common] Fix cdc RowType can not convert to Flink type
zhongqishang Apr 1, 2024
ed09e8b
[minor][cdc][docs] Improve the indentation of the example yaml in REA…
dingqianwen Apr 2, 2024
f0c29f6
[cdc-composer] Introduce transform definition and parser
aiwenmo Mar 20, 2024
c929030
[cdc-common] Introduce partitionKeys into schema and add related util…
aiwenmo Mar 20, 2024
bcad5d9
[cdc-runtime] Introduce TransformSchemaOperator and TransformDataOper…
aiwenmo Mar 20, 2024
a35b8dd
[build] Optimize pom to solve the CI error
aiwenmo Mar 20, 2024
1d05abf
[minor][cdc-common] Improve the java doc of translators
Apr 2, 2024
6510e67
[FLINK-34959][cdc] Update old flink-cdc-connectors artifactId (#3200)
xleoken Apr 7, 2024
b10a666
[FLINK-34613][cdc] Support recover from a specific savepoint file (#2…
lvyanquan Apr 9, 2024
8c5437a
[FLINK-34952][cdc-composer][sink] Flink CDC pipeline supports SinkFun…
loserwang1024 Apr 9, 2024
80d461b
[MySQL] Fix for DBZ-7037 and #2217 to not clear tableMapEventByTableI…
shikai93 Apr 10, 2024
abb98ee
[FLINK-34690] Cast decimal to VARCHAR as primary key in starrocks sin…
loserwang1024 Apr 11, 2024
18dd51f
[FLINK-34905][cdc-connector][mysql] Fix the default length of CHAR/BI…
zhongqishang Apr 11, 2024
025653d
[hotfix] run mvn spotless to fix code style violations. (#3219)
loserwang1024 Apr 11, 2024
1b0b9f8
[minor][cdc-connector][mongo] Fix warning during MongoDB tests (#3210)
yuxiqian Apr 11, 2024
af7665d
[FLINK-34689][MySQL][Feature] check binlog_row_value_options (#3148)
SML0127 Apr 12, 2024
48ca862
[FLINK-34634][cdc-base][mysql] Fix that Restarting the job will not r…
loserwang1024 Apr 12, 2024
adf6667
[FLINK-35078][ci] Adds flink-cdc-pipeline-connectors to the GHA CI (#…
morazow Apr 12, 2024
9d150c0
[docs] [minor] Optimize styles of the Flink CDC website homepage
Laffery Apr 15, 2024
6017b16
[FLINK-34653][cdc][route] Support table merging with route rules
PatrickRen Apr 16, 2024
0562e35
[FLINK-35079][cdc-connector][mongo] Fallback to timestamp startup mod…
yuxiqian Apr 17, 2024
ef9491b
[minor][cdc][docs] Optimize markdown styles in quickstart doc
xleoken Apr 18, 2024
d4ed7db
[FLINK-35127][cdc][values] Remove HybridSource from ValuesSource to a…
lvyanquan Apr 19, 2024
0d797a6
[FLINK-34903][cdc][mysql] Add mysql-pipeline-connector with tables.ex…
Thorne-coder Apr 19, 2024
5e52d86
[FLINK-35102][cdc][doris-sink] Correct Doris connector varchar type m…
yuxiqian Apr 22, 2024
313726b
[minor][cdc][docs] Fix outdated StarRocks quickstart guide
yuxiqian Apr 23, 2024
2103226
[FLINK-34969][cdc][cli] Add support for both new and old Flink config…
skymilong Apr 23, 2024
253ef92
[pipeline-connector][kafka] Add kafka pipeline data sink connector. (…
lvyanquan Apr 23, 2024
01ec7da
[FLINK-35055][cdc] Exclude connector dependencies with questionable l…
yuxiqian Apr 23, 2024
bc7031b
[e2e][pipeline-connector][mysql] Add e2e test for mysql pipeline conn…
lvyanquan Apr 23, 2024
ef2eece
[pipeline-connector][paimon] add paimon pipeline data sink connector.…
lvyanquan Apr 24, 2024
de4be37
[hotfix][e2e] Fix pipeline e2e test cases failures (#3246)
yuxiqian Apr 24, 2024
58531e7
[FLINK-35077][cdc] Add license checking CI scripts (#3218)
yuxiqian Apr 24, 2024
c1e1aa4
[FLINK-34648][cdc] Avoid RPC timeout when applying SchemaChangeEvent …
lvyanquan Apr 24, 2024
65d670a
[FLINK-34188][cdc][build] Add scripts in tools/releasing to help rele…
lvyanquan Apr 24, 2024
3fe0540
[hotfix][cdc][tools] Change file mode to 755 to allow executing relea…
PatrickRen Apr 24, 2024
990261d
[hotfix][ci] Polish ci concurrency group to avoid warning message
GOODBOY008 Apr 24, 2024
3385ae8
[cdc-connector][db2] Db2 support incremental source
gong Dec 13, 2023
8deddab
[minor][cdc-connector][db2] Fix typos and improve the code style
Apr 23, 2024
ddf557c
[tests][cdc-connector][db2] Improve the DB2 tests
Apr 24, 2024
bdca0e3
[FLINK-35128][cdc-connector][cdc-base] Re-calculate the starting chan…
loserwang1024 Apr 25, 2024
05281e5
[FLINK-34639][cdc][oceanbase] Support debezium deserializer in OceanB…
whhe Apr 25, 2024
b0e0538
[release] Update version to 3.2-SNAPSHOT
PatrickRen Apr 25, 2024
f9c1eca
[docs][hotfix] Correct shell scripts style in Quickstart document
ZmmBigdata Apr 25, 2024
6232d84
[FLINK-35173][cdc][mysql] Debezium custom time serializer for MySQL c…
czy006 Apr 26, 2024
185f719
[minor][cdc][docs] Add user guide about providing extra jar package i…
yuxiqian Apr 26, 2024
ec643c9
[FLINK-35235][pipeline-connector][kafka] Fix missing dependencies in …
lvyanquan Apr 26, 2024
9cc3451
[FLINK-35251][cdc][runtime] Fix bug of serializing derivation mapping…
PatrickRen Apr 28, 2024
a513e9f
[FLINK-35258][cdc][doc] Fix broken links to Doris in documentation (#…
yuxiqian Apr 28, 2024
6258bec
[FLINK-35256][cdc][runtime] Fix transform node does not respect type …
yuxiqian Apr 28, 2024
4609f5f
[minor][docs] Fix route definition example in core concept docs (#3269)
yuxiqian Apr 29, 2024
0108d0e
[FLINK-35259][cdc][transform] Fix FlinkCDC pipeline transform can't d…
aiwenmo Apr 29, 2024
75a553e
[FLINK-34878][cdc][transform] Flink CDC pipeline transform supports C…
aiwenmo Apr 29, 2024
23a67dc
[FLINK-35255][cdc][runtime] DataSinkWriterOperator adds overrides for…
yanghuaiGit Apr 29, 2024
f61f0f4
[FLINK-35264][cdc][runtime] Fix multiple transform rules do not take …
yuxiqian Apr 29, 2024
002b16e
[FLINK-35244][cdc-connector][tidb] Correct the package for flink-conn…
xieyi888 May 6, 2024
a7cb46f
[FLINK-35274][cdc-connector][db2] Fix occasional failure issue with F…
gong May 6, 2024
b6cfbcc
[hotfix][docs] Correct example configuration for Paimon warehouse path
May 6, 2024
fa6e7ea
[FLINK-35245][cdc-connector][tidb] Add metrics for flink-connector-ti…
xieyi888 May 7, 2024
0f5584b
[minor][docs] Rectify names of CDC sources for Flink and improve the …
yuxiqian May 11, 2024
8d2d2a6
[hotfix][docs] Fix dead links in documentations
yuxiqian May 11, 2024
d0457f7
[FLINK-35314][cdc] Add Flink CDC pipeline transform user document (#3…
aiwenmo May 15, 2024
999027f
[FLINK-35386][cdc][docs] Build release-3.1 documentation and mark it …
GOODBOY008 May 17, 2024
d386c7c
[FLINK-35386][cdc][docs] Shorten GHA names and disable fail-fast to i…
GOODBOY008 May 17, 2024
b33e6a0
[minor][docs] Improve the answer of MySQL CDC FAQ docs
PONYLEE May 22, 2024
644b5c2
[FLINK-35431][doc] Migrate references in Flink CDC documentation from…
GOODBOY008 May 23, 2024
8e8fd30
[FLINK-35298][cdc][metrics] Improve the fetch delay metrics
Shawn-Hx May 24, 2024
bddcaae
[FLINK-35294][mysql] Use source config to check if the filter should …
Shawn-Hx May 27, 2024
18b0627
[FLINK-35295][mysql] Improve jdbc connection pool initialization fail…
Shawn-Hx May 27, 2024
6350eec
[FLINK-35301][cdc] Avoid deadlock when loading driver classes
Shawn-Hx May 27, 2024
b2cb30f
[FLINK-35408][mysql] Introduce 30 minutes tolerance when validate the…
Shawn-Hx May 27, 2024
d97124f
[FLINK-35447][doc-ci] Flink CDC Document document file had removed bu…
GOODBOY008 May 28, 2024
4a8b587
[minor][cdc-cli] Suppress false alarm in flink config loader
yuxiqian May 29, 2024
19c382c
[FLINK-35409][cdc][mysql] Request more splits if all splits are filte…
Shawn-Hx May 30, 2024
88afc5f
[FLINK-35323][cdc-runtime] Fix transform failure when one rule matche…
yuxiqian Jun 3, 2024
0e8b2c7
[FLINK-35430][cdc-connector][kafka] Pass the time zone infor to JsonS…
joyCurry30 Jun 3, 2024
3389186
[FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pr…
loserwang1024 Jun 4, 2024
5b28d1a
[FLINK-35129][postgres] Introduce scan.lsn-commit.checkpoints-num-del…
morazow Jun 4, 2024
0214166
[FLINK-35325][cdc-connector][paimon] Support specify column order whe…
joyCurry30 Jun 5, 2024
53c2fb9
[build][hotfix] Fix jackson conflicts among cdc connectors
link3280 Jun 5, 2024
e817cc2
[minor][docs] Improve the readme and issue template
leonardBang Jun 5, 2024
b1e1574
[FLINK-35527][docs] Polish quickstart guide & migrate maven links fro…
yuxiqian Jun 6, 2024
8a7fdd5
[minor][cdc-connector][paimon] Remove duplicate interface implements
joyCurry30 Jun 6, 2024
414720d
[FLINK-35464][cdc] Fixes operator state backwards compatibility from …
yuxiqian Jun 6, 2024
9a96034
[FLINK-35415][base] Fix compatibility with Flink 1.19
yuxiqian Jun 5, 2024
fe1ceb9
[FLINK-35415][base] Bump Flink patch version to 1.18.1
yuxiqian Jun 5, 2024
d8a9c8c
[FLINK-35316][base] Run E2e test cases with Flink 1.19 and latest pat…
yuxiqian Jun 5, 2024
8eb7e53
[FLINK-35120][doris] Add Doris integration test cases
yuxiqian Jun 5, 2024
1a36063
[FLINK-35092][cdc][starrocks] Add starrocks integration test cases
yuxiqian Jun 5, 2024
e2ccc83
[FLINK-34908][pipeline-connector][doris] Fix MySQL to doris pipeline …
gong Jun 6, 2024
ed4cd40
[hotfix][cdc-composor] Adjust test of cdc composer from junit4 to junit5
loserwang1024 Jun 7, 2024
d8f905f
[hotfix][ci] PIPELINE_CONNECTORS stage should include pipeline connec…
Jun 7, 2024
17ff659
[hotfix][build] Remove test-jar from parent pom and only add to neces…
yuxiqian Jun 7, 2024
4efb1d7
[FLINK-35545][doc] Miss 3.1.0 version in snapshot flink-cdc doc versi…
GOODBOY008 Jun 7, 2024
7d35f3c
[FLINK-35545][doc] Revert dbz doc 2.0 back to 1.9
GOODBOY008 Jun 7, 2024
c958daf
[FLINK-35540][cdc-common] Fix table missed when database and table ar…
qg-lin Jun 11, 2024
2bd2e4c
[FLINK-35121][common] Adds validation for pipeline definition options
yuxiqian Jun 14, 2024
80920aa
[FLINK-35297][mysql] Add validation for option connect.timeout becaus…
Shawn-Hx Jun 17, 2024
06bf143
[docs][minor] Optimize styles of the Flink CDC index page
Laffery Jun 18, 2024
239debc
[hotfix][ci] Add new pipeline connectors into labeler.yml
yuxiqian Jun 18, 2024
3441a1e
[FLINK-35648][runtime] Allow applying multiple route rules for one si…
yuxiqian Jun 24, 2024
0723009
[FLINK-35700][cli] Loosen CDC pipeline options validation
yuxiqian Jun 26, 2024
ca1470d
[FLINK-35281][cdc-common] FlinkEnvironmentUtils#addJar add each jar o…
loserwang1024 Jul 5, 2024
302a691
[FLINK-35354] Support host mapping in Flink tikv cdc (#3336)
Mrart Jul 9, 2024
ad1f554
[FLINK-35647][route] Support symbol replacement to enrich routing rules
yuxiqian Jul 12, 2024
a098dda
[FLINK-35781][cli] Provide a default parallelism 1 for pipeline jobs
yuxiqian Jul 12, 2024
137dc1b
[minor][cdc][docs] Optimize markdown formats in doris quickstart doc
Jiabao-Sun Jul 15, 2024
2d1eb0a
[FLINK-34990][cdc-connector][oracle] Oracle cdc support newly add tab…
gong Jul 16, 2024
a2539f5
[hotfix][docs][postgres] Remove unsupported erroneous example code
gtk96 Jul 16, 2024
11deb62
[build][CI] Introduce automated PR governance workflows
yuxiqian Jul 16, 2024
94a0415
[FLINK-34883] Fix postgres uuid column as PK (#3282)
eskabetxe Jul 16, 2024
2d50e43
[minor][cdc-connector][postgres] PostgresDialect removes useless code
ChengJie1053 Jul 17, 2024
274401e
[FLINK-35758][doc][cdc-connector][mysql] Add missed scan.startup.time…
lvyanquan Jul 17, 2024
9a97182
[minor][cdc-connector][mysql] Code optimization for constants
ChengJie1053 Jul 17, 2024
332e1f3
[minor][cdc-connector][sqlserver] Fix some typos (#3421)
gong Jul 17, 2024
ec0becd
[docs][minor] Specify the lib directory of Flink CDC in quick start docs
Lordeath Jul 18, 2024
9a4dede
[FLINK-35237][cdc-common] Allow Sink to choose HashFunction in PrePar…
dingxin-tech May 13, 2024
26ff6d2
[FLINK-35237][cdc-common] Improve the interfaces and reorganize the d…
leonardBang Jul 19, 2024
fcb4cd8
[FLINK-35871][doc] Add missed "snapshot" mode to mysql connector star…
lvyanquan Jul 22, 2024
c5f391c
[FLINK-35865][base] Support Byte and Short in ObjectUtils (#3481)
GOODBOY008 Jul 23, 2024
313bace
[minor][doc][cdc-connector][oracle] Update OracleSchema#getTableSchem…
ChengJie1053 Jul 23, 2024
ea71b23
[FLINK-35874][cdc-connector][mysql] Check pureBinlogPhaseTables set b…
qiaozongmi Jul 24, 2024
91fc7bb
[FLINK-35740][cdc-connector][mysql] Allow column as chunk key even it…
SML0127 Jul 24, 2024
768d528
[minor][test] Add Flink CDC 3.1.1 version to migration test version list
yuxiqian Jul 25, 2024
241eb03
[FLINK-35868][cdc-connector][mongodb] Bump dependency version to supp…
yuxiqian Jul 25, 2024
b15a226
[FLINK-35391][cdc-connector][paimon] Bump dependency of Paimon Pipeli…
Jul 29, 2024
5917f78
[FLINK-35736][test] Add migration test scripts & CI workflows
yuxiqian Jul 30, 2024
85bfd6a
[docs][minor] Add transform piece for pipeline example
leonardBang Jul 30, 2024
a39959f
[FLINK-35072][doris] Support applying AlterColumnTypeEvent to Doris p…
yuxiqian Jul 30, 2024
1388cf9
[FLINK-34877][cdc] Support type cast conversion in pipeline transform
aiwenmo Jul 31, 2024
8f2939e
[hotfix][ci] Migrate to Docker Compose V2 (#3505)
yuxiqian Aug 2, 2024
47f5660
[FLINK-35344][cdc-base] Move same code from multiple subclasses to Jd…
loserwang1024 Aug 2, 2024
0c49959
[FLINK-35524][cdc-base] Clear connections pools when reader exist. (#…
loserwang1024 Aug 6, 2024
986f37b
[FLINK-35674][cdc-connector][mysql]Fix blocking caused by searching f…
Thorne-coder Aug 6, 2024
f6d1d48
[FLINK-35912][cdc-connector] SqlServer CDC doesn't chunk UUID-typed c…
LiPL2017 Aug 6, 2024
3315be3
[hotfix][starrocks] Fix StarRocks FE startup failure due to insuffici…
yuxiqian Aug 6, 2024
44dafe3
[FLINK-35813][cdc-runtime] Do not clear state field in TransformSchem…
yuxiqian Aug 6, 2024
d76beec
[FLINK-35234][minor][cdc-common] Fix potential NPE in ConfigurationUtils
loserwang1024 Aug 6, 2024
7ca1135
[FLINK-35743][cdc-runtime] Correct the temporal function semantics
aiwenmo Aug 6, 2024
1778ef6
Revert "[hotfix][starrocks] Fix StarRocks FE startup failure due to i…
GOODBOY008 Aug 6, 2024
f06cc1f
[hotfix][ci] Clean up disk space
GOODBOY008 Aug 6, 2024
4561a8a
[FLINK-34638][cdc-common] Support column with default value
lvyanquan Dec 28, 2023
03a2ae3
[FLINK-35893][cdc-runtime] Write CURRENT_VERSION of TableChangeInfo t…
leonardBang Jul 25, 2024
54c6a0b
[hotfix][e2e] Add missing default values field in E2e test
yuxiqian Aug 7, 2024
5ed9e05
[FLINK-35242][cdc-common][cdc-runtime] Support TRY_EVOLVE and LENIENT…
yuxiqian Aug 8, 2024
21fade0
[FLINK-35432][pipeline-connector][mysql] Support catch modify event i…
hk-lrzy Aug 8, 2024
9d6154f
[FLINK-35791][kafka] Add database and table info of Canal / Debezium …
lvyanquan Aug 8, 2024
af02ce1
[build][e2e] Separate Pipeline and Source E2e tests and cover flink 1…
yuxiqian Aug 8, 2024
2dabfc0
[FLINK-35730][cdc-cli] PipelineDefinitionParser supports parsing pip…
aiwenmo Aug 8, 2024
81d916f
[FLINK-35272][cdc-runtime] Transform supports omitting and renaming …
yuxiqian Aug 8, 2024
d6b687b
[FLINK-34853] Submit CDC Job To Flink K8S Native Application Mode (#3…
czy006 Aug 8, 2024
b937db2
[hotfix][cdc-connector][mongodb] Fix unstable test cases for snapshot…
yuxiqian Aug 9, 2024
09f36a4
[FLINK-35143][pipeline-connector][mysql] Expose newly added tables ca…
qg-lin Aug 9, 2024
07446d1
[FLINK-35715][common] Ignore the compact optimize for mysql timestamp…
ruanhang1993 Aug 9, 2024
4bf5a39
[FLINK-34688][cdc-connector][mysql] Make scan newly table trigger con…
loserwang1024 Aug 9, 2024
e0d6d1d
[FLINK-35442][cdc-connect][kafka] add key.format and partition.strate…
lvyanquan Aug 9, 2024
e2bb917
[FLINK-34876][transform] Support UDF functions in transform (#3465)
yuxiqian Aug 9, 2024
b361db5
[FLINK-36007][[cdc-composer] Loading factory and added jar in one se…
loserwang1024 Aug 9, 2024
84ef9d5
[FLINK-35981][cdc-runtime] Transform supports referencing one column …
MOBIN-F Aug 9, 2024
b9c628d
[hotfix][doc] Fix doris document dead links and typo
GOODBOY008 Aug 9, 2024
3bb1f3c
[FLINK-35938][pipeline-connector][paimon] Use filterAndCommit API for…
lvyanquan Aug 12, 2024
5284df5
[FLINK-36023][cdc-composer] Flink CDC K8S Native Application Mode add…
loserwang1024 Aug 12, 2024
17d21a9
[FLINK-35984][cdc-runtime] Fix bug that metadata column name can not …
MOBIN-F Aug 12, 2024
64f996b
[FLINK-35891][pipeline-connector][paimon] Support dynamic bucket in P…
lvyanquan Aug 12, 2024
15ab858
[FLINK-35884][pipeline-connector][mysql] MySQL pipeline connector sup…
beryllw Aug 12, 2024
ac14dba
[FLINK-35894][pipeline-connector][es] Introduce Elasticsearch Sink Co…
proletarians Jul 12, 2024
8137f9d
[FLINK-35894][pipeline-connector][es] Support for ElasticSearch 6, 7 …
proletarians Aug 2, 2024
2885d12
[FLINK-35991][cdc-runtime] Resolve operator conflicts in transform SQ…
yuxiqian Aug 7, 2024
1042095
[FLINK-36034][cdc-runtime] Get rid of Flink table planner dependency …
yuxiqian Aug 12, 2024
ed83229
[release] Update version to 3.3-SNAPSHOT
PatrickRen Aug 13, 2024
874ff4f
[hotfix][cdc-runtime] Invalidate cache correctly to avoid classloader…
yuxiqian Aug 13, 2024
3cb91fb
[FLINK-35805][transform] Add __data_event_type__ metadata column
yuxiqian Aug 13, 2024
d99e718
[FLINK-36054][cdc][build] Fix Flink CDC parent pom and release script…
PatrickRen Aug 14, 2024
c5396fb
[FLINK-36056][cdc][connector/elasticsearch] Change flink.connector.el…
proletarians Aug 15, 2024
cbb33bb
[FLINK-35638][OceanBase][test] Refactor OceanBase test cases and remo…
whhe Aug 18, 2024
92b5483
[minor][docs] Compress images to reduce file size and improve website…
GOODBOY008 Aug 19, 2024
0470fdb
[FLINK-36082][pipeline-connector][kafka] Fix lamda NotSerializableExc…
lvyanquan Aug 19, 2024
7f08c6c
[FLINK-36088][pipeline-connector][paimon] Fix NPE in BucketAssignOper…
lvyanquan Aug 19, 2024
d3473de
[FLINK-36076][minor][cdc-runtime] Set isSchemaChangeApplying as volat…
loserwang1024 Aug 19, 2024
78fda8b
[FLINK-35243][cdc-common] Extends more schema change event types support
yuxiqian Aug 19, 2024
aedccb6
[FLINK-36111][minor][pipeline-connector/paimon] Improve MultiTableCom…
MOBIN-F Aug 20, 2024
77c6338
[FLINK-36081][cdc-connector][mysql] Remove the schemas of outdated ta…
kevinwangcs Aug 21, 2024
6205a5a
[FLINK-36094][cdc-runtime] Improve the Exception that SchemaRegistryR…
loserwang1024 Aug 22, 2024
565032e
[FLINK-36115][pipeline-connector][mysql] Introduce scan.newly-added-…
lvyanquan Aug 22, 2024
ee843e2
[FLINK-36114][cdc-runtime] Make SchemaRegistryRequestHandler thread s…
yuxiqian Aug 22, 2024
3837887
[FLINK-36092][cdc-runtime] Fix schema evolution failure with wildcard…
yuxiqian Aug 22, 2024
52f2019
[FLINK-35056][cdc-connector/sqlserver] Fix scale mapping from SQL Ser…
morozov Aug 22, 2024
060d203
[hotfix][cdc-runtime] Fix schema registry hanging in multiple paralle…
yuxiqian Aug 23, 2024
1848bd3
reproduce sqlserver
GOODBOY008 Aug 25, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
46 changes: 46 additions & 0 deletions .asf.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

github:
description: "Flink CDC is a streaming data integration tool"
homepage: https://nightlies.apache.org/flink/flink-cdc-docs-stable
labels:
- flink
- distributed
- data-integration
- data-pipeline
- real-time
- batch
- change-data-capture
- schema-evolution
- mysql
- postgresql
- kafka
- paimon
- cdc
- etl
- elt
enabled_merge_buttons:
squash: true
merge: false
rebase: true
autolink_jira: FLINK
collaborators:
- flinkbot
notifications:
commits: [email protected]
pullrequests: [email protected]
jobs: [email protected]
jira_options: link label
35 changes: 35 additions & 0 deletions .dlc.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
{
"ignorePatterns": [
{
"pattern": "^http://localhost"
},
{
"pattern": "^#"
},
{
"pattern": "^{"
},
{
"pattern": "^https://repo1.maven.org/maven2/org/apache/flink.*SNAPSHOT.*"
},
{
"pattern": "^https://mvnrepository.com"
},
{
"pattern": "^https://img.shields.io"
},
{
"pattern": "^https://twitter.com*"
}
],
"timeout": "30s",
"retryOn429": true,
"retryCount": 10,
"fallbackRetryDelay": "1000s",
"aliveStatusCodes": [
0,
200,
401,
403
]
}
70 changes: 0 additions & 70 deletions .github/ISSUE_TEMPLATE/bug-report.yml

This file was deleted.

20 changes: 16 additions & 4 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,17 @@
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

blank_issues_enabled: false
contact_links:
- name: Ask a question or get support
url: https://github.com/ververica/flink-cdc-connectors/discussions/categories/q-a
about: Ask a question or request support for CDC Connectors for Apache Flink®

44 changes: 0 additions & 44 deletions .github/ISSUE_TEMPLATE/feature.yml

This file was deleted.

72 changes: 72 additions & 0 deletions .github/ISSUE_TEMPLATE/issue-notice.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

name: Read Notice on Creating New Issues
description: We have moved to Apache Jira for managing issues
body:
- type: markdown
attributes:
value: |
Thank you for choosing Flink CDC!

As required by Apache Flink, please report bugs or new features on [Apache Jira](https://issues.apache.org/jira)
under the project `Flink` using component tag `Flink CDC`. You must have a JIRA account in order to log cases and issues.
If you don’t have an ASF JIRA account, you can request one at the [ASF Self-serve portal](https://selfserve.apache.org/jira-account.html),
account creation requires review by the PMC member of the application project, which normally takes one to two working days to be approved.

You can also initiate discussions in Apache Flink's dev mailing list ([email protected]) for technical issues.

If you have any questions about using Flink CDC, please use Flink user mailing list ([email protected])

Please note that issues created here on GitHub will be **ignored and automatically closed**.
- type: checkboxes
attributes:
label: Please don't check the box below
options:
- label: I'm aware that bugs and new features should be reported on [Apache Jira](https://issues.apache.org/jira) or Flink mailing list ([email protected]) instead of here
required: true
- type: checkboxes
attributes:
label: Again, please don't check the box below
options:
- label: I'm aware that new issues on GitHub will be ignored and automatically closed.
required: true
- type: markdown
attributes:
value: |
---
感谢您选择 Flink CDC!

由于 Apache Flink 的要求,请在 [Apache Jira](https://issues.apache.org/jira) 的 `Flink` 项目下使用 `Flink CDC` 标签来反馈缺陷或新功能。
您需要登录 Jira 帐户才能创建 issue 去记录缺陷或新功能,如果您没有 Apache JIRA 账号,您可以在 [ASF Jira 账号](https://selfserve.apache.org/jira-account.html)
申请账号,账号创建会由申请项目的 PMC member 审核,通常一到两个工作日可以通过。

您也可以在 Apache Flink 的开发者邮件列表([email protected])中对技术问题发起讨论。

如果您有关于使用 Flink CDC 的问题,请在 Flink 用户邮件列表([email protected])中咨询。

请注意,在此创建的 GitHub issue 会被**忽略且自动关闭**。
- type: checkboxes
attributes:
label: 请不要勾选以下选项
options:
- label: 我已知悉缺陷和新功能需要在 [Apache Jira](https://issues.apache.org/jira) 或 Flink 邮件列表([email protected])中反馈,而不是在这里创建新 issue。
required: true
- type: checkboxes
attributes:
label: 也请不要勾选以下选项
options:
- label: 我已知悉 GitHub 上的新 issue 会被忽略且自动关闭。
required: true
1 change: 1 addition & 0 deletions .github/actions/get-workflow-origin
Submodule get-workflow-origin added at 1b5a8a
1 change: 1 addition & 0 deletions .github/actions/label-when-approved-action
88 changes: 88 additions & 0 deletions .github/labeler.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,88 @@
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
# Pull Request Labeler Github Action Configuration: https://github.com/marketplace/actions/labeler

build:
- .github/**/*
- .idea/**/*
- tools/**/*
- .gitignore
- azure-pipelines.yml
- pom.xml
docs:
- docs/**/*
- README.md
cli:
- flink-cdc-cli/**/*
common:
- flink-cdc-common/**/*
composer:
- flink-cdc-composer/**/*
dist:
- flink-cdc-dist/**/*
runtime:
- flink-cdc-runtime/**/*
e2e-tests:
- flink-cdc-e2e-tests/**/*
migration-tests:
- flink-cdc-migration-tests/**/*
base:
- flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/**/*
debezium:
- flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-debezium/**/*
connector-test-util:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-test-util/**/*
db2-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-db2-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-db2-cdc/**/*
mongodb-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mongodb-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-mongodb-cdc/**/*
mysql-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-mysql-cdc/**/*
oceanbase-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-oceanbase-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-oceanbase-cdc/**/*
oracle-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-oracle-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-oracle-cdc/**/*
postgres-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-postgres-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-postgres-cdc/**/*
sqlserver-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-sqlserver-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-sqlserver-cdc/**/*
tidb-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-tidb-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-tidb-cdc/**/*
vitess-cdc-connector:
- flink-cdc-connect/flink-cdc-source-connectors/flink-connector-vitess-cdc/**/*
- flink-cdc-connect/flink-cdc-source-connectors/flink-sql-connector-vitess-cdc/**/*
values-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-values/**/*
mysql-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-mysql/**/*
paimon-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/**/*
kafka-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-kafka/**/*
doris-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-doris/**/*
starrocks-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-starrocks/**/*
elasticsearch-pipeline-connector:
- flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-elasticsearch/**/*
Loading