-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Towards Flink CDC 3.0 #2600
Comments
Hi @PatrickRen , I can collaborate with you on the subtasks of |
Hi All, |
Hi, maverck, we don't have a plan to dump debezium version yet, but this should happen soon, currently we‘re busy on the 3.0 version whose position is the end-to-end steaming ELT framework. |
Hi @leonardBang, |
Hey, maver1ck |
Hi @leonardBang |
Close this issue as all subtasks finished, will kickoff 3.1 version soon |
sink type mysql error Exception in thread "main" java.lang.RuntimeException: Cannot find factory with identifier "mysql" in the classpath. Available factory classes are: com.ververica.cdc.connectors.mysql.factory.MySqlDataSourceFactory |
sink mysql demo error : Cannot find factory with identifier "mysql" in the classpath |
Have you finished this issue? I encountered this too |
Hi @Jiang-HT @KiwiGeorge We don't support MySQL as data sink now, and current support data sinks are |
I see there is source code in the project, so... when will you support mysql as data sink? |
Do you support Kafka as a data sink? Available factory classes are: com.ververica.cdc.connectors.mysql.factory.MySqlDataSourceFactory |
Hi @shreelatak, Kafka pipeline connector is supported in Flink CDC 3.1. However, it's a breaking update and package names like |
Hello @yuxiqian , thank you so much for the revert! Do you know which supporting mysql-cdc connector I can find for Flink CDC version 3.1, and where? My yaml file has the below contents:
With the previous Flink CDC version (3.0.1) and connector [flink-cdc-pipeline-connector-mysql-3.0.0.jar], I encountered no issues. Now since having upgraded the Flink CDC (to 3.1) I am facing :
|
Connectors are now released under Group ID P.S. It is preferred to share Flink CDC related issues on GitHub Discussions or Flink JIRA Kanban. |
do you has solve this problem? I encountered this too |
|
@lvyanquan I am also getting this error when using mysql as a source.
I am having a little confusion because I followed this guide exactly - https://nightlies.apache.org/flink/flink-cdc-docs-master/docs/get-started/quickstart/mysql-to-starrocks/ This doc uses flink-1.18 and flick-cdc-3.1.0 @shreelatak Were you able to get the demo to work with flink-cdc-3.1.0? |
Motivation
Provide a user-friendly, end-to-end streaming ELT framework for Data integration users.
Solution
The design docs by Flink CDC maintainers as following:
Umbrella tasks for each module
[prepare and mis]
[module] flink-cdc-common
[module] flink-cdc-cli
[module] flink-cdc-composer
[module] flink-cdc-runtime
[module] flink-cdc-dist
[module] flink-cdc-connect/flink-cdc-pipeline-connectors
[module] Docs for cdc 3.0 pipeline
Shared Utilities
The text was updated successfully, but these errors were encountered: