Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Source Connector: TiDB #10891

Closed
zhangyangyu opened this issue Mar 7, 2022 · 5 comments
Closed

New Source Connector: TiDB #10891

zhangyangyu opened this issue Mar 7, 2022 · 5 comments
Labels
area/connectors Connector related issues area/databases community new-connector team/db-dw-sources Backlog for Database and Data Warehouse Sources team

Comments

@zhangyangyu
Copy link
Contributor

Tell us about the new connector you’d like to have

Sources: TiDB

Describe the context around this new connector

TiDB ("Ti" stands for Titanium) is an open-source NewSQL database that supports Hybrid Transactional and Analytical Processing (HTAP) workloads. It is MySQL compatible and features horizontal scalability, strong consistency, and high availability. Besides OP deployment, it also has a DbaaS cloud service.

Currently, TiDB supportes moving data from/to several other systems like MySQL/Aurora/Kafka, but types are very limited. Embracing Airbyte could open more possibilities.

TiDB is MySQL-compatible why not directly use MySQL connector? It's compatible but not 100% compatible. For example it has a METRICS_SCHEMA builtin database we don't want to migrate. It also does not have MySQL binlog.

Describe the alternative you are considering or using

Nope.

Are you willing to submit a PR?

We are going to develop the connector ourselves.

@zhangyangyu zhangyangyu added area/connectors Connector related issues new-connector labels Mar 7, 2022
@Daemonxiao Daemonxiao mentioned this issue Mar 22, 2022
12 tasks
@bleonard bleonard added autoteam team/tse Technical Support Engineers labels Apr 26, 2022
@troyyyang
Copy link

do you know if the mysql destination works for TiDB?

@Daemonxiao
Copy link
Contributor

@troyyyang Since dbt-mysql used in mysql-destination is incompatible with TiDB, mysql-destination cannot be used for TiDB. Now TiDB has its own dbt-tidb. We will launch Airbyte tidb-destination in the future, and you can try it.

@troyyyang
Copy link

@Daemonxiao awesome to hear, I'll keep an eye out for the airbyte tidb destination!

@marcosmarxm marcosmarxm added area/databases team/databases and removed team/tse Technical Support Engineers autoteam labels Jun 13, 2022
@zhangyangyu
Copy link
Contributor Author

@troyyyang We've contributed the TiDB destination connection already!

@zhangyangyu
Copy link
Contributor Author

@marcosmarxm Any hints on how to get TiDB logo in this page? https://airbyte.com/connectors?connector-categories=databases

@grishick grishick added the team/db-dw-sources Backlog for Database and Data Warehouse Sources team label Sep 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/databases community new-connector team/db-dw-sources Backlog for Database and Data Warehouse Sources team
Projects
None yet
Development

No branches or pull requests

7 participants