Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lightning: allocate autoid globally across all tidb instances #35904

Closed
sleepymole opened this issue Jul 4, 2022 · 0 comments · Fixed by #35905
Closed

lightning: allocate autoid globally across all tidb instances #35904

sleepymole opened this issue Jul 4, 2022 · 0 comments · Fixed by #35905
Assignees
Labels
component/lightning This issue is related to Lightning of TiDB. type/enhancement The issue or PR belongs to an enhancement.

Comments

@sleepymole
Copy link
Contributor

sleepymole commented Jul 4, 2022

Enhancement

We are discussing the local backend below.

In #35148, we supported disabling pd scheduler by key range, so that we can import data to a table without significant impact on other tables which are used by online services.

Further, we want to support partition-level online import. That is to say, lightning can import data to a specific partition. Meanwhile, any read/write operations to other partitions on the same table are allowed and safe. There is no data loss or data corruption. To achieve this goal, we must avoid any autoid conflicts, because lightning bypasses the transaction layer, and any write conflicts will be ignored silently.

@sleepymole sleepymole added type/enhancement The issue or PR belongs to an enhancement. component/lightning This issue is related to Lightning of TiDB. labels Jul 4, 2022
@sleepymole sleepymole self-assigned this Jul 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/lightning This issue is related to Lightning of TiDB. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant