Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

lightning: scatter region timeout when importing a single table with 4.8T data #33618

Closed
sleepymole opened this issue Mar 31, 2022 · 1 comment · Fixed by #33625
Closed

lightning: scatter region timeout when importing a single table with 4.8T data #33618

sleepymole opened this issue Mar 31, 2022 · 1 comment · Fixed by #33625
Assignees
@sleepymole
Labels
affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects 5.4.x versions. affects-6.0 component/lightning This issue is related to Lightning of TiDB. severity/major type/bug The issue is confirmed as a bug.

Comments

@sleepymole
Copy link
Contributor

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Use lightning to import a single table with 4.8T data.

2. What did you expect to see? (Required)

Imported successfully.

3. What did you see instead (Required)

All data is imported to three TiKV nodes. And Lightning exited with error like "The available disk of TiKV (xxx) only left xxx and capacity is xxx"

4. What is your TiDB-Lightning version? (Required)

v5.4.0
@sleepymole sleepymole added the type/bug The issue is confirmed as a bug. label Mar 31, 2022
@sleepymole sleepymole self-assigned this Mar 31, 2022
@sleepymole sleepymole added component/lightning This issue is related to Lightning of TiDB. severity/major labels Mar 31, 2022
@ti-chi-bot ti-chi-bot added may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.0 labels Mar 31, 2022
@sleepymole sleepymole mentioned this issue Mar 31, 2022
Merged
4 tasks
@sleepymole sleepymole added affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects 5.4.x versions. affects-6.0 labels Mar 31, 2022
@ti-chi-bot ti-chi-bot removed may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-6.0 may-affects-5.4 This bug maybe affects 5.4.x versions. labels Mar 31, 2022
@sleepymole sleepymole removed may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. labels Mar 31, 2022
@D3Hunter
Copy link
Contributor

seems dup with #33446

ti-chi-bot pushed a commit that referenced this issue Apr 26, 2022
@sleepymole
lightning: split and scatter regions in batches (#33625)
2f2fa06 
close #33618
This was referenced Apr 26, 2022
Merged
Merged
Closed
@tiancaiamao tiancaiamao mentioned this issue May 7, 2022
Merged
@tiancaiamao tiancaiamao mentioned this issue May 7, 2022
Merged
14 tasks
ti-chi-bot pushed a commit that referenced this issue Jun 15, 2022
@ti-srebot
lightning: split and scatter regions in batches (#33625) (#34257)
0cbc12b 
close #33618
ti-chi-bot pushed a commit that referenced this issue Jun 27, 2022
@ti-srebot
lightning: split and scatter regions in batches (#33625) (#34258)
d6be910 
close #33618
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sleepymole sleepymole

Labels
affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects 5.4.x versions. affects-6.0 component/lightning This issue is related to Lightning of TiDB. severity/major type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

lightning: split and scatter regions in batches sleepymole/tidb
3 participants
@D3Hunter @sleepymole @ti-chi-bot