Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

br: volume-snapshot may lead to a panic when there is no block change between two snapshot #4922

Merged
merged 9 commits into from
Mar 7, 2023

Conversation

fengou1
Copy link
Contributor

@fengou1 fengou1 commented Mar 7, 2023

What problem does this PR solve?

Closes #4921

What is changed and how does it work?

remove data change rate since it always 1 from test result and may lead to a panic if there is no block change between two snapshot

Code changes

  • Has Go code change
  • Has CI related scripts change

Tests

  • Unit test

  • E2E test

  • Manual test

  • create an empty cluster

  • take 6 snapshots within short time

  • ensure snapshot incremental block is 0

  • check backup result
    PNvdh8dCEh

  • No code

Side effects

  • Breaking backward compatibility
  • Other side effects:

Related changes

  • Need to cherry-pick to the release branch
  • Need to update the documentation

Release Notes

Please refer to Release Notes Language Style Guide before writing the release note.


@ti-chi-bot
Copy link
Member

ti-chi-bot commented Mar 7, 2023

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • WangLe1321
  • WizardXiao

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@fengou1 fengou1 self-assigned this Mar 7, 2023
@fengou1 fengou1 changed the title br: volume-snapshot may led to a panic when there is no block change between two snapshot br: volume-snapshot may lead to a panic when there is no block change between two snapshot Mar 7, 2023
@codecov-commenter
Copy link

codecov-commenter commented Mar 7, 2023

Codecov Report

Merging #4922 (29e36e0) into master (9f5c437) will increase coverage by 4.49%.
The diff coverage is 0.00%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #4922      +/-   ##
==========================================
+ Coverage   59.07%   63.57%   +4.49%     
==========================================
  Files         227      231       +4     
  Lines       26277    29438    +3161     
==========================================
+ Hits        15524    18714    +3190     
+ Misses       9259     9130     -129     
- Partials     1494     1594     +100     
Flag Coverage Δ
e2e 35.26% <ø> (?)
unittest 59.08% <0.00%> (+<0.01%) ⬆️

@fengou1
Copy link
Contributor Author

fengou1 commented Mar 7, 2023

/test pull-e2e-kind-across-kubernetes pull-e2e-kind-basic pull-e2e-kind-serial pull-e2e-kind-tngm

@fengou1
Copy link
Contributor Author

fengou1 commented Mar 7, 2023

/test pull-e2e-kind

@fengou1
Copy link
Contributor Author

fengou1 commented Mar 7, 2023

/test pull-e2e-kind-serial

@fengou1
Copy link
Contributor Author

fengou1 commented Mar 7, 2023

/merge

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: 29e36e0

@ti-chi-bot ti-chi-bot merged commit 650fb7a into pingcap:master Mar 7, 2023
WizardXiao pushed a commit to WizardXiao/tidb-operator that referenced this pull request Mar 10, 2023
WizardXiao added a commit that referenced this pull request Mar 11, 2023
* feat: support tiflash backup and restore during volume snapshot (#4812)

* feat: calc the backup size from snapshot storage usage (#4819)

* fix backup failed when pod was auto restarted by k8s (#4883)

* init code for test

* just clean before backup data

* delete test code

* import pingcap/errors

* add check version

* remove test code

* add running status check

* add restart condition to clarify logic

* fix status update

* fix ut

* br: ensure pvc names sequential for ebs restore (#4888)

* BR: Restart backup when backup job/pod unexpected failed by k8s (#4895)

* init code for test

* just clean before backup data

* delete test code

* import pingcap/errors

* add check version

* remove test code

* add running status check

* add restart condition to clarify logic

* fix status update

* fix ut

* init code

* update crd reference

* fix miss update retry count

* add retry limit as constant

* init runnable code

* refine main controller logic

* add some note

* address some comments

* init e2e test code

* add e2e env to extend backup time

* add e2e env for test

* fix complie

* just test kill pod

* refine logic

* use pkill to kill pod

* fix reconcile

* add kill pod log

* add more log

* add more log

* try kill pod only

* wait and kill running backup pod

* add wait for pod failed

* fix wait pod running

* use killall backup to kill pod

* use pkill -9 backup

* kill pod until pod is failed

* add ps to debug

* connect commands by semicolon

* kill pod by signal 15

* use panic simulate kill pod

* test all kill pod test

* remove useless log

* add original reason of job or pod failure

* rename BackupRetryFailed to BackupRetryTheFailed

* BR: Auto truncate log backup in backup schedule (#4904)

* init schedule log backup code

* add run log backup code

* update api

* refine some nodes

* refine cacluate logic

* add ut

* fix make check

* add log backup test

* refine code

* fix notes

* refine function names

* fix conflict

* fix: add a new check for encryption during the volume snapshot restore (#4914)

* br: volume-snapshot may lead to a panic when there is no block change between two snapshot (#4922)

* br: refine BackoffRetryPolicy time format (#4925)

* refine BackoffRetryPolicy time format

* fix some ut

---------

Co-authored-by: fengou1 <[email protected]>
Co-authored-by: WangLe1321 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

br: volume snapshot backup panic when calc backup size
5 participants