Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to migrate cluster slot by raw write batch #2067

Merged
merged 8 commits into from
Jan 31, 2024

Conversation

caipengbo
Copy link
Contributor

@caipengbo caipengbo commented Jan 28, 2024

This PR implemented the cluster slot migration by the rocksdb write batch, which will bring performance benefits. Also, we don't need to depend on parsing commands from the write batch log data if enabled. This makes the cluster migration feature more robust since we don't have to take care of the log data in each write batch.

This closes #2008 and the original PR is #1534

src/storage/storage.h Outdated Show resolved Hide resolved
src/cluster/slot_migrate.cc Outdated Show resolved Hide resolved
@caipengbo caipengbo marked this pull request as ready for review January 29, 2024 14:08
@git-hulk
Copy link
Member

@caipengbo Great! Overall is quite clear and concise. Just a few questions inline.

@caipengbo
Copy link
Contributor Author

Just a few questions inline.

I have modified the question you mentioned before. Are there any other questions? @git-hulk

src/cluster/slot_migrate.cc Show resolved Hide resolved
src/cluster/slot_migrate.cc Show resolved Hide resolved
@git-hulk
Copy link
Member

@caipengbo Sorry for didn't send out the comments. 😭

git-hulk
git-hulk previously approved these changes Jan 30, 2024
Copy link
Member

@git-hulk git-hulk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@git-hulk git-hulk changed the title Add raw-key-value migration type Allow to migrate cluster slot by raw write batch Jan 30, 2024
Copy link

sonarcloud bot commented Jan 30, 2024

Quality Gate Passed Quality Gate passed

The SonarCloud Quality Gate passed, but some issues were introduced.

26 New issues
0 Security Hotspots
61.8% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

@git-hulk git-hulk merged commit 6eb8018 into apache:unstable Jan 31, 2024
30 checks passed
@git-hulk git-hulk mentioned this pull request Feb 24, 2024
2 tasks
JoverZhang pushed a commit to JoverZhang/kvrocks that referenced this pull request Feb 24, 2024
This PR implemented the cluster slot migration by the rocksdb write batch,
which will bring performance benefits. Also, we don't need to depend on
parsing commands from the write batch log data if enabled. This makes the
cluster migration feature more robust since we don't have to take care
of the log data in each write batch.

This closes apache#2008
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement the new migration type by applying raw batch
2 participants