Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ISSUE #7064] [RIP-66-2] Support KV(RocksDB) Storage for ConsumeQueue #7120

Merged
merged 87 commits into from
Oct 14, 2023

Conversation

fujian-zfj
Copy link
Contributor

Which Issue(s) This PR Fixes
Fixes #7064

Brief Description
This proposal mainly optimizes and solves the existing perfermance problems in the million-topic scenario from two levels:

  1. Metadata like topic, subscription, consumerOffset implement kv storage
  2. ConsumeQueue index file implements kv storage

@fujian-zfj fujian-zfj changed the title Develop consumequeue rocksdb [ISSUE #7064] [RIP-66-2] Support KV(RocksDB) Storage for ConsumeQueue Aug 5, 2023
fujian-zfj and others added 5 commits September 7, 2023 00:32
# Conflicts:
#	broker/src/main/java/org/apache/rocketmq/broker/BrokerController.java
#	common/src/main/java/org/apache/rocketmq/common/config/AbstractRocksDBStorage.java
#	store/src/main/java/org/apache/rocketmq/store/DefaultMessageStore.java
#	store/src/main/java/org/apache/rocketmq/store/queue/ConsumeQueueStore.java
RongtongJin
RongtongJin previously approved these changes Sep 15, 2023
RongtongJin
RongtongJin previously approved these changes Oct 13, 2023
Copy link
Contributor

@DongyuanPan DongyuanPan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@RongtongJin RongtongJin merged commit f565654 into apache:develop Oct 14, 2023
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[RIP-66] Support KV(Rocksdb) Storage
6 participants