Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance drops dramatically in controller mode when transientStorePoolEnable=true #5751

Closed
riki-wang opened this issue Dec 21, 2022 · 9 comments
Labels

Comments

@riki-wang
Copy link

riki-wang commented Dec 21, 2022

  1. Problem
    Broker在自动故障转移模式下,设置transientStorePoolEnable=true导致benchmark性能测试急剧下降

    • transientStorePoolEnable=true测试性能
      image

    • transientStorePoolEnable=false测试性能
      image

  2. Environment

    • RocketMQ 5.0 1Master-1Slave Dledger Controller Mode
    • broker配置
      brokerClusterName = DefaultCluster
      brokerName = broker-a
      brokerId = -1
      deleteWhen = 04
      fileReservedTime = 12
      enableControllerMode = true
      namesrvAddr = 10.110.150.106:9876;10.110.150.107:9876;10.110.150.108:9876
      controllerAddr = 10.110.150.106:59878;10.110.150.107:59878;10.110.150.108:59878
      allAckInSyncStateSet = true
    
      flushDiskType = ASYNC_FLUSH
    
      transientStorePoolEnable=true
      transientStorePoolSize=3
    
      listenPort = 59011
    
      storePathRootDir=/home/data/rocketmq/broker-a/store
      storePathIndex=/home/data/rocketmq/broker-a/store/index
      storeCheckpoint=/home/data/rocketmq/broker-a/store/checkpoint
      abortFile=/home/data/rocketmq/broker-a/store/abort
      storePathCommitLog=/home/data/rocketmq/broker-a/store/commitlog
      storePathConsumerQueue=/home/data/rocketmq/broker-a/store/consumequeue
      storePathEpochFile=/home/data/rocketmq/broker-a/store/storePathEpochFile
    
@mxsm
Copy link
Member

mxsm commented Dec 22, 2022

Hi @riki-wang
image
image
Little performance impact

@riki-wang
Copy link
Author

riki-wang commented Dec 22, 2022

Hi @riki-wang image image Little performance impact
首次启动会有这个问题,而且是要在controller模式下,1master-1slave

@mxsm
Copy link
Member

mxsm commented Dec 22, 2022

Hi @riki-wang image image Little performance impact
首次启动会有这个问题,而且是要在controller模式下,1master-1slave

我试下首次启动,我上面的模式就是Controller的A-HA的自主切换模式。
image

@mxsm
Copy link
Member

mxsm commented Dec 22, 2022

@riki-wang
image

image

When first start on controller model, broker has performance impact.
I will try to find it and fix.
thanks for you catch.

@RongtongJin
Copy link
Contributor

Hi @riki-wang, the issue of enabling transientStorePool in controller mode is still fixed in #5722 . After the repair is completed, we can continue to test.

@riki-wang
Copy link
Author

Hi @riki-wang, the issue of enabling transientStorePool in controller mode is still fixed in #5722 . After the repair is completed, we can continue to test.

本来是准备给生产环境引入自动故障转移的,就突然测出这个性能bug了

@RongtongJin
Copy link
Contributor

RongtongJin commented Dec 22, 2022

Hi @riki-wang PR #5722 has fixed it. You can try this PR code.

@Oliverwqcwrw
Copy link
Member

close as fixed

@riki-wang
Copy link
Author

Rocketmq v5.1.0 still has this issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants