Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve][broker] Sync commits from apache/pulsar branch-3.0 (15th May) into 3.1_ds #265

Merged
merged 48 commits into from
May 16, 2024

Commits on May 10, 2024

  1. [fix][broker] Fix BufferOverflowException and EOFException bugs in /m…

    …etrics gzip compression (apache#22576)
    
    (cherry picked from commit 997c8b9)
    (cherry picked from commit fe05e08)
    lhotari authored and nikhil-ctds committed May 10, 2024
    Configuration menu
    Copy the full SHA
    bc68ec9 View commit details
    Browse the repository at this point in the history
  2. [improve][meta] Log a warning when ZK batch fails with connectionloss (

    …apache#22566)
    
    (cherry picked from commit 69839c7)
    (cherry picked from commit 701d4cf)
    lhotari authored and nikhil-ctds committed May 10, 2024
    Configuration menu
    Copy the full SHA
    ccdb8fb View commit details
    Browse the repository at this point in the history
  3. [improve][broker] Propagate cause exception in TopicBusyException whe…

    …n applicable (apache#22596)
    
    (cherry picked from commit 3b9602c)
    (cherry picked from commit d00d715)
    lhotari authored and nikhil-ctds committed May 10, 2024
    Configuration menu
    Copy the full SHA
    2b6bb22 View commit details
    Browse the repository at this point in the history
  4. [fix][test] Flaky-test: ManagedLedgerTest.testTimestampOnWorkingLedger (

    apache#22600)
    
    (cherry picked from commit 5d9ccd4)
    (cherry picked from commit bfdbd20)
    shibd authored and nikhil-ctds committed May 10, 2024
    Configuration menu
    Copy the full SHA
    0df1b33 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. [fix][io] CompressionEnabled didn't work on elasticsearch sink (apach…

    …e#22565)
    
    (cherry picked from commit a3cd1f8)
    (cherry picked from commit e3bd58c)
    shibd authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    e9a0c2a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6d5a19b View commit details
    Browse the repository at this point in the history
  3. [fix][admin] Fix namespace admin api exception response (apache#22587)

    (cherry picked from commit f25776d)
    (cherry picked from commit 5ffec8a)
    coderzc authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    a9afad2 View commit details
    Browse the repository at this point in the history
  4. [fix][test] Fix resource leak in TransactionCoordinatorClientTest (ap…

    …ache#21380)
    
    (cherry picked from commit cb7c98a)
    (cherry picked from commit 8ecfd64)
    lhotari authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    efa332c View commit details
    Browse the repository at this point in the history
  5. [fix][test] Clear fields in test cleanup to reduce memory consumption (

    …apache#22583)
    
    (cherry picked from commit 3de14c5)
    (cherry picked from commit 72833fe)
    lhotari authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    f7f7c04 View commit details
    Browse the repository at this point in the history
  6. [fix][broker] Reader stuck after call hasMessageAvailable when enable…

    … replicateSubscriptionState (apache#22572)
    
    (cherry picked from commit a761b97)
    (cherry picked from commit 1dacca5)
    shibd authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    2fe3349 View commit details
    Browse the repository at this point in the history
  7. [fix][test] Fix the flaky tests of ManagedLedgerImplUtilsTest (apache…

    …#22611)
    
    (cherry picked from commit 264722f)
    (cherry picked from commit f4de79a)
    codelipenghui authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    c7e5ec4 View commit details
    Browse the repository at this point in the history
  8. [fix] [broker] Fix metrics pulsar_topic_load_failed_count is 0 when l…

    …oad non-persistent topic fails and fix the flaky test testBrokerStatsTopicLoadFailed (apache#22580)
    
    (cherry picked from commit 340d60d)
    (cherry picked from commit 053c455)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    ab5474d View commit details
    Browse the repository at this point in the history
  9. [cleanup] [test] Cleanup unnecessary imports

    (cherry picked from commit fd823f6)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    78354c1 View commit details
    Browse the repository at this point in the history
  10. [fix] [ml] Mark delete stuck due to switching cursor ledger fails (ap…

    …ache#22662)
    
    (cherry picked from commit a7e1fcd)
    (cherry picked from commit bfd4153)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    f89facf View commit details
    Browse the repository at this point in the history
  11. [fix] [broker] Part-1: Replicator can not created successfully due to…

    … an orphan replicator in the previous topic owner (apache#21946)
    
    (cherry picked from commit 4924052)
    (cherry picked from commit 670aff0)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    493385f View commit details
    Browse the repository at this point in the history
  12. [improve] [broker] Create partitioned topics automatically when enabl…

    …e topic level replication (apache#22537)
    
    (cherry picked from commit d475655)
    (cherry picked from commit 076b55e)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    0b6ec1b View commit details
    Browse the repository at this point in the history
  13. [fix] [broker] Part-2: Replicator can not created successfully due to…

    … an orphan replicator in the previous topic owner (apache#21948)
    
    (cherry picked from commit b774666)
    (cherry picked from commit 6038bbf)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    27d3caf View commit details
    Browse the repository at this point in the history
  14. [fix][broker] One topic can be closed multiple times concurrently (ap…

    …ache#17524)
    
    (cherry picked from commit 93afd89)
    (cherry picked from commit 620fe9b)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    33570f5 View commit details
    Browse the repository at this point in the history
  15. [fix] [test] Fix flaky test ReplicatorTest (apache#22594)

    (cherry picked from commit 6fdc0e3)
    (cherry picked from commit 9242f33)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    24b3751 View commit details
    Browse the repository at this point in the history
  16. [fix] [broker] Fix nothing changed after removing dynamic configs (ap…

    …ache#22673)
    
    (cherry picked from commit ada31a9)
    (cherry picked from commit f2c4367)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    b575da4 View commit details
    Browse the repository at this point in the history
  17. [fix][offload] Fix OOM in tiered storage, caused by unbounded offsets…

    … cache (apache#22679)
    
    Co-authored-by: Jiwe Guo <[email protected]>
    (cherry picked from commit 566330c)
    (cherry picked from commit f091bcb)
    lhotari authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    2367f1c View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    89cab16 View commit details
    Browse the repository at this point in the history
  19. [fix][broker] Fix typos lister -> listener (apache#21068)

    (cherry picked from commit e0c481e)
    (cherry picked from commit 9b13730)
    Masahiro Sakamoto authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    471ec48 View commit details
    Browse the repository at this point in the history
  20. [fix] [broker] Fix configurationMetadataSyncEventTopic is marked supp…

    …orting dynamic setting, but not implemented (apache#22684)
    
    (cherry picked from commit ff4853e)
    (cherry picked from commit 03da743)
    poorbarcode authored and nikhil-ctds committed May 13, 2024
    Configuration menu
    Copy the full SHA
    12c3055 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    a0930b4 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    3ace109 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. [fix][broker] usedLocallySinceLastReport should always be reset (apac…

    …he#22672)
    
    Signed-off-by: Zixuan Liu <[email protected]>
    (cherry picked from commit 8f015d8)
    (cherry picked from commit 6b68a8d)
    nodece authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    36bc126 View commit details
    Browse the repository at this point in the history
  2. [improve] [log] Print source client addr when enabled haProxyProtocol…

    …Enabled (apache#22686)
    
    (cherry picked from commit d77c5de)
    (cherry picked from commit b178084)
    poorbarcode authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    c4e3c7c View commit details
    Browse the repository at this point in the history
  3. [fix][io] Fix es index creation (apache#22654) (apache#22701)

    Signed-off-by: Zixuan Liu <[email protected]>
    (cherry picked from commit f1daa75)
    nodece authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    6d4f606 View commit details
    Browse the repository at this point in the history
  4. [fix][broker] Avoid being stuck when closing the broker with extensib…

    …le load manager (apache#22573)
    
    (cherry picked from commit f411e3c)
    (cherry picked from commit db43414)
    BewareMyPower authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    e10220c View commit details
    Browse the repository at this point in the history
  5. [fix][fn]make sure the classloader for ContextImpl is `functionClassL…

    …oader` in different runtimes (apache#22501)
    
    (cherry picked from commit d067efc)
    (cherry picked from commit d23c77b)
    freeznet authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    8fda0a9 View commit details
    Browse the repository at this point in the history
  6. [fix][sec] Upgrade aws-sdk.version to avoid CVE-2024-21634 (apache#22633

    )
    
    (cherry picked from commit bc44280)
    (cherry picked from commit 04c429c)
    nikhilerigila09 authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    f0f5448 View commit details
    Browse the repository at this point in the history
  7. [fix] [client] Fix Consumer should return configured batch receive ma…

    …x messages (apache#22619)
    
    (cherry picked from commit 0219921)
    (cherry picked from commit 29ee145)
    rdhabalia authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    bcfcb5c View commit details
    Browse the repository at this point in the history
  8. [fix][sec] Upgrade elasticsearch-java version to avoid CVE-2023-4043 (a…

    …pache#22640)
    
    (cherry picked from commit 3ca4ddf)
    (cherry picked from commit 46d8022)
    nikhilerigila09 authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    609cf9e View commit details
    Browse the repository at this point in the history
  9. [fix][storage] ReadonlyManagedLedger initialization does not fill in …

    …the properties (apache#22630)
    
    (cherry picked from commit eee3694)
    (cherry picked from commit 91f4287)
    gvanyao authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    39c05f0 View commit details
    Browse the repository at this point in the history
  10. [fix][test] Clear MockedPulsarServiceBaseTest fields to prevent test …

    …runtime memory leak (apache#22659)
    
    (cherry picked from commit 025354e)
    (cherry picked from commit 13f0aae)
    lhotari authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ee7c61b View commit details
    Browse the repository at this point in the history
  11. [fix] Fix Reader can be stuck from transaction aborted messages. (apa…

    …che#22610)
    
    (cherry picked from commit 7e88463)
    (cherry picked from commit f516a85)
    dao-jun authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    d38cc54 View commit details
    Browse the repository at this point in the history
  12. [fix][broker] Disable system topic message deduplication (apache#22582)

    (cherry picked from commit 5ff0fb9)
    (cherry picked from commit 34ce38e)
    mattisonchao authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    90d0dac View commit details
    Browse the repository at this point in the history
  13. [improve][ws] Add memory limit configuration for Pulsar client used i…

    …n Websocket proxy (apache#22666)
    
    (cherry picked from commit 80d4675)
    (cherry picked from commit e5515c5)
    lhotari authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    52a401e View commit details
    Browse the repository at this point in the history
  14. [fix][broker] avoid offload system topic (apache#22497)

    Co-authored-by: 道君 <[email protected]>
    (cherry picked from commit 3114199)
    (cherry picked from commit 20483f5)
    mattisonchao authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    f8d5a5b View commit details
    Browse the repository at this point in the history
  15. [fix][broker] Fix ProducerBusy issue due to incorrect userCreatedProd…

    …ucerCount on non-persistent topic (apache#22685)
    
    Co-authored-by: ruihongzhou <[email protected]>
    (cherry picked from commit 253e650)
    (cherry picked from commit 89b545e)
    hrzzzz authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    55be42e View commit details
    Browse the repository at this point in the history
  16. [fix][client] Fix ReaderBuilder doest not give illegalArgument on con…

    …nection failure retry (apache#22639)
    
    (cherry picked from commit b56f238)
    (cherry picked from commit 8b2d5e9)
    rdhabalia authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    7a0c4df View commit details
    Browse the repository at this point in the history
  17. [fix][sec] Upgrade postgresql version to avoid CVE-2024-1597 (apache#…

    …22635)
    
    (cherry picked from commit 2cfd959)
    (cherry picked from commit cea5409)
    nikhilerigila09 authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ccca9a0 View commit details
    Browse the repository at this point in the history
  18. [fix] [broker] rename to changeMaxReadPositionCount (apache#22656)

    (cherry picked from commit 5ab0512)
    (cherry picked from commit 1cf6a72)
    thetumbled authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    b2ed011 View commit details
    Browse the repository at this point in the history
  19. [fix][broker] fix replicated subscriptions for transactional messages (

    …apache#22452)
    
    (cherry picked from commit 9fd1b61)
    (cherry picked from commit e300fbd)
    thetumbled authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    d7b24e9 View commit details
    Browse the repository at this point in the history
  20. [fix][test] Fix NPE in BookKeeperClusterTestCase tearDown (apache#22493)

    (cherry picked from commit d174857)
    (cherry picked from commit 4bb0d81)
    lhotari authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    462f806 View commit details
    Browse the repository at this point in the history
  21. [improve][ci][branch-3.0] Upgrade actions in pulsar-ci and pulsar-ci-…

    …flaky, port owasp cache change
    
    (cherry picked from commit db40c8f)
    lhotari authored and nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ce93e19 View commit details
    Browse the repository at this point in the history
  22. fix checkstyle errors

    nikhil-ctds committed May 15, 2024
    Configuration menu
    Copy the full SHA
    eb3d5b0 View commit details
    Browse the repository at this point in the history