Skip to content
This repository has been archived by the owner on Apr 1, 2024. It is now read-only.

Bump pulsar version to 3.1.0-SNAPSHOT #5878

Closed
wants to merge 21 commits into from

Commits on Aug 15, 2023

  1. Configuration menu
    Copy the full SHA
    9127d89 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2023

  1. [fix][io] Update test certs for Elasticsearch (apache#21001)

    Fixes: apache#20997 
    
    ### Motivation
    
    Update the expired certs to get tests passing.
    
    ### Modifications
    
    * Update all certs. See `README.md` in files for detailed steps.
    
    ### Verifying this change
    
    This change is covered by tests.
    
    ### Documentation
    
    - [x] `doc-not-needed`
    michaeljmarshall authored Aug 16, 2023
    Configuration menu
    Copy the full SHA
    d6734b7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d014713 View commit details
    Browse the repository at this point in the history
  3. [feat][io] Support configuration secret interpolation (apache#20901)

    PIP: apache#20903
    Relates to: apache#20862 
    
    ### Motivation
    
    The primary motivation is to make it possible to configure Pulsar Connectors in a secure, non-plaintext way. See the PIP for background and relevant details. The new interpolation feature only applies when deploying with functions to Kubernetes.
    
    ### Modifications
    
    * Add `SecretsProvider#interpolateSecretForValue` method with a default that maintains the current behavior.
    * Override `interpolateSecretForValue` in the `EnvironmentBasedSecretsProvider` so that configuration values formatted as `${my-env-var}` will be replaced with the result of `System.getEnv("my-env-var")` if the result is not `null`.
    * Implement a recursive string interpolation method that will replace any configuration value that the `interpolateSecretForValue` implementation determines ought to be replaced.
    
    ### Verifying this change
    
    Tests are added/modified.
    
    ### Documentation
    
    - [x] `doc-required`
    
    ### Matching PR in forked repository
    
    PR in forked repository: michaeljmarshall#55
    michaeljmarshall authored Aug 16, 2023
    Configuration menu
    Copy the full SHA
    bfde0de View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0cb1c78 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2023

  1. Configuration menu
    Copy the full SHA
    4a9fec6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3160b76 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4facdad View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2023

  1. Configuration menu
    Copy the full SHA
    0daa46d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d06cda6 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2023

  1. Configuration menu
    Copy the full SHA
    00ca6aa View commit details
    Browse the repository at this point in the history
  2. [fix] [admin] Fix get topic stats fail if a subscription catch up con…

    …currently (apache#20971)
    
    ### Motivation
    
    **Background**: when calling `pulsar-admin topics stats --get-earliest-time-in-backlog <topic name>`, Pulsar will read the first entry which is not acknowledged, and respond with the entry write time. The flow is like this:
    - get the mark deleted position of the subscription
    - if no backlog, response `-1`
    - else read the next position of the mark deleted position, and respond with the entry write time.
    
    **Issue**: if the command `pulsar-admin topics stats --get-earliest-time-in-backlog <topic name>` and `consumer.acknowledge` are executed at the same time, the step 2 in above flow will get a position which is larger than the last confirmed position, lead a read entry error.
    
    | time | `pulsar-admin topics stats --get-earliest-time-in-backlog <topic name>` | `consumer.acknowledge` |
    | --- | --- | --- |
    | 1 | mark deleted position is `3:1` and LAC is `3:2` now |
    | 2 | the check `whether has backlog` is passed |
    | 3 | | acknowledged `3:2`, mark deleted position is `3:2` now |
    | 4 | calculate next position: `3:3` |
    | 5 | Read `3:3` and get an error: `read entry failed` |
    
    Note: the test in PR is not intended to reproduce the issue.
    
    ### Modifications
    
    Respond `-1` if the next position of the mark deleted position is larger than the LAC
    poorbarcode authored Aug 20, 2023
    Configuration menu
    Copy the full SHA
    7c96a36 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2023

  1. Configuration menu
    Copy the full SHA
    deeb8a2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    976a580 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f2f0bf4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    dbbaddb View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    43cd86d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    3eb9610 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    0d25e9a View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    ee91edc View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    e8e7b88 View commit details
    Browse the repository at this point in the history