Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DNM] support GetRegion via CSE sync_region API #745

Open
wants to merge 59 commits into
base: master
Choose a base branch
from

Commits on Mar 28, 2023

  1. refactor fanout logic of cse region client

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    97cea40 View commit details
    Browse the repository at this point in the history
  2. add todos about region info resp from cse

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    4da4647 View commit details
    Browse the repository at this point in the history
  3. support get store for CSEClient

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    7ab0132 View commit details
    Browse the repository at this point in the history
  4. update comment for cse test

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 28, 2023
    Configuration menu
    Copy the full SHA
    de2f0f4 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. remove logs

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    5bd7f71 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. Configuration menu
    Copy the full SHA
    4054b80 View commit details
    Browse the repository at this point in the history
  2. add store prober

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    05b48d2 View commit details
    Browse the repository at this point in the history
  3. fix compile

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    e05be61 View commit details
    Browse the repository at this point in the history
  4. remove logs

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    a9ad5f5 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. add cb for Fallback and CSEClient

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    e3a2ba2 View commit details
    Browse the repository at this point in the history
  2. goimports -w ./

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    70cc79e View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. introduce asyncBreaker for Fallback and CSEClient

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    f8201f7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e2fdd40 View commit details
    Browse the repository at this point in the history
  3. bump kvproto

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    ccbfa16 View commit details
    Browse the repository at this point in the history
  4. goimports -w ./

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    bca479e View commit details
    Browse the repository at this point in the history
  5. fix lint

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    f6b9f97 View commit details
    Browse the repository at this point in the history
  6. go mod tidy for integration tests

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    e8cf959 View commit details
    Browse the repository at this point in the history
  7. introduce EnableCSERegionClient for TiKVClient

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    8b68569 View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. refine interface comments and options

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    770e723 View commit details
    Browse the repository at this point in the history
  2. bump kvproto to master

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    01caebd View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. Configuration menu
    Copy the full SHA
    055f177 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Configuration menu
    Copy the full SHA
    e1b0313 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. fix encoding of mvcc get by key (#775)

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus authored Apr 20, 2023
    Configuration menu
    Copy the full SHA
    6de096c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    94baaf7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4011b67 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. add const label for metrics (#781)

    Signed-off-by: zeminzhou <[email protected]>
    zeminzhou authored Apr 26, 2023
    Configuration menu
    Copy the full SHA
    f53c17d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fcf9595 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. Configuration menu
    Copy the full SHA
    716c8a5 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. Configuration menu
    Copy the full SHA
    4d2f943 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. *: Add GetMinTS (#801)

    rleungx authored May 17, 2023
    Configuration menu
    Copy the full SHA
    31152f5 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. Configuration menu
    Copy the full SHA
    d5baf4c View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. Configuration menu
    Copy the full SHA
    a2f93a3 View commit details
    Browse the repository at this point in the history
  2. cse: catch up master (#810)

    Co-authored-by: MyonKeminta <[email protected]>
    Co-authored-by: disksing <[email protected]>
    Co-authored-by: MyonKeminta <[email protected]>
    Co-authored-by: Violin <[email protected]>
    Co-authored-by: Smilencer <[email protected]>
    Co-authored-by: you06 <[email protected]>
    Co-authored-by: Hu# <[email protected]>
    Co-authored-by: Connor <[email protected]>
    Co-authored-by: zyguan <[email protected]>
    fix case typo in comment. (#778)
    fix goroutine leak (#784)
    fix TestRURuntimeStatsCleanUp (#787)
    Fix wrong resource group name for some requests (#788)
    resolver: support verifying primary for check_txn_status (#777)
    resolver: handle pessimistic locks in BatchResolveLocks (#794)
    resolved ts  (#793)
    ResolveLocks for unistore (#807)
    iosmanthus authored May 22, 2023
    Configuration menu
    Copy the full SHA
    5f10ed1 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    35937f2 View commit details
    Browse the repository at this point in the history
  4. Merge branch 'cse-region-client' of github.com:tikv/client-go into cs…

    …e-region-client
    
    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus committed May 22, 2023
    Configuration menu
    Copy the full SHA
    d8ce633 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. Configuration menu
    Copy the full SHA
    a6a7be2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1d62208 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. Configuration menu
    Copy the full SHA
    388baf3 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. support remote coprocessor (#808)

    * support remote coprocessor
    coocood authored May 29, 2023
    Configuration menu
    Copy the full SHA
    4499cc5 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. cse: add replica number (#824)

    Signed-off-by: nolouch <[email protected]>
    nolouch authored May 31, 2023
    Configuration menu
    Copy the full SHA
    a07600f View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Configuration menu
    Copy the full SHA
    390b11b View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. filter out removed node state (#849)

    Signed-off-by: iosmanthus <[email protected]>
    iosmanthus authored Jun 21, 2023
    Configuration menu
    Copy the full SHA
    d2d449f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a246fae View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2023

  1. *: update pd client version (#840)

    Signed-off-by: lhy1024 <[email protected]>
    lhy1024 authored Jun 25, 2023
    Configuration menu
    Copy the full SHA
    136f833 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. Configuration menu
    Copy the full SHA
    d5a7044 View commit details
    Browse the repository at this point in the history
  2. rebase master for cse-region-client (#854)

    Co-authored-by: disksing <[email protected]>
    Co-authored-by: David <[email protected]>
    Co-authored-by: Hu# <[email protected]>
    Co-authored-by: Weizhen Wang <[email protected]>
    Co-authored-by: you06 <[email protected]>
    Co-authored-by: ShuNing <[email protected]>
    Co-authored-by: Hu# <[email protected]>
    Co-authored-by: zzm <[email protected]>
    Co-authored-by: Yongbo Jiang <[email protected]>
    Co-authored-by: crazycs <[email protected]>
    Co-authored-by: glorv <[email protected]>
    Co-authored-by: zyguan <[email protected]>
    ResolvedTS error just write in debug log (#814)
    ResolvedTS error just write in debug log (#825)
    fix ci (#835)
    fix rpc interceptor data race (#845)
    resolver: let getTxnStatusFromLock return error when backoff timeout (#847)
    13 people authored Jun 29, 2023
    Configuration menu
    Copy the full SHA
    43fcadf View commit details
    Browse the repository at this point in the history
  3. fix conflicts with master for cse-region-client (#856)

    Co-authored-by: disksing <[email protected]>
    Co-authored-by: David <[email protected]>
    Co-authored-by: Hu# <[email protected]>
    Co-authored-by: Weizhen Wang <[email protected]>
    Co-authored-by: you06 <[email protected]>
    Co-authored-by: ShuNing <[email protected]>
    Co-authored-by: Hu# <[email protected]>
    Co-authored-by: zzm <[email protected]>
    Co-authored-by: Yongbo Jiang <[email protected]>
    Co-authored-by: crazycs <[email protected]>
    Co-authored-by: glorv <[email protected]>
    Co-authored-by: zyguan <[email protected]>
    ResolvedTS error just write in debug log (#814)
    ResolvedTS error just write in debug log (#825)
    fix ci (#835)
    fix rpc interceptor data race (#845)
    resolver: let getTxnStatusFromLock return error when backoff timeout (#847)
    13 people authored Jun 29, 2023
    Configuration menu
    Copy the full SHA
    1d58034 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    f04046a View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. Configuration menu
    Copy the full SHA
    19ef437 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Configuration menu
    Copy the full SHA
    c22bb29 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. Configuration menu
    Copy the full SHA
    b27cb07 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. Configuration menu
    Copy the full SHA
    2ad441f View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. merge master into cse region client (#939)

    * client-go: add some key range info to error when PD returned no region (#862)
    
    Signed-off-by: Chao Wang <[email protected]>
    
    * *: refine non-global stale-read request retry logic (#863)
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * Fix the issue that primary pessimistic lock may be left not cleared after GC (#866)
    
    * Fix the issue that primary pessimistic lock may be left not cleared after GC
    
    Signed-off-by: MyonKeminta <[email protected]>
    
    * Fix mysteriously shown up thing that makes compilation failed
    
    Signed-off-by: MyonKeminta <[email protected]>
    
    * Fix test effectiveness (forgot to set txn2 to pessimistic txn); add more strict checks
    
    Signed-off-by: MyonKeminta <[email protected]>
    
    * Address comments
    
    Signed-off-by: MyonKeminta <[email protected]>
    
    ---------
    
    Signed-off-by: MyonKeminta <[email protected]>
    Co-authored-by: MyonKeminta <[email protected]>
    
    * add explicit request source type to label the external request like lightning/br (#868)
    
    Signed-off-by: nolouch <[email protected]>
    
    * use '%d' instead of '%q' for some int values in error message (#875)
    
    Signed-off-by: Chao Wang <[email protected]>
    
    * format key in error message in method `scanRegions` (#876)
    
    Signed-off-by: Chao Wang <[email protected]>
    
    * make cop request timeout a config paramter (#865)
    
    * update
    
    Signed-off-by: Spade A <[email protected]>
    
    * update
    
    Signed-off-by: Spade A <[email protected]>
    
    * update
    
    Signed-off-by: Spade A <[email protected]>
    
    * update
    
    Signed-off-by: Spade A <[email protected]>
    
    ---------
    
    Signed-off-by: Spade A <[email protected]>
    
    * region_cache: support check pending tiflash peer (#821)
    
    Signed-off-by: guo-shaoge <[email protected]>
    Co-authored-by: disksing <[email protected]>
    
    * *: add `SnapshotIterReverse` and make `iterReverse` supports `lowerBound` (#883)
    
    Signed-off-by: Jason Mo <[email protected]>
    
    * *: fix stale read ops metric (#878) (#889)
    
    Signed-off-by: crazycs520 <[email protected]>
    Co-authored-by: disksing <[email protected]>
    
    * add gc options (#828)
    
    Signed-off-by: weedge <[email protected]>
    Co-authored-by: disksing <[email protected]>
    
    * reload region cache when store is resolved from invalid status (#843)
    
    Signed-off-by: you06 <[email protected]>
    Co-authored-by: disksing <[email protected]>
    
    * ci: update setup-go action (#904)
    
    Signed-off-by: disksing <[email protected]>
    
    * fix unexpected slow query during GC running after stop 1 tikv-server (#899) (#909)
    
    * fix unexpected slow query during GC running after stop 1 tikv-server
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix test
    
    Signed-off-by: crazycs520 <[email protected]>
    
    ---------
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * resource_manager: ignore ru metrics for background request (#872)
    
    Signed-off-by: husharp <[email protected]>
    Co-authored-by: disksing <[email protected]>
    
    * add more log for diagnose (#915)
    
    * add more log for diagnose
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * add more log for diagnose
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * add more log
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * address comment
    
    Signed-off-by: crazycs520 <[email protected]>
    
    ---------
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * use context logger as much as possible (#908)
    
    * use context logger as much as possible
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * refine
    
    Signed-off-by: crazycs520 <[email protected]>
    
    ---------
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * Resume max retry time check for stale read retry with leader option(#903) (#911)
    
    * Resume max retry time check for stale read retry with leader option
    
    Signed-off-by: cfzjywxk <[email protected]>
    
    * add cancel
    
    Signed-off-by: cfzjywxk <[email protected]>
    
    ---------
    
    Signed-off-by: cfzjywxk <[email protected]>
    
    * request_source: remove default label (#890)
    
    * request_source: remove default label
    
    Signed-off-by: nolouch <[email protected]>
    
    * add a function to set request source task type (#925)
    
    * add a function to set request source task type
    
    Signed-off-by: glorv <[email protected]>
    
    * ci: update go version (#936)
    
    * ci: update go version
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix test
    
    Signed-off-by: crazycs520 <[email protected]>
    
    ---------
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * use tidb_kv_read_timeout as first kv request timeout (#919)
    
    * support tidb_kv_read_timeout as first round kv request timeout
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix ci
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix ci
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix ci
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix ci
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * fix ci
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * update comment
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * refine test
    
    Signed-off-by: crazycs520 <[email protected]>
    
    ---------
    
    Signed-off-by: crazycs520 <[email protected]>
    
    * [pick] resource_control: bypass some internal urgent request (#938)
    
    * resource_control: bypass some internal urgent request (#884)
    
    Signed-off-by: nolouch <[email protected]>
    
    * resourcecontrol: fix nil pointer (#900)
    
    Signed-off-by: nolouch <[email protected]>
    
    ---------
    
    Signed-off-by: nolouch <[email protected]>
    
    ---------
    
    Signed-off-by: Chao Wang <[email protected]>
    Signed-off-by: crazycs520 <[email protected]>
    Signed-off-by: MyonKeminta <[email protected]>
    Signed-off-by: nolouch <[email protected]>
    Signed-off-by: Spade A <[email protected]>
    Signed-off-by: guo-shaoge <[email protected]>
    Signed-off-by: Jason Mo <[email protected]>
    Signed-off-by: weedge <[email protected]>
    Signed-off-by: you06 <[email protected]>
    Signed-off-by: disksing <[email protected]>
    Signed-off-by: husharp <[email protected]>
    Signed-off-by: cfzjywxk <[email protected]>
    Signed-off-by: glorv <[email protected]>
    Signed-off-by: iosmanthus <[email protected]>
    Co-authored-by: 王超 <[email protected]>
    Co-authored-by: crazycs <[email protected]>
    Co-authored-by: MyonKeminta <[email protected]>
    Co-authored-by: MyonKeminta <[email protected]>
    Co-authored-by: ShuNing <[email protected]>
    Co-authored-by: Spade  A <[email protected]>
    Co-authored-by: guo-shaoge <[email protected]>
    Co-authored-by: disksing <[email protected]>
    Co-authored-by: Hangjie Mo <[email protected]>
    Co-authored-by: weedge <[email protected]>
    Co-authored-by: you06 <[email protected]>
    Co-authored-by: Hu# <[email protected]>
    Co-authored-by: cfzjywxk <[email protected]>
    Co-authored-by: glorv <[email protected]>
    15 people authored Aug 11, 2023
    Configuration menu
    Copy the full SHA
    b67add4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e93b07c View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. collecting the RU information by pasing point through context.Value (#…

    …1032)
    
    * ru detail
    
    Signed-off-by: zzm <[email protected]>
    
    * remove unused code
    
    Signed-off-by: zzm <[email protected]>
    
    * reduce waitgroup
    
    Signed-off-by: zzm <[email protected]>
    
    * fix ut
    
    Signed-off-by: zzm <[email protected]>
    
    * make lint
    
    Signed-off-by: zzm <[email protected]>
    
    * fix ci
    
    Signed-off-by: zzm <[email protected]>
    
    ---------
    
    Signed-off-by: zzm <[email protected]>
    zeminzhou authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    a29e95d View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. increase large transaction preSplitSizeThreashold (#1059)

    cloud-storage-engine has larger region size, we don't want to split regions into 32MB size on large transaction write.
    
    Signed-off-by: Evan Zhou <[email protected]>
    coocood authored Nov 15, 2023
    Configuration menu
    Copy the full SHA
    e1d4f84 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. merge master for cse region client (#1083)

    Co-authored-by: cfzjywxk <[email protected]>
    Co-authored-by: cfzjywxk <[email protected]>
    Co-authored-by: disksing <[email protected]>
    Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    Co-authored-by: zzm <[email protected]>
    Co-authored-by: husharp <[email protected]>
    Co-authored-by: you06 <[email protected]>
    Co-authored-by: buffer <[email protected]>
    Co-authored-by: 3pointer <[email protected]>
    Co-authored-by: buffer <[email protected]>
    Co-authored-by: husharp <[email protected]>
    Co-authored-by: crazycs520 <[email protected]>
    Co-authored-by: Smilencer <[email protected]>
    Co-authored-by: ShuNing <[email protected]>
    Co-authored-by: zyguan <[email protected]>
    Co-authored-by: Jack Yu <[email protected]>
    Co-authored-by: Weizhen Wang <[email protected]>
    Co-authored-by: lucasliang <[email protected]>
    Co-authored-by: healthwaite <[email protected]>
    Co-authored-by: xufei <[email protected]>
    Co-authored-by: JmPotato <[email protected]>
    Co-authored-by: ekexium <[email protected]>
    Co-authored-by: 山岚 <[email protected]>
    Co-authored-by: glorv <[email protected]>
    Co-authored-by: Yongbo Jiang <[email protected]>
    resolve locks interface for tidb gc_worker (#945)
    fix some issues of replica selector (#910)  (#942)
    fix some issues of replica selector (#910)
    fix issue of configure kv timeout not work when disable batch client (#980)
    fix batch-client wait too long and add some metrics (#973)
    fix batch-client wait too long and add some metrics (#973)" (#984)
    fix data race at the aggressiveLockingDirty (#913)
    fix MinSafeTS might be set to MaxUint64 permanently (#994)
    fix: fix invalid nil pointer when trying to record Store.SlownessStat. (#1017)
    Fix batch client batchSendLoop panic (#1021)
    fix request source tag unset (#1025)
    Fix comment of `SuspendTime` (#1057)
    iosmanthus authored Dec 20, 2023
    Configuration menu
    Copy the full SHA
    0041484 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4ffb53a View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. Configuration menu
    Copy the full SHA
    aaa66ef View commit details
    Browse the repository at this point in the history