From 52154e9bbba9258c4718df5b54e5d9c54de918dc Mon Sep 17 00:00:00 2001 From: ti-srebot <66930949+ti-srebot@users.noreply.github.com> Date: Fri, 10 Sep 2021 15:38:44 +0800 Subject: [PATCH 01/16] releases: add TiDB 5.0.4-15-38-41 release notes * releases: add TiDB 5.0.4-15-38-41 release notes * Update releases/release-5.0.4-15-38-41.md --- releases/release-5.0.4-15-38-41.md | 202 +++++++++++++++++++++++++++++ 1 file changed, 202 insertions(+) create mode 100644 releases/release-5.0.4-15-38-41.md diff --git a/releases/release-5.0.4-15-38-41.md b/releases/release-5.0.4-15-38-41.md new file mode 100644 index 000000000000..0c80ffd4bafc --- /dev/null +++ b/releases/release-5.0.4-15-38-41.md @@ -0,0 +1,202 @@ +--- +title: TiDB 5.0.4 Release Notes +category: Releases +--- + + + +# TiDB 5.0.4 Release Notes + +Release Date: September 10, 2021 + +TiDB version: 5.0.4 + +## __unsorted + ++ PingCAP/TiDB + + - Please add a release note, or a 'None' if it is not needed. [#27841](https://github.com/pingcap/tidb/pull/27841) + - fix wrong selection push down when having above agg [#27742](https://github.com/pingcap/tidb/pull/27742) + - ```release-note [#27584](https://github.com/pingcap/tidb/pull/27584) + - fix expression rewrite makes between expr infers wrong collation. [#27548](https://github.com/pingcap/tidb/pull/27548) + - make `group_concat` function consider the collation [#27528](https://github.com/pingcap/tidb/pull/27528) + - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27507](https://github.com/pingcap/tidb/pull/27507) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27412](https://github.com/pingcap/tidb/pull/27412) + - expression: fix extract bug when argument is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) + - planner: add missing column for Apply convert to Join [#27283](https://github.com/pingcap/tidb/pull/27283) + - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27263](https://github.com/pingcap/tidb/pull/27263) + - executor: fix unexpected behavior when casting invalid string to date [#27110](https://github.com/pingcap/tidb/pull/27110) + - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26903](https://github.com/pingcap/tidb/pull/26903) + - store/copr: block the tiflash node for a period when it fails before. [#26757](https://github.com/pingcap/tidb/pull/26757) + - Increasing the split region limit makes the split table and pre split more stable [#26657](https://github.com/pingcap/tidb/pull/26657) + - Fix the issue that point get does not use lite version resolve lock [#26560](https://github.com/pingcap/tidb/pull/26560) + - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) + - store/copr: support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) + - Support set tidb_enforce_mpp=1 to enforce use mpp mode. [#26382](https://github.com/pingcap/tidb/pull/26382) + - mpp: check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) + - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) + - fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) + - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) + - Change the lock record into put record for the index keys using point/batch point get for update read. [#26224](https://github.com/pingcap/tidb/pull/26224) + - load: fix load data with non-utf8 can succeed [#26143](https://github.com/pingcap/tidb/pull/26143) + - planner: support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) + - TiDB now supports the mysql system variable init_connect and associated functionality. [#26072](https://github.com/pingcap/tidb/pull/26072) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25873](https://github.com/pingcap/tidb/pull/25873) + - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) + - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) + - planner: check filter condition in func convertToPartialTableScan [#25806](https://github.com/pingcap/tidb/pull/25806) + - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) + - Important security issue for handling ALTER USER statements [#25348](https://github.com/pingcap/tidb/pull/25348) + - metrics: Add err label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) + - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) + - Non release note [#24945](https://github.com/pingcap/tidb/pull/24945) + - Fix the bug that TIKV_REGION_PEERS table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) + - add table name in log [#24802](https://github.com/pingcap/tidb/pull/24802) + - Handle a potential statistic object's memory leak when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) + - SQL Views now consider the default roles associated with the SQL DEFINER correctrly. [#24532](https://github.com/pingcap/tidb/pull/24532) + - Support getting the MVCC key of the secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) + - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) + - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) + + ++ TiKV/TiKV + + - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10872](https://github.com/tikv/tikv/pull/10872) + - - TiKV coprocessor slow log will only consider time spent on processing the request. +- Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10864](https://github.com/tikv/tikv/pull/10864) + - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version +- Fix newer TiKV can't rollback to 5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) + - None. [#10821](https://github.com/tikv/tikv/pull/10821) + - 1. Allow getting region info for all regions on the remote store: + +`tikv-ctl --host 127.0.0.1:20160 raft region --all-regions` + +2. Print region start key and end key with: + +`tikv-ctl --host 127.0.0.1:20160 region-properties -r 1` + +3. Added subcommand: + +- `tikv-ctl unsafe-recover remove-failed-stores -s 1,2,3 -r 1,2,3 --promote-learner`: Promote the learner to leader if only one learner exists +- `tikv-ctl unsafe-recover drop-unapplied-raftlog -r 1,2,3`: regress the commit index to the apply index for the region [#10794](https://github.com/tikv/tikv/pull/10794) + - Fix TiKV panic when Titan is enabled and upgrade from < 5.0 versions to >= 5.0 versions. A cluster may hit the issue if it was upgraded from TiKV 3.x and enabled Titan before the upgrade in the past. [#10778](https://github.com/tikv/tikv/pull/10778) + - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) + - Reduce resolved ts message size to save network bandwidth. [#10678](https://github.com/tikv/tikv/pull/10678) + - Avoid false "GC can not work" alert under low write flow. [#10662](https://github.com/tikv/tikv/pull/10662) + - Fix the resolve failures caused by the left pessimisic locks. [#10654](https://github.com/tikv/tikv/pull/10654) + - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10587](https://github.com/tikv/tikv/pull/10587) + - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) + - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) + - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) + + ++ PD + + - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) + - None. [#3975](https://github.com/tikv/pd/pull/3975) + - Improved the performance of synchronizing Region information between PDs. [#3934](https://github.com/tikv/pd/pull/3934) + - TiDB Dashboard: Add OIDC based SSO support [#3884](https://github.com/tikv/pd/pull/3884) + - Reduce the conflict due to multiple scheduler running in same time [#3856](https://github.com/tikv/pd/pull/3856) + - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3823](https://github.com/tikv/pd/pull/3823) + + ++ Tools + + + PingCAP/Dumpling + + - fix pending on show table status in some mysql version [#342](https://github.com/pingcap/dumpling/pull/342) + - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT +- Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#327](https://github.com/pingcap/dumpling/pull/327) + - ```release-note [#303](https://github.com/pingcap/dumpling/pull/303) + + + + PingCAP/TiCDC + + - Fix json encoding could panic when processing a string type value in some cases. [#2782](https://github.com/pingcap/ticdc/pull/2782) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2728](https://github.com/pingcap/ticdc/pull/2728) + - Fix OOM when TiCDC captures too many regions [#2724](https://github.com/pingcap/ticdc/pull/2724) + - Fix gRPC keepalive error when memory pressure is high. [#2719](https://github.com/pingcap/ticdc/pull/2719) + - Optimize memory management when unified sorter is using memory to sort. [#2711](https://github.com/pingcap/ticdc/pull/2711) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#2682](https://github.com/pingcap/ticdc/pull/2682) + - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2655](https://github.com/pingcap/ticdc/pull/2655) + - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2620](https://github.com/pingcap/ticdc/pull/2620) + - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/ticdc/pull/2610) + - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) + - Prohibit operating TiCDC clusters across major and minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) + - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) + - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2533](https://github.com/pingcap/ticdc/pull/2533) + - `None`. [#2520](https://github.com/pingcap/ticdc/pull/2520) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2492](https://github.com/pingcap/ticdc/pull/2492) + - Optimize workerpool for fewer goroutines when concurrency is high. [#2487](https://github.com/pingcap/ticdc/pull/2487) + - fix outdated capture info may appear in capture list command [#2466](https://github.com/pingcap/ticdc/pull/2466) + - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2458](https://github.com/pingcap/ticdc/pull/2458) + - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2456](https://github.com/pingcap/ticdc/pull/2456) + - fix a bug where synchronizing large tables to cdclog failed. [#2445](https://github.com/pingcap/ticdc/pull/2445) + - Fix CLI back-compatibility [#2413](https://github.com/pingcap/ticdc/pull/2413) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) + - Remove file sorter. [#2326](https://github.com/pingcap/ticdc/pull/2326) + - puller,mounter,processor: always pull the old value internally [#2305](https://github.com/pingcap/ticdc/pull/2305) + - Fix minor runtime panic risk [#2299](https://github.com/pingcap/ticdc/pull/2299) + - Fix potential DDL loss when owner crashes while executing DDL [#2292](https://github.com/pingcap/ticdc/pull/2292) + - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) + - Fix extra partition dispatching when adding new table partition. [#2263](https://github.com/pingcap/ticdc/pull/2263) + - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) + - Cleanup changefeed metrics when changefeed is removed. +- Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) + - ```release-note [#2143](https://github.com/pingcap/ticdc/pull/2143) + - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/ticdc/pull/1488) + + +## Bug Fixes + ++ PingCAP/TiDB + + - ```release-note [#26963](https://github.com/pingcap/tidb/pull/26963) + - planner: fix the unstable test case TestAnalyzeIncremental [#26851](https://github.com/pingcap/tidb/pull/26851) + - Keep the overflow check logic same with mysql [#26724](https://github.com/pingcap/tidb/pull/26724) + - Fix wrong charset and collation for case when function [#26672](https://github.com/pingcap/tidb/pull/26672) + - Fix the case that TiDB would return the wrong result when the children of the UNION contain pure NULL values [#26571](https://github.com/pingcap/tidb/pull/26571) + - Fix the issue that greatest(datetime) union null returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) + - fix incompatible last_day func behavior in sql mode [#26000](https://github.com/pingcap/tidb/pull/26000) + - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25974](https://github.com/pingcap/tidb/pull/25974) + - Fix the wrong result after "insert ignore on duplicate update" in the secondary index has the same column in primary key but has prefix length [#25905](https://github.com/pingcap/tidb/pull/25905) + - Fix the wrong result for "insert ignore duplicate up" on partition table when handle changed and duplicated on secondary index [#25859](https://github.com/pingcap/tidb/pull/25859) + - fix wrong enum key in point get [#24772](https://github.com/pingcap/tidb/pull/24772) + - fix dml_batch_size doesn't load the global variable [#24731](https://github.com/pingcap/tidb/pull/24731) + - planner: filter conflict read_from_storage hints [#24374](https://github.com/pingcap/tidb/pull/24374) + - fix wrong type infer for agg function when type is null. [#24354](https://github.com/pingcap/tidb/pull/24354) + - fix wrong flen infer for bit constant [#24267](https://github.com/pingcap/tidb/pull/24267) + - fix some potential panic in statistics [#24061](https://github.com/pingcap/tidb/pull/24061) + - fix approx_percent panic on bit column [#23703](https://github.com/pingcap/tidb/pull/23703) + - fix get var expr when session var is hex literal [#23373](https://github.com/pingcap/tidb/pull/23373) + - fix unexpected constant fold when year compare string. [#23336](https://github.com/pingcap/tidb/pull/23336) + + ++ PD + + - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) + - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) + + +## Improvements + ++ PingCAP/TiDB + + - Trigger auto-analyze based on histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) + + ++ TiKV/TiKV + + - - separate read write ready to reduce read latency [#10620](https://github.com/tikv/tikv/pull/10620) + + +## Compatibility Changes + ++ PingCAP/TiDB + + - Revert #19341 to avoid #24326. [#26258](https://github.com/pingcap/tidb/pull/26258) + + From 2e722062c66ef22075551cb424740b7abeea8ab0 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 10 Sep 2021 17:35:55 +0800 Subject: [PATCH 02/16] add toc --- TOC.md | 3 +- ...ase-5.0.4-15-38-41.md => release-5.0.4.md} | 368 ++++++++---------- releases/release-notes.md | 1 + 3 files changed, 169 insertions(+), 203 deletions(-) rename releases/{release-5.0.4-15-38-41.md => release-5.0.4.md} (83%) diff --git a/TOC.md b/TOC.md index 9640c57529fc..597f4f44f23f 100644 --- a/TOC.md +++ b/TOC.md @@ -557,11 +557,12 @@ + [All Releases](/releases/release-notes.md) + v5.2 + [5.2.1](/releases/release-5.2.1.md) - + [5.2.0](/releases/release-5.2.0.md) + + [5.2.0](/releases/release-5.2.0.md) + v5.1 + [5.1.1](/releases/release-5.1.1.md) + [5.1.0](/releases/release-5.1.0.md) + v5.0 + + [5.0.4](/releases/release-5.0.4.md) + [5.0.3](/releases/release-5.0.3.md) + [5.0.2](/releases/release-5.0.2.md) + [5.0.1](/releases/release-5.0.1.md) diff --git a/releases/release-5.0.4-15-38-41.md b/releases/release-5.0.4.md similarity index 83% rename from releases/release-5.0.4-15-38-41.md rename to releases/release-5.0.4.md index 0c80ffd4bafc..247fcade2180 100644 --- a/releases/release-5.0.4-15-38-41.md +++ b/releases/release-5.0.4.md @@ -1,202 +1,166 @@ ---- -title: TiDB 5.0.4 Release Notes -category: Releases ---- - - - -# TiDB 5.0.4 Release Notes - -Release Date: September 10, 2021 - -TiDB version: 5.0.4 - -## __unsorted - -+ PingCAP/TiDB - - - Please add a release note, or a 'None' if it is not needed. [#27841](https://github.com/pingcap/tidb/pull/27841) - - fix wrong selection push down when having above agg [#27742](https://github.com/pingcap/tidb/pull/27742) - - ```release-note [#27584](https://github.com/pingcap/tidb/pull/27584) - - fix expression rewrite makes between expr infers wrong collation. [#27548](https://github.com/pingcap/tidb/pull/27548) - - make `group_concat` function consider the collation [#27528](https://github.com/pingcap/tidb/pull/27528) - - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27507](https://github.com/pingcap/tidb/pull/27507) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27412](https://github.com/pingcap/tidb/pull/27412) - - expression: fix extract bug when argument is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) - - planner: add missing column for Apply convert to Join [#27283](https://github.com/pingcap/tidb/pull/27283) - - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27263](https://github.com/pingcap/tidb/pull/27263) - - executor: fix unexpected behavior when casting invalid string to date [#27110](https://github.com/pingcap/tidb/pull/27110) - - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26903](https://github.com/pingcap/tidb/pull/26903) - - store/copr: block the tiflash node for a period when it fails before. [#26757](https://github.com/pingcap/tidb/pull/26757) - - Increasing the split region limit makes the split table and pre split more stable [#26657](https://github.com/pingcap/tidb/pull/26657) - - Fix the issue that point get does not use lite version resolve lock [#26560](https://github.com/pingcap/tidb/pull/26560) - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) - - store/copr: support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) - - Support set tidb_enforce_mpp=1 to enforce use mpp mode. [#26382](https://github.com/pingcap/tidb/pull/26382) - - mpp: check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) - - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) - - fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) - - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) - - Change the lock record into put record for the index keys using point/batch point get for update read. [#26224](https://github.com/pingcap/tidb/pull/26224) - - load: fix load data with non-utf8 can succeed [#26143](https://github.com/pingcap/tidb/pull/26143) - - planner: support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) - - TiDB now supports the mysql system variable init_connect and associated functionality. [#26072](https://github.com/pingcap/tidb/pull/26072) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25873](https://github.com/pingcap/tidb/pull/25873) - - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) - - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) - - planner: check filter condition in func convertToPartialTableScan [#25806](https://github.com/pingcap/tidb/pull/25806) - - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) - - Important security issue for handling ALTER USER statements [#25348](https://github.com/pingcap/tidb/pull/25348) - - metrics: Add err label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) - - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) - - Non release note [#24945](https://github.com/pingcap/tidb/pull/24945) - - Fix the bug that TIKV_REGION_PEERS table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) - - add table name in log [#24802](https://github.com/pingcap/tidb/pull/24802) - - Handle a potential statistic object's memory leak when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) - - SQL Views now consider the default roles associated with the SQL DEFINER correctrly. [#24532](https://github.com/pingcap/tidb/pull/24532) - - Support getting the MVCC key of the secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) - - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) - - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) - - -+ TiKV/TiKV - - - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10872](https://github.com/tikv/tikv/pull/10872) - - - TiKV coprocessor slow log will only consider time spent on processing the request. -- Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10864](https://github.com/tikv/tikv/pull/10864) - - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version -- Fix newer TiKV can't rollback to 5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) - - None. [#10821](https://github.com/tikv/tikv/pull/10821) - - 1. Allow getting region info for all regions on the remote store: - -`tikv-ctl --host 127.0.0.1:20160 raft region --all-regions` - -2. Print region start key and end key with: - -`tikv-ctl --host 127.0.0.1:20160 region-properties -r 1` - -3. Added subcommand: - -- `tikv-ctl unsafe-recover remove-failed-stores -s 1,2,3 -r 1,2,3 --promote-learner`: Promote the learner to leader if only one learner exists -- `tikv-ctl unsafe-recover drop-unapplied-raftlog -r 1,2,3`: regress the commit index to the apply index for the region [#10794](https://github.com/tikv/tikv/pull/10794) - - Fix TiKV panic when Titan is enabled and upgrade from < 5.0 versions to >= 5.0 versions. A cluster may hit the issue if it was upgraded from TiKV 3.x and enabled Titan before the upgrade in the past. [#10778](https://github.com/tikv/tikv/pull/10778) - - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) - - Reduce resolved ts message size to save network bandwidth. [#10678](https://github.com/tikv/tikv/pull/10678) - - Avoid false "GC can not work" alert under low write flow. [#10662](https://github.com/tikv/tikv/pull/10662) - - Fix the resolve failures caused by the left pessimisic locks. [#10654](https://github.com/tikv/tikv/pull/10654) - - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) - - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10587](https://github.com/tikv/tikv/pull/10587) - - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) - - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) - - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) - - -+ PD - - - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) - - None. [#3975](https://github.com/tikv/pd/pull/3975) - - Improved the performance of synchronizing Region information between PDs. [#3934](https://github.com/tikv/pd/pull/3934) - - TiDB Dashboard: Add OIDC based SSO support [#3884](https://github.com/tikv/pd/pull/3884) - - Reduce the conflict due to multiple scheduler running in same time [#3856](https://github.com/tikv/pd/pull/3856) - - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3823](https://github.com/tikv/pd/pull/3823) - - -+ Tools - - + PingCAP/Dumpling - - - fix pending on show table status in some mysql version [#342](https://github.com/pingcap/dumpling/pull/342) - - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT -- Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#327](https://github.com/pingcap/dumpling/pull/327) - - ```release-note [#303](https://github.com/pingcap/dumpling/pull/303) - - - + PingCAP/TiCDC - - - Fix json encoding could panic when processing a string type value in some cases. [#2782](https://github.com/pingcap/ticdc/pull/2782) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2728](https://github.com/pingcap/ticdc/pull/2728) - - Fix OOM when TiCDC captures too many regions [#2724](https://github.com/pingcap/ticdc/pull/2724) - - Fix gRPC keepalive error when memory pressure is high. [#2719](https://github.com/pingcap/ticdc/pull/2719) - - Optimize memory management when unified sorter is using memory to sort. [#2711](https://github.com/pingcap/ticdc/pull/2711) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#2682](https://github.com/pingcap/ticdc/pull/2682) - - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2655](https://github.com/pingcap/ticdc/pull/2655) - - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2620](https://github.com/pingcap/ticdc/pull/2620) - - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/ticdc/pull/2610) - - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) - - Prohibit operating TiCDC clusters across major and minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) - - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) - - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2533](https://github.com/pingcap/ticdc/pull/2533) - - `None`. [#2520](https://github.com/pingcap/ticdc/pull/2520) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2492](https://github.com/pingcap/ticdc/pull/2492) - - Optimize workerpool for fewer goroutines when concurrency is high. [#2487](https://github.com/pingcap/ticdc/pull/2487) - - fix outdated capture info may appear in capture list command [#2466](https://github.com/pingcap/ticdc/pull/2466) - - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2458](https://github.com/pingcap/ticdc/pull/2458) - - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2456](https://github.com/pingcap/ticdc/pull/2456) - - fix a bug where synchronizing large tables to cdclog failed. [#2445](https://github.com/pingcap/ticdc/pull/2445) - - Fix CLI back-compatibility [#2413](https://github.com/pingcap/ticdc/pull/2413) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) - - Remove file sorter. [#2326](https://github.com/pingcap/ticdc/pull/2326) - - puller,mounter,processor: always pull the old value internally [#2305](https://github.com/pingcap/ticdc/pull/2305) - - Fix minor runtime panic risk [#2299](https://github.com/pingcap/ticdc/pull/2299) - - Fix potential DDL loss when owner crashes while executing DDL [#2292](https://github.com/pingcap/ticdc/pull/2292) - - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) - - Fix extra partition dispatching when adding new table partition. [#2263](https://github.com/pingcap/ticdc/pull/2263) - - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) - - Cleanup changefeed metrics when changefeed is removed. -- Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) - - ```release-note [#2143](https://github.com/pingcap/ticdc/pull/2143) - - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/ticdc/pull/1488) - - -## Bug Fixes - -+ PingCAP/TiDB - - - ```release-note [#26963](https://github.com/pingcap/tidb/pull/26963) - - planner: fix the unstable test case TestAnalyzeIncremental [#26851](https://github.com/pingcap/tidb/pull/26851) - - Keep the overflow check logic same with mysql [#26724](https://github.com/pingcap/tidb/pull/26724) - - Fix wrong charset and collation for case when function [#26672](https://github.com/pingcap/tidb/pull/26672) - - Fix the case that TiDB would return the wrong result when the children of the UNION contain pure NULL values [#26571](https://github.com/pingcap/tidb/pull/26571) - - Fix the issue that greatest(datetime) union null returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) - - fix incompatible last_day func behavior in sql mode [#26000](https://github.com/pingcap/tidb/pull/26000) - - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25974](https://github.com/pingcap/tidb/pull/25974) - - Fix the wrong result after "insert ignore on duplicate update" in the secondary index has the same column in primary key but has prefix length [#25905](https://github.com/pingcap/tidb/pull/25905) - - Fix the wrong result for "insert ignore duplicate up" on partition table when handle changed and duplicated on secondary index [#25859](https://github.com/pingcap/tidb/pull/25859) - - fix wrong enum key in point get [#24772](https://github.com/pingcap/tidb/pull/24772) - - fix dml_batch_size doesn't load the global variable [#24731](https://github.com/pingcap/tidb/pull/24731) - - planner: filter conflict read_from_storage hints [#24374](https://github.com/pingcap/tidb/pull/24374) - - fix wrong type infer for agg function when type is null. [#24354](https://github.com/pingcap/tidb/pull/24354) - - fix wrong flen infer for bit constant [#24267](https://github.com/pingcap/tidb/pull/24267) - - fix some potential panic in statistics [#24061](https://github.com/pingcap/tidb/pull/24061) - - fix approx_percent panic on bit column [#23703](https://github.com/pingcap/tidb/pull/23703) - - fix get var expr when session var is hex literal [#23373](https://github.com/pingcap/tidb/pull/23373) - - fix unexpected constant fold when year compare string. [#23336](https://github.com/pingcap/tidb/pull/23336) - - -+ PD - - - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) - - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) - - -## Improvements - -+ PingCAP/TiDB - - - Trigger auto-analyze based on histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) - - -+ TiKV/TiKV - - - - separate read write ready to reduce read latency [#10620](https://github.com/tikv/tikv/pull/10620) - - -## Compatibility Changes - -+ PingCAP/TiDB - - - Revert #19341 to avoid #24326. [#26258](https://github.com/pingcap/tidb/pull/26258) - - +--- +title: TiDB 5.0.4 Release Notes +--- + +# TiDB 5.0.4 Release Notes + +Release Date: September 27, 2021 + +TiDB version: 5.0.4 + +## Compatibility Changes + ++ TiDB + + - Revert #19341 to avoid #24326 [#26258](https://github.com/pingcap/tidb/pull/26258) + +## Improvements + ++ TiDB + + - Trigger auto-analyze based on histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) + ++ TiKV + + - separate read write ready to reduce read latency [#10620](https://github.com/tikv/tikv/pull/10620) + +## Bug Fixes + ++ TiDB + + - tidb panic while query hash partition table with is null condition [#26963](https://github.com/pingcap/tidb/pull/26963) + - planner: fix the unstable test case TestAnalyzeIncremental [#26851](https://github.com/pingcap/tidb/pull/26851) + - Keep the overflow check logic same with mysql [#26724](https://github.com/pingcap/tidb/pull/26724) + - Fix wrong charset and collation for case when function [#26672](https://github.com/pingcap/tidb/pull/26672) + - Fix the case that TiDB would return the wrong result when the children of the UNION contain pure NULL values [#26571](https://github.com/pingcap/tidb/pull/26571) + - Fix the issue that greatest(datetime) union null returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) + - fix incompatible last_day func behavior in sql mode [#26000](https://github.com/pingcap/tidb/pull/26000) + - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25974](https://github.com/pingcap/tidb/pull/25974) + - Fix the wrong result after "insert ignore on duplicate update" in the secondary index has the same column in primary key but has prefix length [#25905](https://github.com/pingcap/tidb/pull/25905) + - Fix the wrong result for "insert ignore duplicate up" on partition table when handle changed and duplicated on secondary index [#25859](https://github.com/pingcap/tidb/pull/25859) + - fix wrong enum key in point get [#24772](https://github.com/pingcap/tidb/pull/24772) + - fix dml_batch_size doesn't load the global variable [#24731](https://github.com/pingcap/tidb/pull/24731) + - planner: filter conflict read_from_storage hints [#24374](https://github.com/pingcap/tidb/pull/24374) + - fix wrong type infer for agg function when type is null. [#24354](https://github.com/pingcap/tidb/pull/24354) + - fix wrong flen infer for bit constant [#24267](https://github.com/pingcap/tidb/pull/24267) + - fix some potential panic in statistics [#24061](https://github.com/pingcap/tidb/pull/24061) + - fix approx_percent panic on bit column [#23703](https://github.com/pingcap/tidb/pull/23703) + - fix get var expr when session var is hex literal [#23373](https://github.com/pingcap/tidb/pull/23373) + - fix unexpected constant fold when year compare string. [#23336](https://github.com/pingcap/tidb/pull/23336) + ++ PD + + - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) + - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) + +## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + ++ TiDB + + - fix wrong selection push down when having above agg [#27742](https://github.com/pingcap/tidb/pull/27742) + - fix expression rewrite makes between expr infers wrong collation. [#27548](https://github.com/pingcap/tidb/pull/27548) + - make `group_concat` function consider the collation [#27528](https://github.com/pingcap/tidb/pull/27528) + - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27507](https://github.com/pingcap/tidb/pull/27507) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27412](https://github.com/pingcap/tidb/pull/27412) + - expression: fix extract bug when argument is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) + - planner: add missing column for Apply convert to Join [#27283](https://github.com/pingcap/tidb/pull/27283) + - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27263](https://github.com/pingcap/tidb/pull/27263) + - executor: fix unexpected behavior when casting invalid string to date [#27110](https://github.com/pingcap/tidb/pull/27110) + - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26903](https://github.com/pingcap/tidb/pull/26903) + - store/copr: block the tiflash node for a period when it fails before. [#26757](https://github.com/pingcap/tidb/pull/26757) + - Increasing the split region limit makes the split table and pre split more stable [#26657](https://github.com/pingcap/tidb/pull/26657) + - Fix the issue that point get does not use lite version resolve lock [#26560](https://github.com/pingcap/tidb/pull/26560) + - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) + - store/copr: support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) + - Support set tidb_enforce_mpp=1 to enforce use mpp mode. [#26382](https://github.com/pingcap/tidb/pull/26382) + - mpp: check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) + - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) + - fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) + - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) + - Change the lock record into put record for the index keys using point/batch point get for update read. [#26224](https://github.com/pingcap/tidb/pull/26224) + - load: fix load data with non-utf8 can succeed [#26143](https://github.com/pingcap/tidb/pull/26143) + - planner: support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) + - TiDB now supports the mysql system variable init_connect and associated functionality. [#26072](https://github.com/pingcap/tidb/pull/26072) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25873](https://github.com/pingcap/tidb/pull/25873) + - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) + - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) + - planner: check filter condition in func convertToPartialTableScan [#25806](https://github.com/pingcap/tidb/pull/25806) + - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) + - Important security issue for handling ALTER USER statements [#25348](https://github.com/pingcap/tidb/pull/25348) + - metrics: Add err label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) + - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) + - Fix the bug that TIKV_REGION_PEERS table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) + - add table name in log [#24802](https://github.com/pingcap/tidb/pull/24802) + - Handle a potential statistic object's memory leak when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) + - SQL Views now consider the default roles associated with the SQL DEFINER correctrly. [#24532](https://github.com/pingcap/tidb/pull/24532) + - Support getting the MVCC key of the secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) + - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) + - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) + ++ TiKV + + - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10872](https://github.com/tikv/tikv/pull/10872) + - TiKV coprocessor slow log will only consider time spent on processing the request. [#10864](https://github.com/tikv/tikv/pull/10864) + - Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10864](https://github.com/tikv/tikv/pull/10864) + - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version [#10843](https://github.com/tikv/tikv/pull/10843) + - Fix newer TiKV can't rollback to 5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) + - Fix TiKV panic when Titan is enabled and upgrade from < 5.0 versions to >= 5.0 versions. A cluster may hit the issue if it was upgraded from TiKV 3.x and enabled Titan before the upgrade in the past. [#10778](https://github.com/tikv/tikv/pull/10778) + - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) + - Reduce resolved ts message size to save network bandwidth. [#10678](https://github.com/tikv/tikv/pull/10678) + - Avoid false "GC can not work" alert under low write flow. [#10662](https://github.com/tikv/tikv/pull/10662) + - Fix the resolve failures caused by the left pessimisic locks. [#10654](https://github.com/tikv/tikv/pull/10654) + - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10587](https://github.com/tikv/tikv/pull/10587) + - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) + - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) + - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) + ++ PD + + - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) + - Improved the performance of synchronizing Region information between PDs. [#3934](https://github.com/tikv/pd/pull/3934) + - TiDB Dashboard: Add OIDC based SSO support [#3884](https://github.com/tikv/pd/pull/3884) + - Reduce the conflict due to multiple scheduler running in same time [#3856](https://github.com/tikv/pd/pull/3856) + - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3823](https://github.com/tikv/pd/pull/3823) + ++ Tools + + + Dumpling + + - fix pending on show table status in some mysql version [#342](https://github.com/pingcap/dumpling/pull/342) + - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT + - Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#327](https://github.com/pingcap/dumpling/pull/327) + + + TiCDC + + - Fix json encoding could panic when processing a string type value in some cases. [#2782](https://github.com/pingcap/ticdc/pull/2782) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2728](https://github.com/pingcap/ticdc/pull/2728) + - Fix OOM when TiCDC captures too many regions [#2724](https://github.com/pingcap/ticdc/pull/2724) + - Fix gRPC keepalive error when memory pressure is high. [#2719](https://github.com/pingcap/ticdc/pull/2719) + - Optimize memory management when unified sorter is using memory to sort. [#2711](https://github.com/pingcap/ticdc/pull/2711) + - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2655](https://github.com/pingcap/ticdc/pull/2655) + - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2620](https://github.com/pingcap/ticdc/pull/2620) + - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/ticdc/pull/2610) + - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) + - Prohibit operating TiCDC clusters across major and minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) + - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) + - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2533](https://github.com/pingcap/ticdc/pull/2533) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2492](https://github.com/pingcap/ticdc/pull/2492) + - Optimize workerpool for fewer goroutines when concurrency is high. [#2487](https://github.com/pingcap/ticdc/pull/2487) + - fix outdated capture info may appear in capture list command [#2466](https://github.com/pingcap/ticdc/pull/2466) + - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2458](https://github.com/pingcap/ticdc/pull/2458) + - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2456](https://github.com/pingcap/ticdc/pull/2456) + - fix a bug where synchronizing large tables to cdclog failed. [#2445](https://github.com/pingcap/ticdc/pull/2445) + - Fix CLI back-compatibility [#2413](https://github.com/pingcap/ticdc/pull/2413) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) + - Remove file sorter. [#2326](https://github.com/pingcap/ticdc/pull/2326) + - puller,mounter,processor: always pull the old value internally [#2305](https://github.com/pingcap/ticdc/pull/2305) + - Fix minor runtime panic risk [#2299](https://github.com/pingcap/ticdc/pull/2299) + - Fix potential DDL loss when owner crashes while executing DDL [#2292](https://github.com/pingcap/ticdc/pull/2292) + - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) + - Fix extra partition dispatching when adding new table partition. [#2263](https://github.com/pingcap/ticdc/pull/2263) + - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) + - Cleanup changefeed metrics when changefeed is removed. + - Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) + - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/ticdc/pull/1488) diff --git a/releases/release-notes.md b/releases/release-notes.md index 7082bf502c88..59c294661116 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -17,6 +17,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.0 +- [5.0.4](/releases/release-5.0.4.md) - [5.0.3](/releases/release-5.0.3.md) - [5.0.2](/releases/release-5.0.2.md) - [5.0.1](/releases/release-5.0.1.md) From 6ee7f8d11d1dd2b695cc8fadd3441f03ac1b17bd Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 10 Sep 2021 17:38:30 +0800 Subject: [PATCH 03/16] Update releases/release-5.0.4.md --- releases/release-5.0.4.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 247fcade2180..78574e9c9475 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -54,7 +54,7 @@ TiDB version: 5.0.4 - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) -## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 +## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + TiDB From e8cb303f7cc164e3af3502de3dcf7a120eaac326 Mon Sep 17 00:00:00 2001 From: Wallace Date: Tue, 14 Sep 2021 16:13:58 +0800 Subject: [PATCH 04/16] Update releases/release-5.0.4.md Co-authored-by: amyangfei --- releases/release-5.0.4.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 78574e9c9475..f882c97c4a0f 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -163,4 +163,3 @@ TiDB version: 5.0.4 - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) - Cleanup changefeed metrics when changefeed is removed. - Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) - - Fix the bug that table is not replicated when it changes from ineligible to eligible by DDL [#1488](https://github.com/pingcap/ticdc/pull/1488) From f8ac632165774aef274bfbc796b182cf54ac1381 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 15 Sep 2021 16:44:35 +0800 Subject: [PATCH 05/16] add tikv and tiflash notes --- releases/release-5.0.4.md | 70 ++++++++++++++++++++++++++++----------- 1 file changed, 51 insertions(+), 19 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index f882c97c4a0f..ffe0f0960a09 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -14,6 +14,22 @@ TiDB version: 5.0.4 - Revert #19341 to avoid #24326 [#26258](https://github.com/pingcap/tidb/pull/26258) +## Feature enhancements + ++ TiDB + +- Support set `tidb_enforce_mpp=1` to enforce use mpp mode [#26382](https://github.com/pingcap/tidb/pull/26382) + ++ TiKV + + - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) + ++ TiFlash + + - Support the `HAVING()` function in DAG requests + - Support the `DATE()` function + - Add Grafana panels for write throughput per instance + ## Improvements + TiDB @@ -22,7 +38,13 @@ TiDB version: 5.0.4 + TiKV - - separate read write ready to reduce read latency [#10620](https://github.com/tikv/tikv/pull/10620) + - Reduce resolved ts message size to save network bandwidth. [#10678](https://github.com/tikv/tikv/pull/10678) + - Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10864](https://github.com/tikv/tikv/pull/10864) + - TiKV coprocessor slow log will only consider time spent on processing the request. [#10864](https://github.com/tikv/tikv/pull/10864) + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10587](https://github.com/tikv/tikv/pull/10587) + - Avoid false "GC can not work" alert under low write flow. [#10662](https://github.com/tikv/tikv/pull/10662) + - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) + - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) ## Bug Fixes @@ -48,6 +70,34 @@ TiDB version: 5.0.4 - fix get var expr when session var is hex literal [#23373](https://github.com/pingcap/tidb/pull/23373) - fix unexpected constant fold when year compare string. [#23336](https://github.com/pingcap/tidb/pull/23336) ++ TiKV + + - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10872](https://github.com/tikv/tikv/pull/10872) + - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version [#10843](https://github.com/tikv/tikv/pull/10843) + - Fix newer TiKV can't rollback to 5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) + - Fix TiKV panic when Titan is enabled and upgrade from < 5.0 versions to >= 5.0 versions. A cluster may hit the issue if it was upgraded from TiKV 3.x and enabled Titan before the upgrade in the past. [#10778](https://github.com/tikv/tikv/pull/10778) + - Fix the resolve failures caused by the left pessimisic locks. [#10654](https://github.com/tikv/tikv/pull/10654) + - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) + - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) + ++ TiFlash + + - Fix the potential panic issue that occurs when running table scan tasks + - Fix the potential memory leak issue that occurs when executing `MPP` tasks + - Fix a bug that TiFlash raises the error about `duplicated region` when handling `DAQ` requests + - Fix the issue of unexpected results when executing the aggregation functions `COUNT` or `COUNT DISTINCT` + - Fix the potential panic issue that occurs when executing `MPP` tasks + - Fix a potential bug that TiFlash cannot restore data when deployed on multiple disks + - Fix the potential panic issue that occurs when deconstructing `SharedQueryBlockInputStream` + - Fix the potential panic issue that occurs when deconstructing `MPPTask` + - Fix the issue of unexpected results when TiFlash failed to establish `MPP` connections + - Fix the potential panic issue that occurs when resolving locks + - Fix the issue that store size in metrics is inaccurate under heavy writing + - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT` `<` | `<=` | `>` | `>=` `COLUMN` + - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time + - Fix a potential bug that metrics display wrong value + - Fix the potential issue of data inconsistency that occurs when deployed on multiple disks + + PD - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) @@ -98,24 +148,6 @@ TiDB version: 5.0.4 - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) -+ TiKV - - - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10872](https://github.com/tikv/tikv/pull/10872) - - TiKV coprocessor slow log will only consider time spent on processing the request. [#10864](https://github.com/tikv/tikv/pull/10864) - - Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10864](https://github.com/tikv/tikv/pull/10864) - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version [#10843](https://github.com/tikv/tikv/pull/10843) - - Fix newer TiKV can't rollback to 5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) - - Fix TiKV panic when Titan is enabled and upgrade from < 5.0 versions to >= 5.0 versions. A cluster may hit the issue if it was upgraded from TiKV 3.x and enabled Titan before the upgrade in the past. [#10778](https://github.com/tikv/tikv/pull/10778) - - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) - - Reduce resolved ts message size to save network bandwidth. [#10678](https://github.com/tikv/tikv/pull/10678) - - Avoid false "GC can not work" alert under low write flow. [#10662](https://github.com/tikv/tikv/pull/10662) - - Fix the resolve failures caused by the left pessimisic locks. [#10654](https://github.com/tikv/tikv/pull/10654) - - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) - - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10587](https://github.com/tikv/tikv/pull/10587) - - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) - - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) - - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) - + PD - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) From 7e1977eafc8bed58493c503b0cda49ab9aecedac Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 15 Sep 2021 17:49:03 +0800 Subject: [PATCH 06/16] add tidb notes (excluding compatibility changes) --- releases/release-5.0.4.md | 78 +++++++++++++-------------------------- 1 file changed, 25 insertions(+), 53 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index ffe0f0960a09..d7656801b303 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -35,6 +35,18 @@ TiDB version: 5.0.4 + TiDB - Trigger auto-analyze based on histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) + - block the tiflash node for a period when it fails before. [#26757](https://github.com/pingcap/tidb/pull/26757) + - Increasing the split region limit makes the split table and pre split more stable [#26657](https://github.com/pingcap/tidb/pull/26657) + - support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) + - check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) + - support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) + - TiDB now supports the mysql system variable init_connect and associated functionality. [#26072](https://github.com/pingcap/tidb/pull/26072) + - thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) + - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) + - Add err label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) + - add table name in log [#24802](https://github.com/pingcap/tidb/pull/24802) + - Support getting the MVCC key of the secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) + - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) + TiKV @@ -51,24 +63,26 @@ TiDB version: 5.0.4 + TiDB - tidb panic while query hash partition table with is null condition [#26963](https://github.com/pingcap/tidb/pull/26963) - - planner: fix the unstable test case TestAnalyzeIncremental [#26851](https://github.com/pingcap/tidb/pull/26851) - Keep the overflow check logic same with mysql [#26724](https://github.com/pingcap/tidb/pull/26724) - Fix wrong charset and collation for case when function [#26672](https://github.com/pingcap/tidb/pull/26672) - - Fix the case that TiDB would return the wrong result when the children of the UNION contain pure NULL values [#26571](https://github.com/pingcap/tidb/pull/26571) - - Fix the issue that greatest(datetime) union null returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) - - fix incompatible last_day func behavior in sql mode [#26000](https://github.com/pingcap/tidb/pull/26000) - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25974](https://github.com/pingcap/tidb/pull/25974) - - Fix the wrong result after "insert ignore on duplicate update" in the secondary index has the same column in primary key but has prefix length [#25905](https://github.com/pingcap/tidb/pull/25905) - - Fix the wrong result for "insert ignore duplicate up" on partition table when handle changed and duplicated on secondary index [#25859](https://github.com/pingcap/tidb/pull/25859) - - fix wrong enum key in point get [#24772](https://github.com/pingcap/tidb/pull/24772) + - Fix the issue that point get does not use lite version resolve lock [#26560](https://github.com/pingcap/tidb/pull/26560) + - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) + - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) + - check filter condition in func convertToPartialTableScan [#25806](https://github.com/pingcap/tidb/pull/25806) + - Important security issue for handling ALTER USER statements [#25348](https://github.com/pingcap/tidb/pull/25348) + - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) + - Fix the bug that TIKV_REGION_PEERS table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) + - Handle a potential statistic object's memory leak when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) + - SQL Views now consider the default roles associated with the SQL DEFINER correctrly. [#24532](https://github.com/pingcap/tidb/pull/24532) + - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) - fix dml_batch_size doesn't load the global variable [#24731](https://github.com/pingcap/tidb/pull/24731) - - planner: filter conflict read_from_storage hints [#24374](https://github.com/pingcap/tidb/pull/24374) + - filter conflict read_from_storage hints [#24374](https://github.com/pingcap/tidb/pull/24374) - fix wrong type infer for agg function when type is null. [#24354](https://github.com/pingcap/tidb/pull/24354) - - fix wrong flen infer for bit constant [#24267](https://github.com/pingcap/tidb/pull/24267) - fix some potential panic in statistics [#24061](https://github.com/pingcap/tidb/pull/24061) - fix approx_percent panic on bit column [#23703](https://github.com/pingcap/tidb/pull/23703) - - fix get var expr when session var is hex literal [#23373](https://github.com/pingcap/tidb/pull/23373) - - fix unexpected constant fold when year compare string. [#23336](https://github.com/pingcap/tidb/pull/23336) + - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) + - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) + TiKV @@ -106,48 +120,6 @@ TiDB version: 5.0.4 ## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 -+ TiDB - - - fix wrong selection push down when having above agg [#27742](https://github.com/pingcap/tidb/pull/27742) - - fix expression rewrite makes between expr infers wrong collation. [#27548](https://github.com/pingcap/tidb/pull/27548) - - make `group_concat` function consider the collation [#27528](https://github.com/pingcap/tidb/pull/27528) - - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27507](https://github.com/pingcap/tidb/pull/27507) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27412](https://github.com/pingcap/tidb/pull/27412) - - expression: fix extract bug when argument is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) - - planner: add missing column for Apply convert to Join [#27283](https://github.com/pingcap/tidb/pull/27283) - - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27263](https://github.com/pingcap/tidb/pull/27263) - - executor: fix unexpected behavior when casting invalid string to date [#27110](https://github.com/pingcap/tidb/pull/27110) - - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26903](https://github.com/pingcap/tidb/pull/26903) - - store/copr: block the tiflash node for a period when it fails before. [#26757](https://github.com/pingcap/tidb/pull/26757) - - Increasing the split region limit makes the split table and pre split more stable [#26657](https://github.com/pingcap/tidb/pull/26657) - - Fix the issue that point get does not use lite version resolve lock [#26560](https://github.com/pingcap/tidb/pull/26560) - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) - - store/copr: support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) - - Support set tidb_enforce_mpp=1 to enforce use mpp mode. [#26382](https://github.com/pingcap/tidb/pull/26382) - - mpp: check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) - - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) - - fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) - - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) - - Change the lock record into put record for the index keys using point/batch point get for update read. [#26224](https://github.com/pingcap/tidb/pull/26224) - - load: fix load data with non-utf8 can succeed [#26143](https://github.com/pingcap/tidb/pull/26143) - - planner: support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) - - TiDB now supports the mysql system variable init_connect and associated functionality. [#26072](https://github.com/pingcap/tidb/pull/26072) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25873](https://github.com/pingcap/tidb/pull/25873) - - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) - - planner/core: thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) - - planner: check filter condition in func convertToPartialTableScan [#25806](https://github.com/pingcap/tidb/pull/25806) - - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) - - Important security issue for handling ALTER USER statements [#25348](https://github.com/pingcap/tidb/pull/25348) - - metrics: Add err label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) - - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) - - Fix the bug that TIKV_REGION_PEERS table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) - - add table name in log [#24802](https://github.com/pingcap/tidb/pull/24802) - - Handle a potential statistic object's memory leak when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) - - SQL Views now consider the default roles associated with the SQL DEFINER correctrly. [#24532](https://github.com/pingcap/tidb/pull/24532) - - Support getting the MVCC key of the secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) - - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) - - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) - + PD - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) From bf6d3f23b9d6cce4292f1d55f8c61c309d1d5a04 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 17 Sep 2021 11:02:47 +0800 Subject: [PATCH 07/16] add tidb pd tools notes --- releases/release-5.0.4.md | 103 +++++++++++++++++++++++++++----------- 1 file changed, 74 insertions(+), 29 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index d7656801b303..6be98f7be2ae 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -13,6 +13,26 @@ TiDB version: 5.0.4 + TiDB - Revert #19341 to avoid #24326 [#26258](https://github.com/pingcap/tidb/pull/26258) + - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25873](https://github.com/pingcap/tidb/pull/25873) + - These bug fixes change execution results, which may result in upgrading incompatibility: + - Fix the case that TiDB would return the wrong result when the children of the UNION contain pure NULL values [#26571](https://github.com/pingcap/tidb/pull/26571) + - Fix the issue that greatest(datetime) union null returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) + - fix incompatible last_day func behavior in sql mode [#26000](https://github.com/pingcap/tidb/pull/26000) + - fix having clause might not work correctly [#27742](https://github.com/pingcap/tidb/pull/27742) + - fix the result is wrong when the collations around the `between` expression are different. [#27548](https://github.com/pingcap/tidb/pull/27548) + - fix the result is wrong when the column in the `group_concat` function has a non-bin collation [#27528](https://github.com/pingcap/tidb/pull/27528) + - Fix bug that using a `count(distinct)` expression on multi-columns returns the wrong result when new collation is on. [#27507](https://github.com/pingcap/tidb/pull/27507) + - fix the result is wrong when the argument of `extract` function is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) + - fix inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#27110](https://github.com/pingcap/tidb/pull/27110) + - Fix bug that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE'. [#26903](https://github.com/pingcap/tidb/pull/26903) + - fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) + - Fix the issue that the `LOAD DATA` statement might abnormally import non-utf8 data [#26143](https://github.com/pingcap/tidb/pull/26143) + - Fix the data might be wrong after "insert ignore on duplicate update" when the secondary index has the same column in the primary key [#25905](https://github.com/pingcap/tidb/pull/25905) + - Fix the data might be wrong after "insert ignore duplicate update" on partition table when the table has a clustered index [#25859](https://github.com/pingcap/tidb/pull/25859) + - fix the result is wrong when the key is `enum` type in point get or batch point get [#24772](https://github.com/pingcap/tidb/pull/24772) + - fix the result is wrong when dividing a `bit` value [#24267](https://github.com/pingcap/tidb/pull/24267) + - fix the result might be different between prepared statements and direct queries [#23373](https://github.com/pingcap/tidb/pull/23373) + - fix the result might be wrong when a `year` type compares with a string or integer type. [#23336](https://github.com/pingcap/tidb/pull/23336) ## Feature enhancements @@ -24,6 +44,10 @@ TiDB version: 5.0.4 - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) ++ PD + + - TiDB Dashboard: Add OIDC based SSO support [#3884](https://github.com/tikv/pd/pull/3884) + + TiFlash - Support the `HAVING()` function in DAG requests @@ -40,12 +64,11 @@ TiDB version: 5.0.4 - support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) - check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) - support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) - - TiDB now supports the mysql system variable init_connect and associated functionality. [#26072](https://github.com/pingcap/tidb/pull/26072) + - Support the MySQL system variable init_connect and its associated features. [#26072](https://github.com/pingcap/tidb/pull/26072) - thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) - - Add err label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) - - add table name in log [#24802](https://github.com/pingcap/tidb/pull/24802) - - Support getting the MVCC key of the secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) + - Add error label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) + - Support getting the MVCC key through a secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) + TiKV @@ -58,30 +81,54 @@ TiDB version: 5.0.4 - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) ++ PD + + - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) + ++ Tools + + + Dumpling + + - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT + - Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#327](https://github.com/pingcap/dumpling/pull/327) + + + TiCDC + + - Optimize memory management when unified sorter is using memory to sort. [#2711](https://github.com/pingcap/ticdc/pull/2711) + - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) + - Prohibit operating TiCDC clusters across major and minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) + - Remove file sorter. [#2326](https://github.com/pingcap/ticdc/pull/2326) + - puller,mounter,processor: always pull the old value internally [#2305](https://github.com/pingcap/ticdc/pull/2305) + - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) + - Cleanup changefeed metrics when changefeed is removed. + - Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) + - Optimize workerpool for fewer goroutines when concurrency is high. [#2487](https://github.com/pingcap/ticdc/pull/2487) + - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) + ## Bug Fixes + TiDB - - tidb panic while query hash partition table with is null condition [#26963](https://github.com/pingcap/tidb/pull/26963) - - Keep the overflow check logic same with mysql [#26724](https://github.com/pingcap/tidb/pull/26724) + - Fix tidb might panic while query hash partition table with `IS NULL` condition [#26963](https://github.com/pingcap/tidb/pull/26963) + - Fix the overflow check of `float64` type is different with MySQL [#26724](https://github.com/pingcap/tidb/pull/26724) - Fix wrong charset and collation for case when function [#26672](https://github.com/pingcap/tidb/pull/26672) - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25974](https://github.com/pingcap/tidb/pull/25974) - - Fix the issue that point get does not use lite version resolve lock [#26560](https://github.com/pingcap/tidb/pull/26560) - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) - - check filter condition in func convertToPartialTableScan [#25806](https://github.com/pingcap/tidb/pull/25806) - - Important security issue for handling ALTER USER statements [#25348](https://github.com/pingcap/tidb/pull/25348) + - Fix the bug that a column may not be found when using INDEX MERGE [#25806](https://github.com/pingcap/tidb/pull/25806) + - Fix the bug that `ALTER USER REQUIRE SSL` clears the user's `authentication_string` [#25348](https://github.com/pingcap/tidb/pull/25348) - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) - - Fix the bug that TIKV_REGION_PEERS table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) - - Handle a potential statistic object's memory leak when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) - - SQL Views now consider the default roles associated with the SQL DEFINER correctrly. [#24532](https://github.com/pingcap/tidb/pull/24532) - - Set the return value to 0 if --help is passed to cli, for golang below version 1.15 [#24074](https://github.com/pingcap/tidb/pull/24074) - - fix dml_batch_size doesn't load the global variable [#24731](https://github.com/pingcap/tidb/pull/24731) - - filter conflict read_from_storage hints [#24374](https://github.com/pingcap/tidb/pull/24374) - - fix wrong type infer for agg function when type is null. [#24354](https://github.com/pingcap/tidb/pull/24354) - - fix some potential panic in statistics [#24061](https://github.com/pingcap/tidb/pull/24061) - - fix approx_percent panic on bit column [#23703](https://github.com/pingcap/tidb/pull/23703) - - Fix copt-cache metrics, it will display the number of hits/miss/evict on Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) + - Fix the bug that `TIKV_REGION_PEERS` table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) + - Fix the bug that memory leaks when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) + - Fix the bug that views don't support `DEFINER`. [#24532](https://github.com/pingcap/tidb/pull/24532) + - Fix the bug that `tidb-server --help` exits with code 2 [#24074](https://github.com/pingcap/tidb/pull/24074) + - fix the bug that setting the global variable `dml_batch_size` doesn't take effect [#24731](https://github.com/pingcap/tidb/pull/24731) + - Fix the bug that using `read_from_storage` and partition tables will report an error [#24374](https://github.com/pingcap/tidb/pull/24374) + - fix using aggregation functions may panic. [#24354](https://github.com/pingcap/tidb/pull/24354) + - fix queries may panic due to statistics [#24061](https://github.com/pingcap/tidb/pull/24061) + - fix `approx_percentile` may panic on a bit column [#23703](https://github.com/pingcap/tidb/pull/23703) + - Fix the metrics in `Coprocessor Cache` is wrong in Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) + TiKV @@ -94,6 +141,14 @@ TiDB version: 5.0.4 - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) ++ PD + + - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) + - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) + - Reduce the conflict due to multiple scheduler running in same time [#3856](https://github.com/tikv/pd/pull/3856) + - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3823](https://github.com/tikv/pd/pull/3823) + + TiFlash - Fix the potential panic issue that occurs when running table scan tasks @@ -118,16 +173,6 @@ TiDB version: 5.0.4 - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) -## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 - -+ PD - - - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) - - Improved the performance of synchronizing Region information between PDs. [#3934](https://github.com/tikv/pd/pull/3934) - - TiDB Dashboard: Add OIDC based SSO support [#3884](https://github.com/tikv/pd/pull/3884) - - Reduce the conflict due to multiple scheduler running in same time [#3856](https://github.com/tikv/pd/pull/3856) - - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3823](https://github.com/tikv/pd/pull/3823) - + Tools + Dumpling From 43e818c4883b34455e60bab7e93f339d4dc1f3e3 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 17 Sep 2021 18:05:35 +0800 Subject: [PATCH 08/16] revise < L130 --- releases/release-5.0.4.md | 163 ++++++++++++++++++-------------------- 1 file changed, 78 insertions(+), 85 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 6be98f7be2ae..97291d2b213e 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -8,45 +8,45 @@ Release Date: September 27, 2021 TiDB version: 5.0.4 -## Compatibility Changes +## Compatibility changes + TiDB - - Revert #19341 to avoid #24326 [#26258](https://github.com/pingcap/tidb/pull/26258) - - Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000 [#25873](https://github.com/pingcap/tidb/pull/25873) - - These bug fixes change execution results, which may result in upgrading incompatibility: - - Fix the case that TiDB would return the wrong result when the children of the UNION contain pure NULL values [#26571](https://github.com/pingcap/tidb/pull/26571) - - Fix the issue that greatest(datetime) union null returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) - - fix incompatible last_day func behavior in sql mode [#26000](https://github.com/pingcap/tidb/pull/26000) - - fix having clause might not work correctly [#27742](https://github.com/pingcap/tidb/pull/27742) - - fix the result is wrong when the collations around the `between` expression are different. [#27548](https://github.com/pingcap/tidb/pull/27548) - - fix the result is wrong when the column in the `group_concat` function has a non-bin collation [#27528](https://github.com/pingcap/tidb/pull/27528) - - Fix bug that using a `count(distinct)` expression on multi-columns returns the wrong result when new collation is on. [#27507](https://github.com/pingcap/tidb/pull/27507) - - fix the result is wrong when the argument of `extract` function is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) - - fix inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#27110](https://github.com/pingcap/tidb/pull/27110) - - Fix bug that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE'. [#26903](https://github.com/pingcap/tidb/pull/26903) - - fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) + - Fix the issue that executing `SHOW VARIABLES` in a new session is slow. This fix reverts some changes made in [#19341](https://github.com/pingcap/tidb/pull/19341) and might cause compatibility issues. [#24326](https://github.com/pingcap/tidb/issues/24326) + - Change the default value of the `tidb_stmt_summary_max_stmt_count` variable from `200` to `3000` [#25873](https://github.com/pingcap/tidb/pull/25873) + + The following bug fixes change execution results, which might cause upgrade incompatibilities: + - Fix the issue that TiDB returns wrong result when the children of `UNION` contain the `NULL` value [#26571](https://github.com/pingcap/tidb/pull/26571) + - Fix the issue that `greatest(datetime) union null` returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) + - Fix the issue that the behavior of the `last_day` function is incompatible in SQL mode [#26000](https://github.com/pingcap/tidb/pull/26000) + - Fix the issue that the `having` clause might not work correctly [#27742](https://github.com/pingcap/tidb/pull/27742) + - Fix the wrong execution results that occur when the collations around the `between` expression are different [#27548](https://github.com/pingcap/tidb/pull/27548) + - Fix the wrong execution results that occur when the column in the `group_concat` function has a non-bin collation [#27528](https://github.com/pingcap/tidb/pull/27528) + - Fix an issue that using a `count(distinct)` expression on multiple columns returns wrong result when the new collation is enabled [#27507](https://github.com/pingcap/tidb/pull/27507) + - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) + - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#27110](https://github.com/pingcap/tidb/pull/27110) + - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26903](https://github.com/pingcap/tidb/pull/26903) + - Fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) - Fix the issue that the `LOAD DATA` statement might abnormally import non-utf8 data [#26143](https://github.com/pingcap/tidb/pull/26143) - - Fix the data might be wrong after "insert ignore on duplicate update" when the secondary index has the same column in the primary key [#25905](https://github.com/pingcap/tidb/pull/25905) - - Fix the data might be wrong after "insert ignore duplicate update" on partition table when the table has a clustered index [#25859](https://github.com/pingcap/tidb/pull/25859) - - fix the result is wrong when the key is `enum` type in point get or batch point get [#24772](https://github.com/pingcap/tidb/pull/24772) - - fix the result is wrong when dividing a `bit` value [#24267](https://github.com/pingcap/tidb/pull/24267) - - fix the result might be different between prepared statements and direct queries [#23373](https://github.com/pingcap/tidb/pull/23373) - - fix the result might be wrong when a `year` type compares with a string or integer type. [#23336](https://github.com/pingcap/tidb/pull/23336) + - Fix the issue that `insert ignore on duplicate update` might insert wrong data when the secondary index has the same column as in the primary key [#25905](https://github.com/pingcap/tidb/pull/25905) + - Fix the issue that `insert ignore duplicate update` might insert wrong data when a partitioned table has a clustered index [#25859](https://github.com/pingcap/tidb/pull/25859) + - Fix the issue that the query result might be wrong when the key is the `ENUM` type in point get or batch point get [#24772](https://github.com/pingcap/tidb/pull/24772) + - Fix the wrong result that occurs when dividing a `BIT`-type value [#24267](https://github.com/pingcap/tidb/pull/24267) + - Fix the issue that the results of `prepared` statements and direct queries might be inconsistent [#23373](https://github.com/pingcap/tidb/pull/23373) + - Fix the issue that the query result might be wrong when a `YEAR` type is compared with a string or an integer type [#23336](https://github.com/pingcap/tidb/pull/23336) ## Feature enhancements + TiDB -- Support set `tidb_enforce_mpp=1` to enforce use mpp mode [#26382](https://github.com/pingcap/tidb/pull/26382) + - Support setting `tidb_enforce_mpp=1` to ignore the optimizer estimation and forcibly use the MPP mode [#26382](https://github.com/pingcap/tidb/pull/26382) + TiKV - - Support changing CDC configs dynamically [#10685](https://github.com/tikv/tikv/pull/10685) + - Support changing TiCDC configurations dynamically [#10685](https://github.com/tikv/tikv/pull/10685) + PD - - TiDB Dashboard: Add OIDC based SSO support [#3884](https://github.com/tikv/pd/pull/3884) + - Add OIDC-based SSO support for TiDB Dashboard [#3884](https://github.com/tikv/pd/pull/3884) + TiFlash @@ -58,78 +58,79 @@ TiDB version: 5.0.4 + TiDB - - Trigger auto-analyze based on histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) - - block the tiflash node for a period when it fails before. [#26757](https://github.com/pingcap/tidb/pull/26757) - - Increasing the split region limit makes the split table and pre split more stable [#26657](https://github.com/pingcap/tidb/pull/26657) - - support retry for mpp query [#26483](https://github.com/pingcap/tidb/pull/26483) - - check the tiflash availabilities before launching mpp queries. [#26356](https://github.com/pingcap/tidb/pull/26356) - - support stable result mode [#26084](https://github.com/pingcap/tidb/pull/26084) - - Support the MySQL system variable init_connect and its associated features. [#26072](https://github.com/pingcap/tidb/pull/26072) - - thoroughly push down count-distinct agg in the MPP mode. [#25861](https://github.com/pingcap/tidb/pull/25861) - - Log warnings when agg function can not be pushdown in explain statement [#25736](https://github.com/pingcap/tidb/pull/25736) - - Add error label for TiFlashQueryTotalCounter [#25327](https://github.com/pingcap/tidb/pull/25327) - - Support getting the MVCC key through a secondary index in a clustered index table by HTTP API. [#24470](https://github.com/pingcap/tidb/pull/24470) - - Optimize the parser object allocation in the prepared statement. [#24371](https://github.com/pingcap/tidb/pull/24371) + - Trigger auto-analyze based on the histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) + - Do not send requests to a TiFlash node for a period if it has failed and restarted before [#26757](https://github.com/pingcap/tidb/pull/26757) + - Increase the `split region` limit to make `split table` and `presplit` more stable [#26657](https://github.com/pingcap/tidb/pull/26657) + - Support retry for MPP queries [#26483](https://github.com/pingcap/tidb/pull/26483) + - Check the availability of TiFlash before launching MPP queries [#26356](https://github.com/pingcap/tidb/pull/26356) + - Support the stable result mode to make the query result more stable [#26084](https://github.com/pingcap/tidb/pull/26084) + - Support the MySQL system variable `init_connect` and its associated features [#26072](https://github.com/pingcap/tidb/pull/26072) + - Thoroughly push down the `COUNT(DISTINCT)` aggregation function in the MPP mode [#25861](https://github.com/pingcap/tidb/pull/25861) + - Print log warnings when the aggregation function cannot be pushed down in `EXPLAIN` statements [#25736](https://github.com/pingcap/tidb/pull/25736) + - Add error labels for `TiFlashQueryTotalCounter` in Grafana dashboard [#25327](https://github.com/pingcap/tidb/pull/25327) + - Support getting the MVCC data of a clustered index table through a secondary index by HTTP API [#24470](https://github.com/pingcap/tidb/pull/24470) + - Optimize the memory allocation of `prepared` statement in parser [#24371](https://github.com/pingcap/tidb/pull/24371) + TiKV - - Reduce resolved ts message size to save network bandwidth. [#10678](https://github.com/tikv/tikv/pull/10678) - - Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10864](https://github.com/tikv/tikv/pull/10864) - - TiKV coprocessor slow log will only consider time spent on processing the request. [#10864](https://github.com/tikv/tikv/pull/10864) - - Make prewrite as idempotent as possible to reduce the chance of undetermined errors. [#10587](https://github.com/tikv/tikv/pull/10587) - - Avoid false "GC can not work" alert under low write flow. [#10662](https://github.com/tikv/tikv/pull/10662) - - Database restored from BR or Lightning Local-backend is now smaller, should be matching the original cluster size when backed up. [#10643](https://github.com/tikv/tikv/pull/10643) - - Ensure panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) + - Handle read ready and write ready separately to reduce read latency [#10620](https://github.com/tikv/tikv/pull/10620) + - Reduce the size of Resolved TS messages to save network bandwidth [#10678](https://github.com/tikv/tikv/pull/10678) + - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10864](https://github.com/tikv/tikv/pull/10864) + - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10864](https://github.com/tikv/tikv/pull/10864) + - Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10587](https://github.com/tikv/tikv/pull/10587) + - Avoid the false "GC can not work" alert under low write flow [#10662](https://github.com/tikv/tikv/pull/10662) + - The database to be restored always matches the original cluster size during backup. [#10643](https://github.com/tikv/tikv/pull/10643) + - Ensure that the panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) + PD - - Improved the performance of synchronizing Region information between PDs. [#3993](https://github.com/tikv/pd/pull/3993) + - Improve the performance of synchronizing Region information between PDs [#3993](https://github.com/tikv/pd/pull/3993) + Tools + Dumpling - - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT - - Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#327](https://github.com/pingcap/dumpling/pull/327) + - Support backing up MySQL-compatible databases that do not support the `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` or the `SHOW CREATE DATABASE` syntax + TiCDC - - Optimize memory management when unified sorter is using memory to sort. [#2711](https://github.com/pingcap/ticdc/pull/2711) - - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) - - Prohibit operating TiCDC clusters across major and minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) - - Remove file sorter. [#2326](https://github.com/pingcap/ticdc/pull/2326) - - puller,mounter,processor: always pull the old value internally [#2305](https://github.com/pingcap/ticdc/pull/2305) - - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) - - Cleanup changefeed metrics when changefeed is removed. - - Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) - - Optimize workerpool for fewer goroutines when concurrency is high. [#2487](https://github.com/pingcap/ticdc/pull/2487) - - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) + - Optimize memory management when unified sorter is using memory to sort [#2711](https://github.com/pingcap/ticdc/pull/2711) + - Prohibit operating TiCDC clusters across major or minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) + - Reduce the goroutine usage when a table's Regions are all transferred away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) + - Remove `file sorter` [#2326](https://github.com/pingcap/ticdc/pull/2326) + - Always pull the old values from TiKV and the output is adjusted according to `enable-old-value` [#2305](https://github.com/pingcap/ticdc/pull/2305) + - Improve the error message returned when a PD endpoint misses the certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) + - Optimize workerpool for fewer goroutines when concurrency is high [#2487](https://github.com/pingcap/ticdc/pull/2487) + - Add a global gRPC connection pool and share gRPC connections among KV clients [#2533](https://github.com/pingcap/ticdc/pull/2533) ## Bug Fixes + TiDB - - Fix tidb might panic while query hash partition table with `IS NULL` condition [#26963](https://github.com/pingcap/tidb/pull/26963) - - Fix the overflow check of `float64` type is different with MySQL [#26724](https://github.com/pingcap/tidb/pull/26724) - - Fix wrong charset and collation for case when function [#26672](https://github.com/pingcap/tidb/pull/26672) - - Fix the issue that committing pessimistic transactions may report write-conflict errors. [#25974](https://github.com/pingcap/tidb/pull/25974) - - Fix the bug that index keys in a pessimistic transaction may be repeatedly committed. [#26495](https://github.com/pingcap/tidb/pull/26495) - - Fix the issue that TiDB may panic when resolving async-commit locks. [#25863](https://github.com/pingcap/tidb/pull/25863) - - Fix the bug that a column may not be found when using INDEX MERGE [#25806](https://github.com/pingcap/tidb/pull/25806) - - Fix the bug that `ALTER USER REQUIRE SSL` clears the user's `authentication_string` [#25348](https://github.com/pingcap/tidb/pull/25348) - - Fix a bug that a new cluster's "tidb_gc_scan_lock_mode" global variable shows "PHYSICAL" instead of the actual default mode "LEGACY". [#25118](https://github.com/pingcap/tidb/pull/25118) - - Fix the bug that `TIKV_REGION_PEERS` table did not have the correct DOWN status. [#24919](https://github.com/pingcap/tidb/pull/24919) - - Fix the bug that memory leaks when HTTP api is used [#24649](https://github.com/pingcap/tidb/pull/24649) - - Fix the bug that views don't support `DEFINER`. [#24532](https://github.com/pingcap/tidb/pull/24532) - - Fix the bug that `tidb-server --help` exits with code 2 [#24074](https://github.com/pingcap/tidb/pull/24074) - - fix the bug that setting the global variable `dml_batch_size` doesn't take effect [#24731](https://github.com/pingcap/tidb/pull/24731) - - Fix the bug that using `read_from_storage` and partition tables will report an error [#24374](https://github.com/pingcap/tidb/pull/24374) - - fix using aggregation functions may panic. [#24354](https://github.com/pingcap/tidb/pull/24354) - - fix queries may panic due to statistics [#24061](https://github.com/pingcap/tidb/pull/24061) - - fix `approx_percentile` may panic on a bit column [#23703](https://github.com/pingcap/tidb/pull/23703) - - Fix the metrics in `Coprocessor Cache` is wrong in Grafana. [#26343](https://github.com/pingcap/tidb/pull/26343) - - Fix the issue that concurrently truncating the same partition hangs DDL. [#26238](https://github.com/pingcap/tidb/pull/26238) + - Fix the issue that TiDB might panic when querying a partitioned table and the partition key has the `IS NULL` condition [#26963](https://github.com/pingcap/tidb/pull/26963) + - Fix the issue that the overflow check of the `FLOAT64` type is different with that of MySQL [#26724](https://github.com/pingcap/tidb/pull/26724) + - Fix the wrong character set and collation for the `case when` function [#26672](https://github.com/pingcap/tidb/pull/26672) + - Fix the issue that committing pessimistic transactions might cause write conflicts [#25974](https://github.com/pingcap/tidb/pull/25974) + - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26495](https://github.com/pingcap/tidb/pull/26495) + - Fix the issue that TiDB might panic when resolving the async commit locks [#25863](https://github.com/pingcap/tidb/pull/25863) + - Fix a bug that a column might not be found when using `INDEX MERGE` [#25806](https://github.com/pingcap/tidb/pull/25806) + - Fix a bug that `ALTER USER REQUIRE SSL` clears users' `authentication_string` [#25348](https://github.com/pingcap/tidb/pull/25348) + - Fix a bug that the value of the `tidb_gc_scan_lock_mode` global variable on a new cluster shows "PHYSICAL" instead of the actual default mode "LEGACY" [#25118](https://github.com/pingcap/tidb/pull/25118) + - Fix the bug that the `TIKV_REGION_PEERS` system table does not show the correct `DOWN` status [#24919](https://github.com/pingcap/tidb/pull/24919) + - Fix the issue of memory leaks that occurs when HTTP API is used [#24649](https://github.com/pingcap/tidb/pull/24649) + - Fix the issue that views does not support `DEFINER` [#24532](https://github.com/pingcap/tidb/pull/24532) + - Fix the issue that `tidb-server --help` exits with the code `2` [#24074](https://github.com/pingcap/tidb/pull/24074) + - Fix the issue that setting the global variable `dml_batch_size` does not take effect [#24731](https://github.com/pingcap/tidb/pull/24731) + - Fix the issue that using `read_from_storage` and partitioned table at the same time causes an error [#24374](https://github.com/pingcap/tidb/pull/24374) + - Fix the issue that TiDB panics when executing the projection operator [#24354](https://github.com/pingcap/tidb/pull/24354) + - Fix the issue that queries might panic due to statistics [#24061](https://github.com/pingcap/tidb/pull/24061) + - Fix the issue that using the `approx_percentile` function might panic on a `BIT` column [#23703](https://github.com/pingcap/tidb/pull/23703) + - Fix the issue that the metrics on the **Coprocessor Cache** panel are wrong in Grafana [#26343](https://github.com/pingcap/tidb/pull/26343) + - Fix the issue that concurrently truncating the same partition causes DDL statements to stuck [#26238](https://github.com/pingcap/tidb/pull/26238) + - [planner, expression: avoid exprs with side effects in column pruning and agg pushdown (#27370) by ti-srebot · Pull Request #27637 · pingcap/tidb](https://github.com/pingcap/tidb/pull/27637) + - [executor: fix hash join between datetime and timestamp (#25915) by ti-srebot · Pull Request #25990 · pingcap/tidb](https://github.com/pingcap/tidb/pull/25990) + - [expression: do not derive filters containing null sensitive functions from outer join (#27067) by ti-srebot · Pull Request #27194 · pingcap/tidb](https://github.com/pingcap/tidb/pull/27194) + - [planner: add missing column for Apply convert to Join (#27246) by ti-srebot · Pull Request #27283 · pingcap/tidb](https://github.com/pingcap/tidb/pull/27283) + TiKV @@ -187,28 +188,20 @@ TiDB version: 5.0.4 - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2728](https://github.com/pingcap/ticdc/pull/2728) - Fix OOM when TiCDC captures too many regions [#2724](https://github.com/pingcap/ticdc/pull/2724) - Fix gRPC keepalive error when memory pressure is high. [#2719](https://github.com/pingcap/ticdc/pull/2719) - - Optimize memory management when unified sorter is using memory to sort. [#2711](https://github.com/pingcap/ticdc/pull/2711) - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2655](https://github.com/pingcap/ticdc/pull/2655) - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2620](https://github.com/pingcap/ticdc/pull/2620) - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/ticdc/pull/2610) - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) - - Prohibit operating TiCDC clusters across major and minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) - - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2533](https://github.com/pingcap/ticdc/pull/2533) - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2492](https://github.com/pingcap/ticdc/pull/2492) - - Optimize workerpool for fewer goroutines when concurrency is high. [#2487](https://github.com/pingcap/ticdc/pull/2487) - fix outdated capture info may appear in capture list command [#2466](https://github.com/pingcap/ticdc/pull/2466) - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2458](https://github.com/pingcap/ticdc/pull/2458) - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2456](https://github.com/pingcap/ticdc/pull/2456) - fix a bug where synchronizing large tables to cdclog failed. [#2445](https://github.com/pingcap/ticdc/pull/2445) - Fix CLI back-compatibility [#2413](https://github.com/pingcap/ticdc/pull/2413) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) - - Remove file sorter. [#2326](https://github.com/pingcap/ticdc/pull/2326) - - puller,mounter,processor: always pull the old value internally [#2305](https://github.com/pingcap/ticdc/pull/2305) - Fix minor runtime panic risk [#2299](https://github.com/pingcap/ticdc/pull/2299) - Fix potential DDL loss when owner crashes while executing DDL [#2292](https://github.com/pingcap/ticdc/pull/2292) - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) - Fix extra partition dispatching when adding new table partition. [#2263](https://github.com/pingcap/ticdc/pull/2263) - - Better err msg when PD endpoint missing certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) - Cleanup changefeed metrics when changefeed is removed. - Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) From 4e90568e68129ab394fa669a49098fe746a0f33a Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 17 Sep 2021 19:56:46 +0800 Subject: [PATCH 09/16] revise < 146 --- releases/release-5.0.4.md | 21 ++++++++++----------- 1 file changed, 10 insertions(+), 11 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 97291d2b213e..cfd9fdfd8111 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -127,20 +127,19 @@ TiDB version: 5.0.4 - Fix the issue that using the `approx_percentile` function might panic on a `BIT` column [#23703](https://github.com/pingcap/tidb/pull/23703) - Fix the issue that the metrics on the **Coprocessor Cache** panel are wrong in Grafana [#26343](https://github.com/pingcap/tidb/pull/26343) - Fix the issue that concurrently truncating the same partition causes DDL statements to stuck [#26238](https://github.com/pingcap/tidb/pull/26238) - - [planner, expression: avoid exprs with side effects in column pruning and agg pushdown (#27370) by ti-srebot · Pull Request #27637 · pingcap/tidb](https://github.com/pingcap/tidb/pull/27637) - - [executor: fix hash join between datetime and timestamp (#25915) by ti-srebot · Pull Request #25990 · pingcap/tidb](https://github.com/pingcap/tidb/pull/25990) - - [expression: do not derive filters containing null sensitive functions from outer join (#27067) by ti-srebot · Pull Request #27194 · pingcap/tidb](https://github.com/pingcap/tidb/pull/27194) - - [planner: add missing column for Apply convert to Join (#27246) by ti-srebot · Pull Request #27283 · pingcap/tidb](https://github.com/pingcap/tidb/pull/27283) + - Fix the issue of wrong query results that occurs when the session variable is used as the `GROUP BY` item [#27637](https://github.com/pingcap/tidb/pull/27637) + - Fix the wrong implicit conversion between `VARCHAR` and timestamp when joining tables [#25990](https://github.com/pingcap/tidb/pull/25990) + - Fix the wrong results in associated subquery statements [#27283](https://github.com/pingcap/tidb/pull/27283) + TiKV - - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10872](https://github.com/tikv/tikv/pull/10872) - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version [#10843](https://github.com/tikv/tikv/pull/10843) - - Fix newer TiKV can't rollback to 5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) - - Fix TiKV panic when Titan is enabled and upgrade from < 5.0 versions to >= 5.0 versions. A cluster may hit the issue if it was upgraded from TiKV 3.x and enabled Titan before the upgrade in the past. [#10778](https://github.com/tikv/tikv/pull/10778) - - Fix the resolve failures caused by the left pessimisic locks. [#10654](https://github.com/tikv/tikv/pull/10654) - - Fix duration calculation panics on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) - - Fix unencoded keys of `batch_get_command` in load-base-split [#10564](https://github.com/tikv/tikv/pull/10564) + ?- Fix the issue that snapshot GC might miss GC snapshot files when there is a snapshot file failed to be garbage-collected [#10872](https://github.com/tikv/tikv/pull/10872) + - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10843](https://github.com/tikv/tikv/pull/10843) + - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) + - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 versions to a 5.0 version or later. If a cluster was upgraded from TiKV v3.x with Titan enabled before the upgrade in the past, this cluster might encounter the issue. [#10778](https://github.com/tikv/tikv/pull/10778) + - Fix the parsing failure caused by the left pessimistic locks [#10654](https://github.com/tikv/tikv/pull/10654) + - Fix the panic that occurs when calculating duration on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) + - Fix the issue that the keys of `batch_get_command` in Load Base Split are unencoded [#10564](https://github.com/tikv/tikv/pull/10564) + PD From eb8d0da4d99b488d1e1cbf845843f8e68058f427 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sat, 18 Sep 2021 10:10:22 +0800 Subject: [PATCH 10/16] revise < 150 --- releases/release-5.0.4.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index cfd9fdfd8111..4b819af7177f 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -143,11 +143,11 @@ TiDB version: 5.0.4 + PD - - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) - - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) - - Reduce the conflict due to multiple scheduler running in same time [#3856](https://github.com/tikv/pd/pull/3856) - - Fix the issue that the scheduler may appear again even if we have already executed the delete operation [#3823](https://github.com/tikv/pd/pull/3823) + - Fix the issue that PD does not fix the down peers in time [#4082](https://github.com/tikv/pd/pull/4082) + - Fix the issue that the replica count of the default placement rules stays constant after `replication.max-replicas` is updated [#3914](https://github.com/tikv/pd/pull/3914) + - Fix a bug that PD might panic when scaling out TiKV [#3910](https://github.com/tikv/pd/pull/3910) + - Fix the scheduling conflict issue that occurs when multiple schedulers are running at same time [#3856](https://github.com/tikv/pd/pull/3856) + - Fix the issue that the scheduler might appear again even if it has been deleted [#3823](https://github.com/tikv/pd/pull/3823) + TiFlash From c9f3d19dbcc0bf1e8a83315722fa1e0af1d7811d Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sat, 18 Sep 2021 13:52:19 +0800 Subject: [PATCH 11/16] the rest --- releases/release-5.0.4.md | 65 +++++++++++++++++---------------------- 1 file changed, 28 insertions(+), 37 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 4b819af7177f..a994d7a076c9 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -152,55 +152,46 @@ TiDB version: 5.0.4 + TiFlash - Fix the potential panic issue that occurs when running table scan tasks - - Fix the potential memory leak issue that occurs when executing `MPP` tasks - - Fix a bug that TiFlash raises the error about `duplicated region` when handling `DAQ` requests + - Fix the potential memory leak issue that occurs when executing MPP tasks + - Fix a bug that TiFlash raises the `duplicated region` error when handling DAQ requests - Fix the issue of unexpected results when executing the aggregation functions `COUNT` or `COUNT DISTINCT` - - Fix the potential panic issue that occurs when executing `MPP` tasks + - Fix the potential panic issue that occurs when executing MPP tasks - Fix a potential bug that TiFlash cannot restore data when deployed on multiple disks - Fix the potential panic issue that occurs when deconstructing `SharedQueryBlockInputStream` - Fix the potential panic issue that occurs when deconstructing `MPPTask` - - Fix the issue of unexpected results when TiFlash failed to establish `MPP` connections + - Fix the issue of unexpected results when TiFlash fails to establish MPP connections - Fix the potential panic issue that occurs when resolving locks - - Fix the issue that store size in metrics is inaccurate under heavy writing + - Fix the issue that the store size in metrics is inaccurate under heavy writing - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT` `<` | `<=` | `>` | `>=` `COLUMN` - - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time - - Fix a potential bug that metrics display wrong value - - Fix the potential issue of data inconsistency that occurs when deployed on multiple disks - -+ PD - - - Fix the bug that PD would not fix down-peer in time. [#4082](https://github.com/tikv/pd/pull/4082) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3914](https://github.com/tikv/pd/pull/3914) - - Fix the bug that PD may panic during scaling out TiKV. [#3910](https://github.com/tikv/pd/pull/3910) + - Fix the potential issue that TiFlash cannot garbage-collect the delta data after running for a long time + - Fix a potential bug that metrics display wrong values + - Fix the potential issue of data inconsistency that occurs when TiFlash is deployed on multiple disks + Tools + Dumpling - - fix pending on show table status in some mysql version [#342](https://github.com/pingcap/dumpling/pull/342) - - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT - - Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#327](https://github.com/pingcap/dumpling/pull/327) + - Fix the issue that the execution of `show table status` is stuck in MySQL 8.0.3 or a later version [#342](https://github.com/pingcap/dumpling/pull/342) + TiCDC - - Fix json encoding could panic when processing a string type value in some cases. [#2782](https://github.com/pingcap/ticdc/pull/2782) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2728](https://github.com/pingcap/ticdc/pull/2728) - - Fix OOM when TiCDC captures too many regions [#2724](https://github.com/pingcap/ticdc/pull/2724) - - Fix gRPC keepalive error when memory pressure is high. [#2719](https://github.com/pingcap/ticdc/pull/2719) - - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2655](https://github.com/pingcap/ticdc/pull/2655) - - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2620](https://github.com/pingcap/ticdc/pull/2620) - - Fixed a bug in DDL handling when the owner restarts. [#2610](https://github.com/pingcap/ticdc/pull/2610) - - This PR make the old owner handle DDL in Async mode. [#2605](https://github.com/pingcap/ticdc/pull/2605) + - Fix the issue of process panic that occurs when encoding the data types such as `mysql.TypeString, mysql.TypeVarString, mysql.TypeVarchar` into JSON [#2782](https://github.com/pingcap/ticdc/pull/2782) + - Fix a data inconsistency issue that occurs because multiple processors might write data to the same table when this table is being re-scheduled [#2728](https://github.com/pingcap/ticdc/pull/2728) + - Decrease the gRPC window size to avoid the OOM that occurs when TiCDC captures too many Regions [#2724](https://github.com/pingcap/ticdc/pull/2724) + - Fix the error that the gRPC connection is frequently broken when the memory pressure is high [#2719](https://github.com/pingcap/ticdc/pull/2719) + - Fix a bug that causes TiCDC to panic on the unsigned `TINYINT` type [#2655](https://github.com/pingcap/ticdc/pull/2655) + - Fix the issue that TiCDC Open Protocol outputs an empty value when inserting a transaction and deleting data of the same row in the upstream [#2620](https://github.com/pingcap/ticdc/pull/2620) + - Fix a bug that DDL handling fails when a changefeed starts at the finish TS of a schema change [#2610](https://github.com/pingcap/ticdc/pull/2610) + - Fix the issue that irresponsive downstreams interrupt the replication task in old owner until the task times out [#2605](https://github.com/pingcap/ticdc/pull/2605) - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2492](https://github.com/pingcap/ticdc/pull/2492) - - fix outdated capture info may appear in capture list command [#2466](https://github.com/pingcap/ticdc/pull/2466) - - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2458](https://github.com/pingcap/ticdc/pull/2458) - - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2456](https://github.com/pingcap/ticdc/pull/2456) - - fix a bug where synchronizing large tables to cdclog failed. [#2445](https://github.com/pingcap/ticdc/pull/2445) - - Fix CLI back-compatibility [#2413](https://github.com/pingcap/ticdc/pull/2413) - - Fix minor runtime panic risk [#2299](https://github.com/pingcap/ticdc/pull/2299) - - Fix potential DDL loss when owner crashes while executing DDL [#2292](https://github.com/pingcap/ticdc/pull/2292) - - Don't resolve lock immediately after a region is initialized. [#2265](https://github.com/pingcap/ticdc/pull/2265) - - Fix extra partition dispatching when adding new table partition. [#2263](https://github.com/pingcap/ticdc/pull/2263) - - Cleanup changefeed metrics when changefeed is removed. - - Cleanup processor metrics when processor exits. [#2177](https://github.com/pingcap/ticdc/pull/2177) + - Fix the issue of data inconsistency that occurs after the TiCDC owner switch [#2492](https://github.com/pingcap/ticdc/pull/2492) + - Fix the issue that outdated capture might appear in the output of the `capture list` command [#2466](https://github.com/pingcap/ticdc/pull/2466) + - Fix the `ErrSchemaStorageTableMiss` error that occurs when the DDL Job duplication is encountered in the integrated test [#2458](https://github.com/pingcap/ticdc/pull/2458) + - Fix the bug that a changefeed cannot be removed if the `ErrGCTTLExceeded` error occurs [#2456](https://github.com/pingcap/ticdc/pull/2456) + - Fix a bug that replicating large tables to cdclog fails [#2445](https://github.com/pingcap/ticdc/pull/2445) + - Fix the CLI backward compatibility issue [#2413](https://github.com/pingcap/ticdc/pull/2413) + - Fix the issue of insecure concurrent access to the map in `SinkManager` [#2299](https://github.com/pingcap/ticdc/pull/2299) + - Fix the issue of potential DDL loss when the owner crashes when executing DDL statements [#2292](https://github.com/pingcap/ticdc/pull/2292) + - Fix the issue that the lock is resolved immediately after a Region is initialized [#2265](https://github.com/pingcap/ticdc/pull/2265) + - Fix the issue of extra partition dispatching that occurs when adding a new partitioned table [#2263](https://github.com/pingcap/ticdc/pull/2263) + - Fix the issue that TiCDC keeps warning on removed changefeeds [#2177](https://github.com/pingcap/ticdc/pull/2177) From a36b61f2bc1a1cb721dc516c682bbe6cb7d70077 Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 24 Sep 2021 15:36:09 +0800 Subject: [PATCH 12/16] Update release-5.0.4.md --- releases/release-5.0.4.md | 122 +++++++++++++++++++------------------- 1 file changed, 61 insertions(+), 61 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index a994d7a076c9..a9415dbe4c3a 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -12,27 +12,27 @@ TiDB version: 5.0.4 + TiDB - - Fix the issue that executing `SHOW VARIABLES` in a new session is slow. This fix reverts some changes made in [#19341](https://github.com/pingcap/tidb/pull/19341) and might cause compatibility issues. [#24326](https://github.com/pingcap/tidb/issues/24326) + - Fix the issue that executing `SHOW VARIABLES` in a new session is slow. This fix reverts some changes made in [#18517](https://github.com/pingcap/tidb/issues/18517) and might cause compatibility issues. [#18517](https://github.com/pingcap/tidb/issues/18517) - Change the default value of the `tidb_stmt_summary_max_stmt_count` variable from `200` to `3000` [#25873](https://github.com/pingcap/tidb/pull/25873) + The following bug fixes change execution results, which might cause upgrade incompatibilities: - - Fix the issue that TiDB returns wrong result when the children of `UNION` contain the `NULL` value [#26571](https://github.com/pingcap/tidb/pull/26571) - - Fix the issue that `greatest(datetime) union null` returns empty string [#26565](https://github.com/pingcap/tidb/pull/26565) + - Fix the issue that TiDB returns wrong result when the children of `UNION` contain the `NULL` value [#26559](https://github.com/pingcap/tidb/issues/26559) + - Fix the issue that `greatest(datetime) union null` returns empty string [#26532](https://github.com/pingcap/tidb/issues/26532) - Fix the issue that the behavior of the `last_day` function is incompatible in SQL mode [#26000](https://github.com/pingcap/tidb/pull/26000) - - Fix the issue that the `having` clause might not work correctly [#27742](https://github.com/pingcap/tidb/pull/27742) - - Fix the wrong execution results that occur when the collations around the `between` expression are different [#27548](https://github.com/pingcap/tidb/pull/27548) - - Fix the wrong execution results that occur when the column in the `group_concat` function has a non-bin collation [#27528](https://github.com/pingcap/tidb/pull/27528) - - Fix an issue that using a `count(distinct)` expression on multiple columns returns wrong result when the new collation is enabled [#27507](https://github.com/pingcap/tidb/pull/27507) - - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27368](https://github.com/pingcap/tidb/pull/27368) - - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#27110](https://github.com/pingcap/tidb/pull/27110) - - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26903](https://github.com/pingcap/tidb/pull/26903) - - Fix a bug on the query range of prefix index [#26261](https://github.com/pingcap/tidb/pull/26261) - - Fix the issue that the `LOAD DATA` statement might abnormally import non-utf8 data [#26143](https://github.com/pingcap/tidb/pull/26143) - - Fix the issue that `insert ignore on duplicate update` might insert wrong data when the secondary index has the same column as in the primary key [#25905](https://github.com/pingcap/tidb/pull/25905) - - Fix the issue that `insert ignore duplicate update` might insert wrong data when a partitioned table has a clustered index [#25859](https://github.com/pingcap/tidb/pull/25859) - - Fix the issue that the query result might be wrong when the key is the `ENUM` type in point get or batch point get [#24772](https://github.com/pingcap/tidb/pull/24772) - - Fix the wrong result that occurs when dividing a `BIT`-type value [#24267](https://github.com/pingcap/tidb/pull/24267) - - Fix the issue that the results of `prepared` statements and direct queries might be inconsistent [#23373](https://github.com/pingcap/tidb/pull/23373) - - Fix the issue that the query result might be wrong when a `YEAR` type is compared with a string or an integer type [#23336](https://github.com/pingcap/tidb/pull/23336) + - Fix the issue that the `having` clause might not work correctly [#26496](https://github.com/pingcap/tidb/issues/26496) + - Fix the wrong execution results that occur when the collations around the `between` expression are different [#27146](https://github.com/pingcap/tidb/issues/27146) + - Fix the wrong execution results that occur when the column in the `group_concat` function has a non-bin collation [#27429](https://github.com/pingcap/tidb/issues/27429) + - Fix an issue that using a `count(distinct)` expression on multiple columns returns wrong result when the new collation is enabled [#27091](https://github.com/pingcap/tidb/issues/27091) + - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) + - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#26762](https://github.com/pingcap/tidb/issues/26762) + - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766](https://github.com/pingcap/tidb/issues/26766) + - Fix a bug on the query range of prefix index [#26029](https://github.com/pingcap/tidb/issues/26029) + - Fix the issue that the `LOAD DATA` statement might abnormally import non-utf8 data [#25979](https://github.com/pingcap/tidb/issues/25979) + - Fix the issue that `insert ignore on duplicate update` might insert wrong data when the secondary index has the same column as in the primary key [#25809](https://github.com/pingcap/tidb/issues/25809) + - Fix the issue that `insert ignore duplicate update` might insert wrong data when a partitioned table has a clustered index [#25846](https://github.com/pingcap/tidb/issues/25846) + - Fix the issue that the query result might be wrong when the key is the `ENUM` type in point get or batch point get [#24562](https://github.com/pingcap/tidb/issues/24562) + - Fix the wrong result that occurs when dividing a `BIT`-type value [#23479](https://github.com/pingcap/tidb/issues/23479) + - Fix the issue that the results of `prepared` statements and direct queries might be inconsistent [#22949](https://github.com/pingcap/tidb/issues/22949) + - Fix the issue that the query result might be wrong when a `YEAR` type is compared with a string or an integer type [#23262](https://github.com/pingcap/tidb/issues/23262) ## Feature enhancements @@ -42,7 +42,7 @@ TiDB version: 5.0.4 + TiKV - - Support changing TiCDC configurations dynamically [#10685](https://github.com/tikv/tikv/pull/10685) + - Support changing TiCDC configurations dynamically [#10645](https://github.com/tikv/tikv/issues/10645) + PD @@ -58,29 +58,29 @@ TiDB version: 5.0.4 + TiDB - - Trigger auto-analyze based on the histogram row count [#26707](https://github.com/pingcap/tidb/pull/26707) + - Trigger auto-analyze based on the histogram row count [#24237](https://github.com/pingcap/tidb/issues/24237) - Do not send requests to a TiFlash node for a period if it has failed and restarted before [#26757](https://github.com/pingcap/tidb/pull/26757) - Increase the `split region` limit to make `split table` and `presplit` more stable [#26657](https://github.com/pingcap/tidb/pull/26657) - Support retry for MPP queries [#26483](https://github.com/pingcap/tidb/pull/26483) - Check the availability of TiFlash before launching MPP queries [#26356](https://github.com/pingcap/tidb/pull/26356) - Support the stable result mode to make the query result more stable [#26084](https://github.com/pingcap/tidb/pull/26084) - - Support the MySQL system variable `init_connect` and its associated features [#26072](https://github.com/pingcap/tidb/pull/26072) + - Support the MySQL system variable `init_connect` and its associated features [#18894](https://github.com/pingcap/tidb/issues/18894) - Thoroughly push down the `COUNT(DISTINCT)` aggregation function in the MPP mode [#25861](https://github.com/pingcap/tidb/pull/25861) - Print log warnings when the aggregation function cannot be pushed down in `EXPLAIN` statements [#25736](https://github.com/pingcap/tidb/pull/25736) - Add error labels for `TiFlashQueryTotalCounter` in Grafana dashboard [#25327](https://github.com/pingcap/tidb/pull/25327) - - Support getting the MVCC data of a clustered index table through a secondary index by HTTP API [#24470](https://github.com/pingcap/tidb/pull/24470) + - Support getting the MVCC data of a clustered index table through a secondary index by HTTP API [#24209](https://github.com/pingcap/tidb/issues/24209) - Optimize the memory allocation of `prepared` statement in parser [#24371](https://github.com/pingcap/tidb/pull/24371) + TiKV - - Handle read ready and write ready separately to reduce read latency [#10620](https://github.com/tikv/tikv/pull/10620) - - Reduce the size of Resolved TS messages to save network bandwidth [#10678](https://github.com/tikv/tikv/pull/10678) + - Handle read ready and write ready separately to reduce read latency [#10475](https://github.com/tikv/tikv/issues/10475) + - Reduce the size of Resolved TS messages to save network bandwidth [#2448](https://github.com/pingcap/ticdc/issues/2448) - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10864](https://github.com/tikv/tikv/pull/10864) - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10864](https://github.com/tikv/tikv/pull/10864) - Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10587](https://github.com/tikv/tikv/pull/10587) - Avoid the false "GC can not work" alert under low write flow [#10662](https://github.com/tikv/tikv/pull/10662) - The database to be restored always matches the original cluster size during backup. [#10643](https://github.com/tikv/tikv/pull/10643) - - Ensure that the panic output is flushed to the log [#10487](https://github.com/tikv/tikv/pull/10487) + - Ensure that the panic output is flushed to the log [#9955](https://github.com/tikv/tikv/pull/9955) + PD @@ -96,7 +96,7 @@ TiDB version: 5.0.4 - Optimize memory management when unified sorter is using memory to sort [#2711](https://github.com/pingcap/ticdc/pull/2711) - Prohibit operating TiCDC clusters across major or minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) - - Reduce the goroutine usage when a table's Regions are all transferred away from a TiKV node [#2377](https://github.com/pingcap/ticdc/pull/2377) + - Reduce the goroutine usage when a table's Regions are all transferred away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) - Remove `file sorter` [#2326](https://github.com/pingcap/ticdc/pull/2326) - Always pull the old values from TiKV and the output is adjusted according to `enable-old-value` [#2305](https://github.com/pingcap/ticdc/pull/2305) - Improve the error message returned when a PD endpoint misses the certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) @@ -107,47 +107,47 @@ TiDB version: 5.0.4 + TiDB - - Fix the issue that TiDB might panic when querying a partitioned table and the partition key has the `IS NULL` condition [#26963](https://github.com/pingcap/tidb/pull/26963) - - Fix the issue that the overflow check of the `FLOAT64` type is different with that of MySQL [#26724](https://github.com/pingcap/tidb/pull/26724) - - Fix the wrong character set and collation for the `case when` function [#26672](https://github.com/pingcap/tidb/pull/26672) - - Fix the issue that committing pessimistic transactions might cause write conflicts [#25974](https://github.com/pingcap/tidb/pull/25974) + - Fix the issue that TiDB might panic when querying a partitioned table and the partition key has the `IS NULL` condition [#23802](https://github.com/pingcap/tidb/issues/23802) + - Fix the issue that the overflow check of the `FLOAT64` type is different with that of MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) + - Fix the wrong character set and collation for the `case when` function [#26662](https://github.com/pingcap/tidb/issues/26662) + - Fix the issue that committing pessimistic transactions might cause write conflicts [#25964](https://github.com/pingcap/tidb/issues/25964) - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26495](https://github.com/pingcap/tidb/pull/26495) - - Fix the issue that TiDB might panic when resolving the async commit locks [#25863](https://github.com/pingcap/tidb/pull/25863) - - Fix a bug that a column might not be found when using `INDEX MERGE` [#25806](https://github.com/pingcap/tidb/pull/25806) - - Fix a bug that `ALTER USER REQUIRE SSL` clears users' `authentication_string` [#25348](https://github.com/pingcap/tidb/pull/25348) - - Fix a bug that the value of the `tidb_gc_scan_lock_mode` global variable on a new cluster shows "PHYSICAL" instead of the actual default mode "LEGACY" [#25118](https://github.com/pingcap/tidb/pull/25118) - - Fix the bug that the `TIKV_REGION_PEERS` system table does not show the correct `DOWN` status [#24919](https://github.com/pingcap/tidb/pull/24919) + - Fix the issue that TiDB might panic when resolving the async commit locks [#25778](https://github.com/pingcap/tidb/issues/25778) + - Fix a bug that a column might not be found when using `INDEX MERGE` [#25045](https://github.com/pingcap/tidb/issues/25045) + - Fix a bug that `ALTER USER REQUIRE SSL` clears users' `authentication_string` [#25225](https://github.com/pingcap/tidb/issues/25225) + - Fix a bug that the value of the `tidb_gc_scan_lock_mode` global variable on a new cluster shows "PHYSICAL" instead of the actual default mode "LEGACY" [#25100](https://github.com/pingcap/tidb/issues/25100) + - Fix the bug that the `TIKV_REGION_PEERS` system table does not show the correct `DOWN` status [#24879](https://github.com/pingcap/tidb/issues/24879) - Fix the issue of memory leaks that occurs when HTTP API is used [#24649](https://github.com/pingcap/tidb/pull/24649) - - Fix the issue that views does not support `DEFINER` [#24532](https://github.com/pingcap/tidb/pull/24532) - - Fix the issue that `tidb-server --help` exits with the code `2` [#24074](https://github.com/pingcap/tidb/pull/24074) - - Fix the issue that setting the global variable `dml_batch_size` does not take effect [#24731](https://github.com/pingcap/tidb/pull/24731) - - Fix the issue that using `read_from_storage` and partitioned table at the same time causes an error [#24374](https://github.com/pingcap/tidb/pull/24374) - - Fix the issue that TiDB panics when executing the projection operator [#24354](https://github.com/pingcap/tidb/pull/24354) + - Fix the issue that views does not support `DEFINER` [#24414](https://github.com/pingcap/tidb/issues/24414) + - Fix the issue that `tidb-server --help` exits with the code `2` [#24046](https://github.com/pingcap/tidb/issues/24046) + - Fix the issue that setting the global variable `dml_batch_size` does not take effect [#24709](https://github.com/pingcap/tidb/issues/24709) + - Fix the issue that using `read_from_storage` and partitioned table at the same time causes an error [#20372](https://github.com/pingcap/tidb/issues/20372) + - Fix the issue that TiDB panics when executing the projection operator [#24264](https://github.com/pingcap/tidb/issues/24264) - Fix the issue that queries might panic due to statistics [#24061](https://github.com/pingcap/tidb/pull/24061) - - Fix the issue that using the `approx_percentile` function might panic on a `BIT` column [#23703](https://github.com/pingcap/tidb/pull/23703) - - Fix the issue that the metrics on the **Coprocessor Cache** panel are wrong in Grafana [#26343](https://github.com/pingcap/tidb/pull/26343) - - Fix the issue that concurrently truncating the same partition causes DDL statements to stuck [#26238](https://github.com/pingcap/tidb/pull/26238) - - Fix the issue of wrong query results that occurs when the session variable is used as the `GROUP BY` item [#27637](https://github.com/pingcap/tidb/pull/27637) - - Fix the wrong implicit conversion between `VARCHAR` and timestamp when joining tables [#25990](https://github.com/pingcap/tidb/pull/25990) - - Fix the wrong results in associated subquery statements [#27283](https://github.com/pingcap/tidb/pull/27283) + - Fix the issue that using the `approx_percentile` function might panic on a `BIT` column [#23662](https://github.com/pingcap/tidb/issues/23662) + - Fix the issue that the metrics on the **Coprocessor Cache** panel are wrong in Grafana [#26338](https://github.com/pingcap/tidb/issues/26338) + - Fix the issue that concurrently truncating the same partition causes DDL statements to stuck [#26229](https://github.com/pingcap/tidb/issues/26229) + - Fix the issue of wrong query results that occurs when the session variable is used as the `GROUP BY` item [#27106](https://github.com/pingcap/tidb/issues/27106) + - Fix the wrong implicit conversion between `VARCHAR` and timestamp when joining tables [#25902](https://github.com/pingcap/tidb/issues/25902) + - Fix the wrong results in associated subquery statements [#27233](https://github.com/pingcap/tidb/issues/27233) + TiKV - ?- Fix the issue that snapshot GC might miss GC snapshot files when there is a snapshot file failed to be garbage-collected [#10872](https://github.com/tikv/tikv/pull/10872) + ?- Fix the issue that snapshot GC might miss GC snapshot files when there is a snapshot file failed to be garbage-collected [#10813](https://github.com/tikv/tikv/issues/10813) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10843](https://github.com/tikv/tikv/pull/10843) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) - - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 versions to a 5.0 version or later. If a cluster was upgraded from TiKV v3.x with Titan enabled before the upgrade in the past, this cluster might encounter the issue. [#10778](https://github.com/tikv/tikv/pull/10778) - - Fix the parsing failure caused by the left pessimistic locks [#10654](https://github.com/tikv/tikv/pull/10654) + - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 versions to a 5.0 version or later. If a cluster was upgraded from TiKV v3.x with Titan enabled before the upgrade in the past, this cluster might encounter the issue. [#10774](https://github.com/tikv/tikv/issues/10774) + - Fix the parsing failure caused by the left pessimistic locks [#26404](https://github.com/pingcap/tidb/issues/26404) - Fix the panic that occurs when calculating duration on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) - - Fix the issue that the keys of `batch_get_command` in Load Base Split are unencoded [#10564](https://github.com/tikv/tikv/pull/10564) + - Fix the issue that the keys of `batch_get_command` in Load Base Split are unencoded [#10542](https://github.com/tikv/tikv/issues/10542) + PD - - Fix the issue that PD does not fix the down peers in time [#4082](https://github.com/tikv/pd/pull/4082) - - Fix the issue that the replica count of the default placement rules stays constant after `replication.max-replicas` is updated [#3914](https://github.com/tikv/pd/pull/3914) + - Fix the issue that PD does not fix the down peers in time [#4077](https://github.com/tikv/pd/issues/4077) + - Fix the issue that the replica count of the default placement rules stays constant after `replication.max-replicas` is updated [#3886](https://github.com/tikv/pd/issues/3886) - Fix a bug that PD might panic when scaling out TiKV [#3910](https://github.com/tikv/pd/pull/3910) - - Fix the scheduling conflict issue that occurs when multiple schedulers are running at same time [#3856](https://github.com/tikv/pd/pull/3856) - - Fix the issue that the scheduler might appear again even if it has been deleted [#3823](https://github.com/tikv/pd/pull/3823) + - Fix the scheduling conflict issue that occurs when multiple schedulers are running at same time [#3807](https://github.com/tikv/pd/issues/3807) + - Fix the issue that the scheduler might appear again even if it has been deleted [#2572](https://github.com/tikv/pd/issues/2572) + TiFlash @@ -176,22 +176,22 @@ TiDB version: 5.0.4 + TiCDC - Fix the issue of process panic that occurs when encoding the data types such as `mysql.TypeString, mysql.TypeVarString, mysql.TypeVarchar` into JSON [#2782](https://github.com/pingcap/ticdc/pull/2782) - - Fix a data inconsistency issue that occurs because multiple processors might write data to the same table when this table is being re-scheduled [#2728](https://github.com/pingcap/ticdc/pull/2728) + - Fix a data inconsistency issue that occurs because multiple processors might write data to the same table when this table is being re-scheduled [#2417](https://github.com/pingcap/ticdc/pull/2417) - Decrease the gRPC window size to avoid the OOM that occurs when TiCDC captures too many Regions [#2724](https://github.com/pingcap/ticdc/pull/2724) - Fix the error that the gRPC connection is frequently broken when the memory pressure is high [#2719](https://github.com/pingcap/ticdc/pull/2719) - Fix a bug that causes TiCDC to panic on the unsigned `TINYINT` type [#2655](https://github.com/pingcap/ticdc/pull/2655) - - Fix the issue that TiCDC Open Protocol outputs an empty value when inserting a transaction and deleting data of the same row in the upstream [#2620](https://github.com/pingcap/ticdc/pull/2620) + - Fix the issue that TiCDC Open Protocol outputs an empty value when inserting a transaction and deleting data of the same row in the upstream [#2612](https://github.com/pingcap/ticdc/issues/2612) - Fix a bug that DDL handling fails when a changefeed starts at the finish TS of a schema change [#2610](https://github.com/pingcap/ticdc/pull/2610) - Fix the issue that irresponsive downstreams interrupt the replication task in old owner until the task times out [#2605](https://github.com/pingcap/ticdc/pull/2605) - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) - - Fix the issue of data inconsistency that occurs after the TiCDC owner switch [#2492](https://github.com/pingcap/ticdc/pull/2492) + - Fix the issue of data inconsistency that occurs after the TiCDC owner switch [#2230](https://github.com/pingcap/ticdc/issues/2230) - Fix the issue that outdated capture might appear in the output of the `capture list` command [#2466](https://github.com/pingcap/ticdc/pull/2466) - - Fix the `ErrSchemaStorageTableMiss` error that occurs when the DDL Job duplication is encountered in the integrated test [#2458](https://github.com/pingcap/ticdc/pull/2458) - - Fix the bug that a changefeed cannot be removed if the `ErrGCTTLExceeded` error occurs [#2456](https://github.com/pingcap/ticdc/pull/2456) + - Fix the `ErrSchemaStorageTableMiss` error that occurs when the DDL Job duplication is encountered in the integrated test [#2422](https://github.com/pingcap/ticdc/issues/2422) + - Fix the bug that a changefeed cannot be removed if the `ErrGCTTLExceeded` error occurs [#2391](https://github.com/pingcap/ticdc/issues/2391) - Fix a bug that replicating large tables to cdclog fails [#2445](https://github.com/pingcap/ticdc/pull/2445) - Fix the CLI backward compatibility issue [#2413](https://github.com/pingcap/ticdc/pull/2413) - Fix the issue of insecure concurrent access to the map in `SinkManager` [#2299](https://github.com/pingcap/ticdc/pull/2299) - Fix the issue of potential DDL loss when the owner crashes when executing DDL statements [#2292](https://github.com/pingcap/ticdc/pull/2292) - - Fix the issue that the lock is resolved immediately after a Region is initialized [#2265](https://github.com/pingcap/ticdc/pull/2265) + - Fix the issue that the lock is resolved immediately after a Region is initialized [#2188](https://github.com/pingcap/ticdc/issues/2188) - Fix the issue of extra partition dispatching that occurs when adding a new partitioned table [#2263](https://github.com/pingcap/ticdc/pull/2263) - - Fix the issue that TiCDC keeps warning on removed changefeeds [#2177](https://github.com/pingcap/ticdc/pull/2177) + - Fix the issue that TiCDC keeps warning on removed changefeeds [#2156](https://github.com/pingcap/ticdc/issues/2156) From 2b92511f73d8a1d1e2bf46f380636ccba69e3f48 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 24 Sep 2021 20:02:44 +0800 Subject: [PATCH 13/16] more pr to issue --- releases/release-5.0.4.md | 42 +++++++++++++++++++-------------------- 1 file changed, 21 insertions(+), 21 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index a9415dbe4c3a..1a01ce3e3232 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -12,7 +12,7 @@ TiDB version: 5.0.4 + TiDB - - Fix the issue that executing `SHOW VARIABLES` in a new session is slow. This fix reverts some changes made in [#18517](https://github.com/pingcap/tidb/issues/18517) and might cause compatibility issues. [#18517](https://github.com/pingcap/tidb/issues/18517) + - Fix the issue that executing `SHOW VARIABLES` in a new session is slow. This fix reverts some changes made in [#19341](https://github.com/pingcap/tidb/pull/19341) and might cause compatibility issues. [#24326](https://github.com/pingcap/tidb/issues/24326) - Change the default value of the `tidb_stmt_summary_max_stmt_count` variable from `200` to `3000` [#25873](https://github.com/pingcap/tidb/pull/25873) + The following bug fixes change execution results, which might cause upgrade incompatibilities: - Fix the issue that TiDB returns wrong result when the children of `UNION` contain the `NULL` value [#26559](https://github.com/pingcap/tidb/issues/26559) @@ -62,7 +62,7 @@ TiDB version: 5.0.4 - Do not send requests to a TiFlash node for a period if it has failed and restarted before [#26757](https://github.com/pingcap/tidb/pull/26757) - Increase the `split region` limit to make `split table` and `presplit` more stable [#26657](https://github.com/pingcap/tidb/pull/26657) - Support retry for MPP queries [#26483](https://github.com/pingcap/tidb/pull/26483) - - Check the availability of TiFlash before launching MPP queries [#26356](https://github.com/pingcap/tidb/pull/26356) + - Check the availability of TiFlash before launching MPP queries [#1807](https://github.com/pingcap/tics/issues/1807) - Support the stable result mode to make the query result more stable [#26084](https://github.com/pingcap/tidb/pull/26084) - Support the MySQL system variable `init_connect` and its associated features [#18894](https://github.com/pingcap/tidb/issues/18894) - Thoroughly push down the `COUNT(DISTINCT)` aggregation function in the MPP mode [#25861](https://github.com/pingcap/tidb/pull/25861) @@ -75,8 +75,8 @@ TiDB version: 5.0.4 - Handle read ready and write ready separately to reduce read latency [#10475](https://github.com/tikv/tikv/issues/10475) - Reduce the size of Resolved TS messages to save network bandwidth [#2448](https://github.com/pingcap/ticdc/issues/2448) - - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10864](https://github.com/tikv/tikv/pull/10864) - - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10864](https://github.com/tikv/tikv/pull/10864) + - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) + - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) - Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10587](https://github.com/tikv/tikv/pull/10587) - Avoid the false "GC can not work" alert under low write flow [#10662](https://github.com/tikv/tikv/pull/10662) - The database to be restored always matches the original cluster size during backup. [#10643](https://github.com/tikv/tikv/pull/10643) @@ -90,17 +90,17 @@ TiDB version: 5.0.4 + Dumpling - - Support backing up MySQL-compatible databases that do not support the `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` or the `SHOW CREATE DATABASE` syntax + - Support backing up MySQL-compatible databases that do not support the `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` or the `SHOW CREATE TABLE` syntax [#309](https://github.com/pingcap/dumpling/issues/309) + TiCDC - - Optimize memory management when unified sorter is using memory to sort [#2711](https://github.com/pingcap/ticdc/pull/2711) + - Optimize memory management when unified sorter is using memory to sort [#2553](https://github.com/pingcap/ticdc/issues/2553) - Prohibit operating TiCDC clusters across major or minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) - Reduce the goroutine usage when a table's Regions are all transferred away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) - Remove `file sorter` [#2326](https://github.com/pingcap/ticdc/pull/2326) - - Always pull the old values from TiKV and the output is adjusted according to `enable-old-value` [#2305](https://github.com/pingcap/ticdc/pull/2305) - - Improve the error message returned when a PD endpoint misses the certificate [#2185](https://github.com/pingcap/ticdc/pull/2185) - - Optimize workerpool for fewer goroutines when concurrency is high [#2487](https://github.com/pingcap/ticdc/pull/2487) + - Always pull the old values from TiKV and the output is adjusted according to `enable-old-value` [#2301](https://github.com/pingcap/ticdc/issues/2301) + - Improve the error message returned when a PD endpoint misses the certificate [#1973](https://github.com/pingcap/ticdc/issues/1973) + - Optimize workerpool for fewer goroutines when concurrency is high [#2211](https://github.com/pingcap/ticdc/issues/2211) - Add a global gRPC connection pool and share gRPC connections among KV clients [#2533](https://github.com/pingcap/ticdc/pull/2533) ## Bug Fixes @@ -111,7 +111,7 @@ TiDB version: 5.0.4 - Fix the issue that the overflow check of the `FLOAT64` type is different with that of MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) - Fix the wrong character set and collation for the `case when` function [#26662](https://github.com/pingcap/tidb/issues/26662) - Fix the issue that committing pessimistic transactions might cause write conflicts [#25964](https://github.com/pingcap/tidb/issues/25964) - - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26495](https://github.com/pingcap/tidb/pull/26495) + - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26359](https://github.com/pingcap/tidb/issues/26359) [#10600](https://github.com/tikv/tikv/pull/10600) - Fix the issue that TiDB might panic when resolving the async commit locks [#25778](https://github.com/pingcap/tidb/issues/25778) - Fix a bug that a column might not be found when using `INDEX MERGE` [#25045](https://github.com/pingcap/tidb/issues/25045) - Fix a bug that `ALTER USER REQUIRE SSL` clears users' `authentication_string` [#25225](https://github.com/pingcap/tidb/issues/25225) @@ -145,7 +145,7 @@ TiDB version: 5.0.4 - Fix the issue that PD does not fix the down peers in time [#4077](https://github.com/tikv/pd/issues/4077) - Fix the issue that the replica count of the default placement rules stays constant after `replication.max-replicas` is updated [#3886](https://github.com/tikv/pd/issues/3886) - - Fix a bug that PD might panic when scaling out TiKV [#3910](https://github.com/tikv/pd/pull/3910) + - Fix a bug that PD might panic when scaling out TiKV [#3868](https://github.com/tikv/pd/issues/3868) - Fix the scheduling conflict issue that occurs when multiple schedulers are running at same time [#3807](https://github.com/tikv/pd/issues/3807) - Fix the issue that the scheduler might appear again even if it has been deleted [#2572](https://github.com/tikv/pd/issues/2572) @@ -171,27 +171,27 @@ TiDB version: 5.0.4 + Dumpling - - Fix the issue that the execution of `show table status` is stuck in MySQL 8.0.3 or a later version [#342](https://github.com/pingcap/dumpling/pull/342) + - Fix the issue that the execution of `show table status` is stuck in MySQL 8.0.3 or a later version [#322](https://github.com/pingcap/dumpling/issues/322) + TiCDC - - Fix the issue of process panic that occurs when encoding the data types such as `mysql.TypeString, mysql.TypeVarString, mysql.TypeVarchar` into JSON [#2782](https://github.com/pingcap/ticdc/pull/2782) + - Fix the issue of process panic that occurs when encoding the data types such as `mysql.TypeString, mysql.TypeVarString, mysql.TypeVarchar` into JSON [#2758](https://github.com/pingcap/ticdc/issues/2758) - Fix a data inconsistency issue that occurs because multiple processors might write data to the same table when this table is being re-scheduled [#2417](https://github.com/pingcap/ticdc/pull/2417) - Decrease the gRPC window size to avoid the OOM that occurs when TiCDC captures too many Regions [#2724](https://github.com/pingcap/ticdc/pull/2724) - - Fix the error that the gRPC connection is frequently broken when the memory pressure is high [#2719](https://github.com/pingcap/ticdc/pull/2719) - - Fix a bug that causes TiCDC to panic on the unsigned `TINYINT` type [#2655](https://github.com/pingcap/ticdc/pull/2655) + - Fix the error that the gRPC connection is frequently broken when the memory pressure is high [#2202](https://github.com/pingcap/ticdc/issues/2202) + - Fix a bug that causes TiCDC to panic on the unsigned `TINYINT` type [#2648](https://github.com/pingcap/ticdc/issues/2648) - Fix the issue that TiCDC Open Protocol outputs an empty value when inserting a transaction and deleting data of the same row in the upstream [#2612](https://github.com/pingcap/ticdc/issues/2612) - - Fix a bug that DDL handling fails when a changefeed starts at the finish TS of a schema change [#2610](https://github.com/pingcap/ticdc/pull/2610) - - Fix the issue that irresponsive downstreams interrupt the replication task in old owner until the task times out [#2605](https://github.com/pingcap/ticdc/pull/2605) + - Fix a bug that DDL handling fails when a changefeed starts at the finish TS of a schema change [#2603](https://github.com/pingcap/ticdc/issues/2603) + - Fix the issue that irresponsive downstreams interrupt the replication task in old owner until the task times out [#2295](https://github.com/pingcap/ticdc/issues/2295) - Fix a bug in metadata management [#2558](https://github.com/pingcap/ticdc/pull/2558) - Fix the issue of data inconsistency that occurs after the TiCDC owner switch [#2230](https://github.com/pingcap/ticdc/issues/2230) - - Fix the issue that outdated capture might appear in the output of the `capture list` command [#2466](https://github.com/pingcap/ticdc/pull/2466) + - Fix the issue that outdated capture might appear in the output of the `capture list` command [#2388](https://github.com/pingcap/ticdc/issues/2388) - Fix the `ErrSchemaStorageTableMiss` error that occurs when the DDL Job duplication is encountered in the integrated test [#2422](https://github.com/pingcap/ticdc/issues/2422) - Fix the bug that a changefeed cannot be removed if the `ErrGCTTLExceeded` error occurs [#2391](https://github.com/pingcap/ticdc/issues/2391) - - Fix a bug that replicating large tables to cdclog fails [#2445](https://github.com/pingcap/ticdc/pull/2445) - - Fix the CLI backward compatibility issue [#2413](https://github.com/pingcap/ticdc/pull/2413) + - Fix a bug that replicating large tables to cdclog fails [#1259](https://github.com/pingcap/ticdc/issues/1259) [#2424](https://github.com/pingcap/ticdc/issues/2424) + - Fix the CLI backward compatibility issue [#2373](https://github.com/pingcap/ticdc/issues/2373) - Fix the issue of insecure concurrent access to the map in `SinkManager` [#2299](https://github.com/pingcap/ticdc/pull/2299) - - Fix the issue of potential DDL loss when the owner crashes when executing DDL statements [#2292](https://github.com/pingcap/ticdc/pull/2292) + - Fix the issue of potential DDL loss when the owner crashes when executing DDL statements [#1260](https://github.com/pingcap/ticdc/issues/1260) - Fix the issue that the lock is resolved immediately after a Region is initialized [#2188](https://github.com/pingcap/ticdc/issues/2188) - Fix the issue of extra partition dispatching that occurs when adding a new partitioned table [#2263](https://github.com/pingcap/ticdc/pull/2263) - Fix the issue that TiCDC keeps warning on removed changefeeds [#2156](https://github.com/pingcap/ticdc/issues/2156) From 19c490ae789edb4e07691624e1854016041f2eb1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sun, 26 Sep 2021 13:58:58 +0800 Subject: [PATCH 14/16] fix --- releases/release-5.0.4.md | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 1a01ce3e3232..7f71da6d5416 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -27,7 +27,7 @@ TiDB version: 5.0.4 - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766](https://github.com/pingcap/tidb/issues/26766) - Fix a bug on the query range of prefix index [#26029](https://github.com/pingcap/tidb/issues/26029) - Fix the issue that the `LOAD DATA` statement might abnormally import non-utf8 data [#25979](https://github.com/pingcap/tidb/issues/25979) - - Fix the issue that `insert ignore on duplicate update` might insert wrong data when the secondary index has the same column as in the primary key [#25809](https://github.com/pingcap/tidb/issues/25809) + - Fix the issue that `insert ignore on duplicate update` might insert wrong data when the secondary index has the same column with the primary key [#25809](https://github.com/pingcap/tidb/issues/25809) - Fix the issue that `insert ignore duplicate update` might insert wrong data when a partitioned table has a clustered index [#25846](https://github.com/pingcap/tidb/issues/25846) - Fix the issue that the query result might be wrong when the key is the `ENUM` type in point get or batch point get [#24562](https://github.com/pingcap/tidb/issues/24562) - Fix the wrong result that occurs when dividing a `BIT`-type value [#23479](https://github.com/pingcap/tidb/issues/23479) @@ -59,8 +59,8 @@ TiDB version: 5.0.4 + TiDB - Trigger auto-analyze based on the histogram row count [#24237](https://github.com/pingcap/tidb/issues/24237) - - Do not send requests to a TiFlash node for a period if it has failed and restarted before [#26757](https://github.com/pingcap/tidb/pull/26757) - - Increase the `split region` limit to make `split table` and `presplit` more stable [#26657](https://github.com/pingcap/tidb/pull/26657) + - Stop sending requests to a TiFlash node for a period if the node has failed and restarted before [#26757](https://github.com/pingcap/tidb/pull/26757) + - Increase the `split region` upper limit to make `split table` and `presplit` more stable [#26657](https://github.com/pingcap/tidb/pull/26657) - Support retry for MPP queries [#26483](https://github.com/pingcap/tidb/pull/26483) - Check the availability of TiFlash before launching MPP queries [#1807](https://github.com/pingcap/tics/issues/1807) - Support the stable result mode to make the query result more stable [#26084](https://github.com/pingcap/tidb/pull/26084) @@ -76,10 +76,10 @@ TiDB version: 5.0.4 - Handle read ready and write ready separately to reduce read latency [#10475](https://github.com/tikv/tikv/issues/10475) - Reduce the size of Resolved TS messages to save network bandwidth [#2448](https://github.com/pingcap/ticdc/issues/2448) - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) - - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) + - Make the slow log of TiKV coprocessor only consider the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) - Make prewrite as idempotent as possible to reduce the chance of undetermined errors [#10587](https://github.com/tikv/tikv/pull/10587) - Avoid the false "GC can not work" alert under low write flow [#10662](https://github.com/tikv/tikv/pull/10662) - - The database to be restored always matches the original cluster size during backup. [#10643](https://github.com/tikv/tikv/pull/10643) + - Make the database to be restored always match the original cluster size during backup. [#10643](https://github.com/tikv/tikv/pull/10643) - Ensure that the panic output is flushed to the log [#9955](https://github.com/tikv/tikv/pull/9955) + PD @@ -94,7 +94,7 @@ TiDB version: 5.0.4 + TiCDC - - Optimize memory management when unified sorter is using memory to sort [#2553](https://github.com/pingcap/ticdc/issues/2553) + - Optimize memory management when Unified Sorter is using memory to sort [#2553](https://github.com/pingcap/ticdc/issues/2553) - Prohibit operating TiCDC clusters across major or minor versions [#2598](https://github.com/pingcap/ticdc/pull/2598) - Reduce the goroutine usage when a table's Regions are all transferred away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) - Remove `file sorter` [#2326](https://github.com/pingcap/ticdc/pull/2326) @@ -109,7 +109,7 @@ TiDB version: 5.0.4 - Fix the issue that TiDB might panic when querying a partitioned table and the partition key has the `IS NULL` condition [#23802](https://github.com/pingcap/tidb/issues/23802) - Fix the issue that the overflow check of the `FLOAT64` type is different with that of MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) - - Fix the wrong character set and collation for the `case when` function [#26662](https://github.com/pingcap/tidb/issues/26662) + - Fix the wrong character set and collation for the `case when` expression [#26662](https://github.com/pingcap/tidb/issues/26662) - Fix the issue that committing pessimistic transactions might cause write conflicts [#25964](https://github.com/pingcap/tidb/issues/25964) - Fix a bug that the index keys in a pessimistic transaction might be repeatedly committed [#26359](https://github.com/pingcap/tidb/issues/26359) [#10600](https://github.com/tikv/tikv/pull/10600) - Fix the issue that TiDB might panic when resolving the async commit locks [#25778](https://github.com/pingcap/tidb/issues/25778) @@ -123,9 +123,9 @@ TiDB version: 5.0.4 - Fix the issue that setting the global variable `dml_batch_size` does not take effect [#24709](https://github.com/pingcap/tidb/issues/24709) - Fix the issue that using `read_from_storage` and partitioned table at the same time causes an error [#20372](https://github.com/pingcap/tidb/issues/20372) - Fix the issue that TiDB panics when executing the projection operator [#24264](https://github.com/pingcap/tidb/issues/24264) - - Fix the issue that queries might panic due to statistics [#24061](https://github.com/pingcap/tidb/pull/24061) - - Fix the issue that using the `approx_percentile` function might panic on a `BIT` column [#23662](https://github.com/pingcap/tidb/issues/23662) - - Fix the issue that the metrics on the **Coprocessor Cache** panel are wrong in Grafana [#26338](https://github.com/pingcap/tidb/issues/26338) + - Fix the issue that statistics might cause queries to panic [#24061](https://github.com/pingcap/tidb/pull/24061) + - Fix the issue that using the `approx_percentile` function on a `BIT` column might panic [#23662](https://github.com/pingcap/tidb/issues/23662) + - Fix the issue that the metrics on the **Coprocessor Cache** panel in Grafana are wrong [#26338](https://github.com/pingcap/tidb/issues/26338) - Fix the issue that concurrently truncating the same partition causes DDL statements to stuck [#26229](https://github.com/pingcap/tidb/issues/26229) - Fix the issue of wrong query results that occurs when the session variable is used as the `GROUP BY` item [#27106](https://github.com/pingcap/tidb/issues/27106) - Fix the wrong implicit conversion between `VARCHAR` and timestamp when joining tables [#25902](https://github.com/pingcap/tidb/issues/25902) @@ -136,7 +136,7 @@ TiDB version: 5.0.4 ?- Fix the issue that snapshot GC might miss GC snapshot files when there is a snapshot file failed to be garbage-collected [#10813](https://github.com/tikv/tikv/issues/10813) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10843](https://github.com/tikv/tikv/pull/10843) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) - - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 versions to a 5.0 version or later. If a cluster was upgraded from TiKV v3.x with Titan enabled before the upgrade in the past, this cluster might encounter the issue. [#10774](https://github.com/tikv/tikv/issues/10774) + - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version to a 5.0 version or later. If a cluster was upgraded from TiKV v3.x with Titan enabled before the upgrade, this cluster might encounter the issue. [#10774](https://github.com/tikv/tikv/issues/10774) - Fix the parsing failure caused by the left pessimistic locks [#26404](https://github.com/pingcap/tidb/issues/26404) - Fix the panic that occurs when calculating duration on certain platforms [#10571](https://github.com/tikv/tikv/pull/10571) - Fix the issue that the keys of `batch_get_command` in Load Base Split are unencoded [#10542](https://github.com/tikv/tikv/issues/10542) @@ -162,7 +162,7 @@ TiDB version: 5.0.4 - Fix the issue of unexpected results when TiFlash fails to establish MPP connections - Fix the potential panic issue that occurs when resolving locks - Fix the issue that the store size in metrics is inaccurate under heavy writing - - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT` `<` | `<=` | `>` | `>=` `COLUMN` + - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT`, `<`, `<=`, `>`, `>=`, or `COLUMN` - Fix the potential issue that TiFlash cannot garbage-collect the delta data after running for a long time - Fix a potential bug that metrics display wrong values - Fix the potential issue of data inconsistency that occurs when TiFlash is deployed on multiple disks From 9658f2ba3fd6c0fc27940a441849431e502f05ec Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sun, 26 Sep 2021 14:21:46 +0800 Subject: [PATCH 15/16] fix a note --- releases/release-5.0.4.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 7f71da6d5416..0796d3c112dd 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -133,7 +133,7 @@ TiDB version: 5.0.4 + TiKV - ?- Fix the issue that snapshot GC might miss GC snapshot files when there is a snapshot file failed to be garbage-collected [#10813](https://github.com/tikv/tikv/issues/10813) + - Fix the potential disk full issue caused by corrupted snapshot files [#10813](https://github.com/tikv/tikv/issues/10813) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10843](https://github.com/tikv/tikv/pull/10843) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10843](https://github.com/tikv/tikv/pull/10843) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version to a 5.0 version or later. If a cluster was upgraded from TiKV v3.x with Titan enabled before the upgrade, this cluster might encounter the issue. [#10774](https://github.com/tikv/tikv/issues/10774) From eb746382213e7608dbf853d4ecab2efc287eacea Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sun, 26 Sep 2021 14:51:59 +0800 Subject: [PATCH 16/16] Update releases/release-5.0.4.md Co-authored-by: djshow832 --- releases/release-5.0.4.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.4.md b/releases/release-5.0.4.md index 0796d3c112dd..3387995e133f 100644 --- a/releases/release-5.0.4.md +++ b/releases/release-5.0.4.md @@ -118,7 +118,7 @@ TiDB version: 5.0.4 - Fix a bug that the value of the `tidb_gc_scan_lock_mode` global variable on a new cluster shows "PHYSICAL" instead of the actual default mode "LEGACY" [#25100](https://github.com/pingcap/tidb/issues/25100) - Fix the bug that the `TIKV_REGION_PEERS` system table does not show the correct `DOWN` status [#24879](https://github.com/pingcap/tidb/issues/24879) - Fix the issue of memory leaks that occurs when HTTP API is used [#24649](https://github.com/pingcap/tidb/pull/24649) - - Fix the issue that views does not support `DEFINER` [#24414](https://github.com/pingcap/tidb/issues/24414) + - Fix the issue that views do not support `DEFINER` [#24414](https://github.com/pingcap/tidb/issues/24414) - Fix the issue that `tidb-server --help` exits with the code `2` [#24046](https://github.com/pingcap/tidb/issues/24046) - Fix the issue that setting the global variable `dml_batch_size` does not take effect [#24709](https://github.com/pingcap/tidb/issues/24709) - Fix the issue that using `read_from_storage` and partitioned table at the same time causes an error [#20372](https://github.com/pingcap/tidb/issues/20372)