From fb9386f2bbed1a145d4942c4335cc7b710a76cce Mon Sep 17 00:00:00 2001 From: ti-srebot <66930949+ti-srebot@users.noreply.github.com> Date: Sat, 18 Sep 2021 10:06:36 +0800 Subject: [PATCH 01/33] releases: add TiDB 5.1.2-10-06-33 release notes * releases: add TiDB 5.1.2-10-06-33 release notes * Update releases/release-5.1.2-10-06-33.md --- releases/release-5.1.2-10-06-33.md | 183 +++++++++++++++++++++++++++++ 1 file changed, 183 insertions(+) create mode 100644 releases/release-5.1.2-10-06-33.md diff --git a/releases/release-5.1.2-10-06-33.md b/releases/release-5.1.2-10-06-33.md new file mode 100644 index 0000000000000..2ab30d07f8ece --- /dev/null +++ b/releases/release-5.1.2-10-06-33.md @@ -0,0 +1,183 @@ +--- +title: TiDB 5.1.2 Release Notes +category: Releases +--- + + + +# TiDB 5.1.2 Release Notes + +Release Date: September 18, 2021 + +TiDB version: 5.1.2 + +## __unsorted + ++ PingCAP/TiDB + + - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) + - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) + - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) + - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) + - None. [#27925](https://github.com/pingcap/tidb/pull/27925) + - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) + - Please add a release note, or a 'None' if it is not needed. [#27631](https://github.com/pingcap/tidb/pull/27631) + - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) + - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) + - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) + - make `group_concat` function consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) + - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27506](https://github.com/pingcap/tidb/pull/27506) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27411](https://github.com/pingcap/tidb/pull/27411) + - expression: fix extract bug when argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) + - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27265](https://github.com/pingcap/tidb/pull/27265) + - fix wrong selection push down when having above agg [#27258](https://github.com/pingcap/tidb/pull/27258) + - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) + - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) + - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) + - Please add a release note, or a 'None' if it is not needed. [#26969](https://github.com/pingcap/tidb/pull/26969) + - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) + - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) + - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) + - planner: fix CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) + - Fix a bug 'select for update' does not correctly lock the data when a normal table join a partition table. [#26631](https://github.com/pingcap/tidb/pull/26631) + - Fix a panic when select for update on a normal table join a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) + - Fix the issue that point get does not use lite version resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + + ++ TiKV/TiKV + + - ```release-note [#10933](https://github.com/tikv/tikv/pull/10933) + - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10912](https://github.com/tikv/tikv/pull/10912) + - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10873](https://github.com/tikv/tikv/pull/10873) + - - TiKV coprocessor slow log will only consider time spent on processing the request. +- Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) + - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10856](https://github.com/tikv/tikv/pull/10856) + - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version +- Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) + - Fix TiKV delete files before it ingests to RocksDB. [#10741](https://github.com/tikv/tikv/pull/10741) + - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) + - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) + - Fix the resolve failures caused by the left pessimisic locks. [#10653](https://github.com/tikv/tikv/pull/10653) + - ```release-note [#10621](https://github.com/tikv/tikv/pull/10621) + + ++ PingCAP/TiFlash + + - Please add a release note, or a 'None' if it is not needed. [#2819](https://github.com/pingcap/tics/pull/2819) + - Support INET6_ATON and INET6_NTOA in TiFlash. [#2624](https://github.com/pingcap/tics/pull/2624) + - - Support INET_ATON and INET_NTOA in TiFlash. [#2613](https://github.com/pingcap/tics/pull/2613) + - update client to fix race bug [#2583](https://github.com/pingcap/tics/pull/2583) + - [#2552](https://github.com/pingcap/tics/pull/2552) + - expand streams after aggregation [#2537](https://github.com/pingcap/tics/pull/2537) + - Improve the mpp cancel process to cancel the mpp task ASAP [#2518](https://github.com/pingcap/tics/pull/2518) + - Fix the bug may cause metrics to display error value. [#2469](https://github.com/pingcap/tics/pull/2469) + + ++ PD + + - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) + - None. [#3976](https://github.com/tikv/pd/pull/3976) + - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) + + ++ Tools + + + PingCAP/BR + + - fix the bug that the average speed isn't accurate in backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + - [#1375](https://github.com/pingcap/br/pull/1375) + + + + PingCAP/Dumpling + + - fix pending on show table status in some mysql version [#333](https://github.com/pingcap/dumpling/pull/333) + - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT +- Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#328](https://github.com/pingcap/dumpling/pull/328) + + + + PingCAP/TiCDC + + - Fix json encoding could panic when processing a string type value in some cases. [#2783](https://github.com/pingcap/ticdc/pull/2783) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2729](https://github.com/pingcap/ticdc/pull/2729) + - Fix OOM when TiCDC captures too many regions [#2725](https://github.com/pingcap/ticdc/pull/2725) + - Fix gRPC keepalive error when memory pressure is high. [#2720](https://github.com/pingcap/ticdc/pull/2720) + - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#2683](https://github.com/pingcap/ticdc/pull/2683) + - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) + - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2656](https://github.com/pingcap/ticdc/pull/2656) + - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) + - Fixed a bug in DDL handling when the owner restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) + - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) + - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) + - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) + - `None`. [#2521](https://github.com/pingcap/ticdc/pull/2521) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) + - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) + - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) + - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2454](https://github.com/pingcap/ticdc/pull/2454) + - fix a bug where synchronizing large tables to cdclog failed. [#2446](https://github.com/pingcap/ticdc/pull/2446) + - Fix CLI back-compatibility [#2414](https://github.com/pingcap/ticdc/pull/2414) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) + + +## Bug Fixes + ++ PingCAP/TiDB + + - Fix wrong index hash join when hash col is enum. [#28081](https://github.com/pingcap/tidb/pull/28081) + - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases. [#27678](https://github.com/pingcap/tidb/pull/27678) + - Keep the overflow check logic same with mysql [#26725](https://github.com/pingcap/tidb/pull/26725) + - Fix #26147 that `tidb` returns an `unknow` error with no message while it should return the error that contains `pd is timeout`. [#26682](https://github.com/pingcap/tidb/pull/26682) + - Fix wrong charset and collation for case when function [#26673](https://github.com/pingcap/tidb/pull/26673) + - Fix the issue that greatest(datetime) union null returns empty string [#26566](https://github.com/pingcap/tidb/pull/26566) + + ++ PingCAP/TiFlash + + - Fix the potential issue of data inconsistency after crashes when deployed on multi-disks [#2776](https://github.com/pingcap/tics/pull/2776) + - Please add a release note, or a 'None' if it is not needed. [#2762](https://github.com/pingcap/tics/pull/2762) + - Please add a release note, or a 'None' if it is not needed. [#2710](https://github.com/pingcap/tics/pull/2710) + - Fix concurrency between init store and DDL. [#2693](https://github.com/pingcap/tics/pull/2693) + - ```release-note [#2673](https://github.com/pingcap/tics/pull/2673) + - Fix the bug that filters unexpected data if the query contains "constant" "<"/"<="/">"/">=" "column" [#2635](https://github.com/pingcap/tics/pull/2635) + - Fix an overflow bug in decimal MOD(N, M). [#2609](https://github.com/pingcap/tics/pull/2609) + - Fix the potential panic when applying Snapshot with multiple DDL operations [#2606](https://github.com/pingcap/tics/pull/2606) + - Fix inaccurate store size on tiflash metric under heavy write scenario [#2598](https://github.com/pingcap/tics/pull/2598) + - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time [#2337](https://github.com/pingcap/tics/pull/2337) + + ++ PD + + - Fix the bug that PD would not fix down-peer in time. [#4083](https://github.com/tikv/pd/pull/4083) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3915](https://github.com/tikv/pd/pull/3915) + - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) + + ++ Tools + + + PingCAP/BR + + - Fix the bug that in concurrency mode, pd schedulers may not be restored if one or more lightning failed. [#1422](https://github.com/pingcap/br/pull/1422) + - Fix the bug that lightning local backend may met checksum mismatch error due to data loss. [#1416](https://github.com/pingcap/br/pull/1416) + + +## Improvements + ++ PingCAP/TiDB + + - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) + + ++ PingCAP/TiFlash + + - ```release-note [#2658](https://github.com/pingcap/tics/pull/2658) + - Support pushing down ROUND(X) to TiFlash. [#2611](https://github.com/pingcap/tics/pull/2611) + - support function DATE() pushed down to tiflash [#2602](https://github.com/pingcap/tics/pull/2602) + - support functions of ADDDATE() and DATE_ADD() pushed down to tiflash [#2591](https://github.com/pingcap/tics/pull/2591) + - retry when meeting stablish conn fails [#2570](https://github.com/pingcap/tics/pull/2570) + - Support pushing down MOD(N, M) to TiFlash. [#2560](https://github.com/pingcap/tics/pull/2560) + - Add Grafana panels for write throughput per instance [#2544](https://github.com/pingcap/tics/pull/2544) + - [#2345](https://github.com/pingcap/tics/pull/2345) + + From 8d2a3707af66464013d5ef74aa756ddcc4b23593 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sat, 18 Sep 2021 10:24:57 +0800 Subject: [PATCH 02/33] toc --- TOC.md | 1 + ...ase-5.1.2-10-06-33.md => release-5.1.2.md} | 348 +++++++++--------- releases/release-notes.md | 1 + 3 files changed, 167 insertions(+), 183 deletions(-) rename releases/{release-5.1.2-10-06-33.md => release-5.1.2.md} (90%) diff --git a/TOC.md b/TOC.md index 9640c57529fc5..bbdaf80ce8ed5 100644 --- a/TOC.md +++ b/TOC.md @@ -559,6 +559,7 @@ + [5.2.1](/releases/release-5.2.1.md) + [5.2.0](/releases/release-5.2.0.md) + v5.1 + + [5.1.2](/releases/release-5.1.2.md) + [5.1.1](/releases/release-5.1.1.md) + [5.1.0](/releases/release-5.1.0.md) + v5.0 diff --git a/releases/release-5.1.2-10-06-33.md b/releases/release-5.1.2.md similarity index 90% rename from releases/release-5.1.2-10-06-33.md rename to releases/release-5.1.2.md index 2ab30d07f8ece..d71be9ade69c1 100644 --- a/releases/release-5.1.2-10-06-33.md +++ b/releases/release-5.1.2.md @@ -1,183 +1,165 @@ ---- -title: TiDB 5.1.2 Release Notes -category: Releases ---- - - - -# TiDB 5.1.2 Release Notes - -Release Date: September 18, 2021 - -TiDB version: 5.1.2 - -## __unsorted - -+ PingCAP/TiDB - - - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) - - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) - - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) - - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) - - None. [#27925](https://github.com/pingcap/tidb/pull/27925) - - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) - - Please add a release note, or a 'None' if it is not needed. [#27631](https://github.com/pingcap/tidb/pull/27631) - - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) - - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) - - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) - - make `group_concat` function consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) - - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27506](https://github.com/pingcap/tidb/pull/27506) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27411](https://github.com/pingcap/tidb/pull/27411) - - expression: fix extract bug when argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) - - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27265](https://github.com/pingcap/tidb/pull/27265) - - fix wrong selection push down when having above agg [#27258](https://github.com/pingcap/tidb/pull/27258) - - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) - - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) - - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) - - Please add a release note, or a 'None' if it is not needed. [#26969](https://github.com/pingcap/tidb/pull/26969) - - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) - - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) - - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) - - planner: fix CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) - - Fix a bug 'select for update' does not correctly lock the data when a normal table join a partition table. [#26631](https://github.com/pingcap/tidb/pull/26631) - - Fix a panic when select for update on a normal table join a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) - - Fix the issue that point get does not use lite version resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) - - -+ TiKV/TiKV - - - ```release-note [#10933](https://github.com/tikv/tikv/pull/10933) - - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10912](https://github.com/tikv/tikv/pull/10912) - - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10873](https://github.com/tikv/tikv/pull/10873) - - - TiKV coprocessor slow log will only consider time spent on processing the request. -- Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) - - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10856](https://github.com/tikv/tikv/pull/10856) - - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version -- Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - - Fix TiKV delete files before it ingests to RocksDB. [#10741](https://github.com/tikv/tikv/pull/10741) - - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) - - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) - - Fix the resolve failures caused by the left pessimisic locks. [#10653](https://github.com/tikv/tikv/pull/10653) - - ```release-note [#10621](https://github.com/tikv/tikv/pull/10621) - - -+ PingCAP/TiFlash - - - Please add a release note, or a 'None' if it is not needed. [#2819](https://github.com/pingcap/tics/pull/2819) - - Support INET6_ATON and INET6_NTOA in TiFlash. [#2624](https://github.com/pingcap/tics/pull/2624) - - - Support INET_ATON and INET_NTOA in TiFlash. [#2613](https://github.com/pingcap/tics/pull/2613) - - update client to fix race bug [#2583](https://github.com/pingcap/tics/pull/2583) - - [#2552](https://github.com/pingcap/tics/pull/2552) - - expand streams after aggregation [#2537](https://github.com/pingcap/tics/pull/2537) - - Improve the mpp cancel process to cancel the mpp task ASAP [#2518](https://github.com/pingcap/tics/pull/2518) - - Fix the bug may cause metrics to display error value. [#2469](https://github.com/pingcap/tics/pull/2469) - - -+ PD - - - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) - - None. [#3976](https://github.com/tikv/pd/pull/3976) - - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) - - -+ Tools - - + PingCAP/BR - - - fix the bug that the average speed isn't accurate in backup and restore [#1412](https://github.com/pingcap/br/pull/1412) - - [#1375](https://github.com/pingcap/br/pull/1375) - - - + PingCAP/Dumpling - - - fix pending on show table status in some mysql version [#333](https://github.com/pingcap/dumpling/pull/333) - - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT -- Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#328](https://github.com/pingcap/dumpling/pull/328) - - - + PingCAP/TiCDC - - - Fix json encoding could panic when processing a string type value in some cases. [#2783](https://github.com/pingcap/ticdc/pull/2783) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2729](https://github.com/pingcap/ticdc/pull/2729) - - Fix OOM when TiCDC captures too many regions [#2725](https://github.com/pingcap/ticdc/pull/2725) - - Fix gRPC keepalive error when memory pressure is high. [#2720](https://github.com/pingcap/ticdc/pull/2720) - - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#2683](https://github.com/pingcap/ticdc/pull/2683) - - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) - - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2656](https://github.com/pingcap/ticdc/pull/2656) - - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) - - Fixed a bug in DDL handling when the owner restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) - - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) - - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) - - `None`. [#2521](https://github.com/pingcap/ticdc/pull/2521) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) - - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) - - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) - - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2454](https://github.com/pingcap/ticdc/pull/2454) - - fix a bug where synchronizing large tables to cdclog failed. [#2446](https://github.com/pingcap/ticdc/pull/2446) - - Fix CLI back-compatibility [#2414](https://github.com/pingcap/ticdc/pull/2414) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) - - -## Bug Fixes - -+ PingCAP/TiDB - - - Fix wrong index hash join when hash col is enum. [#28081](https://github.com/pingcap/tidb/pull/28081) - - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases. [#27678](https://github.com/pingcap/tidb/pull/27678) - - Keep the overflow check logic same with mysql [#26725](https://github.com/pingcap/tidb/pull/26725) - - Fix #26147 that `tidb` returns an `unknow` error with no message while it should return the error that contains `pd is timeout`. [#26682](https://github.com/pingcap/tidb/pull/26682) - - Fix wrong charset and collation for case when function [#26673](https://github.com/pingcap/tidb/pull/26673) - - Fix the issue that greatest(datetime) union null returns empty string [#26566](https://github.com/pingcap/tidb/pull/26566) - - -+ PingCAP/TiFlash - - - Fix the potential issue of data inconsistency after crashes when deployed on multi-disks [#2776](https://github.com/pingcap/tics/pull/2776) - - Please add a release note, or a 'None' if it is not needed. [#2762](https://github.com/pingcap/tics/pull/2762) - - Please add a release note, or a 'None' if it is not needed. [#2710](https://github.com/pingcap/tics/pull/2710) - - Fix concurrency between init store and DDL. [#2693](https://github.com/pingcap/tics/pull/2693) - - ```release-note [#2673](https://github.com/pingcap/tics/pull/2673) - - Fix the bug that filters unexpected data if the query contains "constant" "<"/"<="/">"/">=" "column" [#2635](https://github.com/pingcap/tics/pull/2635) - - Fix an overflow bug in decimal MOD(N, M). [#2609](https://github.com/pingcap/tics/pull/2609) - - Fix the potential panic when applying Snapshot with multiple DDL operations [#2606](https://github.com/pingcap/tics/pull/2606) - - Fix inaccurate store size on tiflash metric under heavy write scenario [#2598](https://github.com/pingcap/tics/pull/2598) - - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time [#2337](https://github.com/pingcap/tics/pull/2337) - - -+ PD - - - Fix the bug that PD would not fix down-peer in time. [#4083](https://github.com/tikv/pd/pull/4083) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3915](https://github.com/tikv/pd/pull/3915) - - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) - - -+ Tools - - + PingCAP/BR - - - Fix the bug that in concurrency mode, pd schedulers may not be restored if one or more lightning failed. [#1422](https://github.com/pingcap/br/pull/1422) - - Fix the bug that lightning local backend may met checksum mismatch error due to data loss. [#1416](https://github.com/pingcap/br/pull/1416) - - -## Improvements - -+ PingCAP/TiDB - - - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) - - -+ PingCAP/TiFlash - - - ```release-note [#2658](https://github.com/pingcap/tics/pull/2658) - - Support pushing down ROUND(X) to TiFlash. [#2611](https://github.com/pingcap/tics/pull/2611) - - support function DATE() pushed down to tiflash [#2602](https://github.com/pingcap/tics/pull/2602) - - support functions of ADDDATE() and DATE_ADD() pushed down to tiflash [#2591](https://github.com/pingcap/tics/pull/2591) - - retry when meeting stablish conn fails [#2570](https://github.com/pingcap/tics/pull/2570) - - Support pushing down MOD(N, M) to TiFlash. [#2560](https://github.com/pingcap/tics/pull/2560) - - Add Grafana panels for write throughput per instance [#2544](https://github.com/pingcap/tics/pull/2544) - - [#2345](https://github.com/pingcap/tics/pull/2345) - - +--- +title: TiDB 5.1.2 Release Notes +--- + +# TiDB 5.1.2 Release Notes + +Release Date: September 27, 2021 + +TiDB version: 5.1.2 + +## Improvements + ++ TiDB + + - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) + ++ TiFlash + + - ```release-note [#2658](https://github.com/pingcap/tics/pull/2658) + - Support pushing down ROUND(X) to TiFlash. [#2611](https://github.com/pingcap/tics/pull/2611) + - support function DATE() pushed down to tiflash [#2602](https://github.com/pingcap/tics/pull/2602) + - support functions of ADDDATE() and DATE_ADD() pushed down to tiflash [#2591](https://github.com/pingcap/tics/pull/2591) + - retry when meeting stablish conn fails [#2570](https://github.com/pingcap/tics/pull/2570) + - Support pushing down MOD(N, M) to TiFlash. [#2560](https://github.com/pingcap/tics/pull/2560) + - Add Grafana panels for write throughput per instance [#2544](https://github.com/pingcap/tics/pull/2544) + - [#2345](https://github.com/pingcap/tics/pull/2345) + +## Bug Fixes + ++ TiDB + + - Fix wrong index hash join when hash col is enum. [#28081](https://github.com/pingcap/tidb/pull/28081) + - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases. [#27678](https://github.com/pingcap/tidb/pull/27678) + - Keep the overflow check logic same with mysql [#26725](https://github.com/pingcap/tidb/pull/26725) + - Fix #26147 that `tidb` returns an `unknow` error with no message while it should return the error that contains `pd is timeout`. [#26682](https://github.com/pingcap/tidb/pull/26682) + - Fix wrong charset and collation for case when function [#26673](https://github.com/pingcap/tidb/pull/26673) + - Fix the issue that greatest(datetime) union null returns empty string [#26566](https://github.com/pingcap/tidb/pull/26566) + ++ TiFlash + + - Fix the potential issue of data inconsistency after crashes when deployed on multi-disks [#2776](https://github.com/pingcap/tics/pull/2776) + - Please add a release note, or a 'None' if it is not needed. [#2762](https://github.com/pingcap/tics/pull/2762) + - Please add a release note, or a 'None' if it is not needed. [#2710](https://github.com/pingcap/tics/pull/2710) + - Fix concurrency between init store and DDL. [#2693](https://github.com/pingcap/tics/pull/2693) + - ```release-note [#2673](https://github.com/pingcap/tics/pull/2673) + - Fix the bug that filters unexpected data if the query contains "constant" "<"/"<="/">"/">=" "column" [#2635](https://github.com/pingcap/tics/pull/2635) + - Fix an overflow bug in decimal MOD(N, M). [#2609](https://github.com/pingcap/tics/pull/2609) + - Fix the potential panic when applying Snapshot with multiple DDL operations [#2606](https://github.com/pingcap/tics/pull/2606) + - Fix inaccurate store size on tiflash metric under heavy write scenario [#2598](https://github.com/pingcap/tics/pull/2598) + - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time [#2337](https://github.com/pingcap/tics/pull/2337) + ++ PD + + - Fix the bug that PD would not fix down-peer in time. [#4083](https://github.com/tikv/pd/pull/4083) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3915](https://github.com/tikv/pd/pull/3915) + - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) + ++ Tools + + + Backup & Restore (BR) + + - Fix the bug that in concurrency mode, pd schedulers may not be restored if one or more lightning failed. [#1422](https://github.com/pingcap/br/pull/1422) + - Fix the bug that lightning local backend may met checksum mismatch error due to data loss. [#1416](https://github.com/pingcap/br/pull/1416) + +## __unsorted + ++ TiDB + + - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) + - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) + - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) + - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) + - None. [#27925](https://github.com/pingcap/tidb/pull/27925) + - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) + - Please add a release note, or a 'None' if it is not needed. [#27631](https://github.com/pingcap/tidb/pull/27631) + - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) + - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) + - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) + - make `group_concat` function consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) + - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27506](https://github.com/pingcap/tidb/pull/27506) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27411](https://github.com/pingcap/tidb/pull/27411) + - expression: fix extract bug when argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) + - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27265](https://github.com/pingcap/tidb/pull/27265) + - fix wrong selection push down when having above agg [#27258](https://github.com/pingcap/tidb/pull/27258) + - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) + - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) + - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) + - Please add a release note, or a 'None' if it is not needed. [#26969](https://github.com/pingcap/tidb/pull/26969) + - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) + - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) + - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) + - planner: fix CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) + - Fix a bug 'select for update' does not correctly lock the data when a normal table join a partition table. [#26631](https://github.com/pingcap/tidb/pull/26631) + - Fix a panic when select for update on a normal table join a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) + - Fix the issue that point get does not use lite version resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + ++ TiKV + + - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10912](https://github.com/tikv/tikv/pull/10912) + - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10873](https://github.com/tikv/tikv/pull/10873) + - TiKV coprocessor slow log will only consider time spent on processing the request. + - Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) + - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10856](https://github.com/tikv/tikv/pull/10856) + - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version + - Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) + - Fix TiKV delete files before it ingests to RocksDB. [#10741](https://github.com/tikv/tikv/pull/10741) + - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) + - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) + - Fix the resolve failures caused by the left pessimisic locks. [#10653](https://github.com/tikv/tikv/pull/10653) + - ```release-note [#10621](https://github.com/tikv/tikv/pull/10621) + ++ PingCAP/TiFlash + + - Please add a release note, or a 'None' if it is not needed. [#2819](https://github.com/pingcap/tics/pull/2819) + - Support INET6_ATON and INET6_NTOA in TiFlash. [#2624](https://github.com/pingcap/tics/pull/2624) + - Support INET_ATON and INET_NTOA in TiFlash. [#2613](https://github.com/pingcap/tics/pull/2613) + - update client to fix race bug [#2583](https://github.com/pingcap/tics/pull/2583) + - [#2552](https://github.com/pingcap/tics/pull/2552) + - expand streams after aggregation [#2537](https://github.com/pingcap/tics/pull/2537) + - Improve the mpp cancel process to cancel the mpp task ASAP [#2518](https://github.com/pingcap/tics/pull/2518) + - Fix the bug may cause metrics to display error value. [#2469](https://github.com/pingcap/tics/pull/2469) + ++ PD + + - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) + - None. [#3976](https://github.com/tikv/pd/pull/3976) + - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) + ++ Tools + + + Backup & Restore (BR) + + - fix the bug that the average speed isn't accurate in backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + - [#1375](https://github.com/pingcap/br/pull/1375) + + + Dumpling + + - fix pending on show table status in some mysql version [#333](https://github.com/pingcap/dumpling/pull/333) + - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT + - Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#328](https://github.com/pingcap/dumpling/pull/328) + + + TiCDC + + - Fix json encoding could panic when processing a string type value in some cases. [#2783](https://github.com/pingcap/ticdc/pull/2783) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2729](https://github.com/pingcap/ticdc/pull/2729) + - Fix OOM when TiCDC captures too many regions [#2725](https://github.com/pingcap/ticdc/pull/2725) + - Fix gRPC keepalive error when memory pressure is high. [#2720](https://github.com/pingcap/ticdc/pull/2720) + - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) + - Please add a release note. + - If you don't think this PR needs a release note then fill it with `None`. [#2683](https://github.com/pingcap/ticdc/pull/2683) + - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) + - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2656](https://github.com/pingcap/ticdc/pull/2656) + - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) + - Fixed a bug in DDL handling when the owner restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) + - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) + - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) + - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) + - `None`. [#2521](https://github.com/pingcap/ticdc/pull/2521) + - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) + - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) + - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) + - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2454](https://github.com/pingcap/ticdc/pull/2454) + - fix a bug where synchronizing large tables to cdclog failed. [#2446](https://github.com/pingcap/ticdc/pull/2446) + - Fix CLI back-compatibility [#2414](https://github.com/pingcap/ticdc/pull/2414) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) \ No newline at end of file diff --git a/releases/release-notes.md b/releases/release-notes.md index 7082bf502c881..1a467834592b7 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -12,6 +12,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.1 +- [5.1.2](/releases/release-5.1.2.md) - [5.1.1](/releases/release-5.1.1.md) - [5.1.0](/releases/release-5.1.0.md) From d8bce5799688c89888db7dce535983f55a2cb42e Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sat, 18 Sep 2021 15:24:01 +0800 Subject: [PATCH 03/33] Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> --- releases/release-5.1.2.md | 21 ++++++--------------- 1 file changed, 6 insertions(+), 15 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index d71be9ade69c1..a8ae3f4b0e5be 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -16,14 +16,13 @@ TiDB version: 5.1.2 + TiFlash - - ```release-note [#2658](https://github.com/pingcap/tics/pull/2658) - Support pushing down ROUND(X) to TiFlash. [#2611](https://github.com/pingcap/tics/pull/2611) - support function DATE() pushed down to tiflash [#2602](https://github.com/pingcap/tics/pull/2602) - support functions of ADDDATE() and DATE_ADD() pushed down to tiflash [#2591](https://github.com/pingcap/tics/pull/2591) - retry when meeting stablish conn fails [#2570](https://github.com/pingcap/tics/pull/2570) - Support pushing down MOD(N, M) to TiFlash. [#2560](https://github.com/pingcap/tics/pull/2560) - Add Grafana panels for write throughput per instance [#2544](https://github.com/pingcap/tics/pull/2544) - - [#2345](https://github.com/pingcap/tics/pull/2345) + - Cherry-pick #2216 #2460 #2494 & Optimizr read-index retry to release-5.1 [#2345](https://github.com/pingcap/tics/pull/2345) ## Bug Fixes @@ -39,10 +38,10 @@ TiDB version: 5.1.2 + TiFlash - Fix the potential issue of data inconsistency after crashes when deployed on multi-disks [#2776](https://github.com/pingcap/tics/pull/2776) - - Please add a release note, or a 'None' if it is not needed. [#2762](https://github.com/pingcap/tics/pull/2762) + - fix bug that SharedQueryBlockInputStream may loss block randomly. [#2762](https://github.com/pingcap/tics/pull/2762) - Please add a release note, or a 'None' if it is not needed. [#2710](https://github.com/pingcap/tics/pull/2710) - Fix concurrency between init store and DDL. [#2693](https://github.com/pingcap/tics/pull/2693) - - ```release-note [#2673](https://github.com/pingcap/tics/pull/2673) + - Fix false alert of expected internal DDL error [#2673](https://github.com/pingcap/tics/pull/2673) - Fix the bug that filters unexpected data if the query contains "constant" "<"/"<="/">"/">=" "column" [#2635](https://github.com/pingcap/tics/pull/2635) - Fix an overflow bug in decimal MOD(N, M). [#2609](https://github.com/pingcap/tics/pull/2609) - Fix the potential panic when applying Snapshot with multiple DDL operations [#2606](https://github.com/pingcap/tics/pull/2606) @@ -70,9 +69,7 @@ TiDB version: 5.1.2 - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) - - None. [#27925](https://github.com/pingcap/tidb/pull/27925) - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) - - Please add a release note, or a 'None' if it is not needed. [#27631](https://github.com/pingcap/tidb/pull/27631) - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) @@ -85,7 +82,7 @@ TiDB version: 5.1.2 - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) - - Please add a release note, or a 'None' if it is not needed. [#26969](https://github.com/pingcap/tidb/pull/26969) + - planner: add missing distinct flag for Apply convert to join. [#26969](https://github.com/pingcap/tidb/pull/26969) - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) @@ -107,15 +104,14 @@ TiDB version: 5.1.2 - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) - Fix the resolve failures caused by the left pessimisic locks. [#10653](https://github.com/tikv/tikv/pull/10653) - - ```release-note [#10621](https://github.com/tikv/tikv/pull/10621) + - limit the hotspot report count. [#10621](https://github.com/tikv/tikv/pull/10621) + PingCAP/TiFlash - - Please add a release note, or a 'None' if it is not needed. [#2819](https://github.com/pingcap/tics/pull/2819) + - function result name should contain collator info [#2819](https://github.com/pingcap/tics/pull/2819) - Support INET6_ATON and INET6_NTOA in TiFlash. [#2624](https://github.com/pingcap/tics/pull/2624) - Support INET_ATON and INET_NTOA in TiFlash. [#2613](https://github.com/pingcap/tics/pull/2613) - update client to fix race bug [#2583](https://github.com/pingcap/tics/pull/2583) - - [#2552](https://github.com/pingcap/tics/pull/2552) - expand streams after aggregation [#2537](https://github.com/pingcap/tics/pull/2537) - Improve the mpp cancel process to cancel the mpp task ASAP [#2518](https://github.com/pingcap/tics/pull/2518) - Fix the bug may cause metrics to display error value. [#2469](https://github.com/pingcap/tics/pull/2469) @@ -123,7 +119,6 @@ TiDB version: 5.1.2 + PD - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) - - None. [#3976](https://github.com/tikv/pd/pull/3976) - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) + Tools @@ -131,7 +126,6 @@ TiDB version: 5.1.2 + Backup & Restore (BR) - fix the bug that the average speed isn't accurate in backup and restore [#1412](https://github.com/pingcap/br/pull/1412) - - [#1375](https://github.com/pingcap/br/pull/1375) + Dumpling @@ -146,8 +140,6 @@ TiDB version: 5.1.2 - Fix OOM when TiCDC captures too many regions [#2725](https://github.com/pingcap/ticdc/pull/2725) - Fix gRPC keepalive error when memory pressure is high. [#2720](https://github.com/pingcap/ticdc/pull/2720) - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) - - Please add a release note. - - If you don't think this PR needs a release note then fill it with `None`. [#2683](https://github.com/pingcap/ticdc/pull/2683) - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2656](https://github.com/pingcap/ticdc/pull/2656) - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) @@ -155,7 +147,6 @@ TiDB version: 5.1.2 - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) - - `None`. [#2521](https://github.com/pingcap/ticdc/pull/2521) - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) From 06e57ef71b56016665d729df588e0f957fa96eaa Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sat, 18 Sep 2021 15:26:12 +0800 Subject: [PATCH 04/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index a8ae3f4b0e5be..4b9f050dd6c1a 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -61,7 +61,7 @@ TiDB version: 5.1.2 - Fix the bug that in concurrency mode, pd schedulers may not be restored if one or more lightning failed. [#1422](https://github.com/pingcap/br/pull/1422) - Fix the bug that lightning local backend may met checksum mismatch error due to data loss. [#1416](https://github.com/pingcap/br/pull/1416) -## __unsorted +## ## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + TiDB From 01f51a4e140c58e46b0c79fc9fbaf37557817b03 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sat, 18 Sep 2021 15:26:46 +0800 Subject: [PATCH 05/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 4b9f050dd6c1a..f3214f8bfd29a 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -61,7 +61,7 @@ TiDB version: 5.1.2 - Fix the bug that in concurrency mode, pd schedulers may not be restored if one or more lightning failed. [#1422](https://github.com/pingcap/br/pull/1422) - Fix the bug that lightning local backend may met checksum mismatch error due to data loss. [#1416](https://github.com/pingcap/br/pull/1416) -## ## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 +## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + TiDB From a40d5e1cdd27b70a761e61e6e3e434132a68b9e1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 24 Sep 2021 11:26:46 +0800 Subject: [PATCH 06/33] add notes from comments --- releases/release-5.1.2.md | 121 ++++++++++++++++++-------------------- 1 file changed, 56 insertions(+), 65 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index f3214f8bfd29a..50c4f7edb41e3 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -8,60 +8,60 @@ Release Date: September 27, 2021 TiDB version: 5.1.2 -## Improvements +## Compatibility changes -+ TiDB ++ Tools - - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) + + TiCDC -+ TiFlash + - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) + - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) + - Fix CLI back-compatibility [#2414](https://github.com/pingcap/ticdc/pull/2414) - - Support pushing down ROUND(X) to TiFlash. [#2611](https://github.com/pingcap/tics/pull/2611) - - support function DATE() pushed down to tiflash [#2602](https://github.com/pingcap/tics/pull/2602) - - support functions of ADDDATE() and DATE_ADD() pushed down to tiflash [#2591](https://github.com/pingcap/tics/pull/2591) - - retry when meeting stablish conn fails [#2570](https://github.com/pingcap/tics/pull/2570) - - Support pushing down MOD(N, M) to TiFlash. [#2560](https://github.com/pingcap/tics/pull/2560) - - Add Grafana panels for write throughput per instance [#2544](https://github.com/pingcap/tics/pull/2544) - - Cherry-pick #2216 #2460 #2494 & Optimizr read-index retry to release-5.1 [#2345](https://github.com/pingcap/tics/pull/2345) +## Feature enhancements -## Bug Fixes ++ Tools + + + Dumpling + + - Support for backing up MySQL compatible databases that don't support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#328](https://github.com/pingcap/dumpling/pull/328) + - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) + +## Improvements + TiDB - - Fix wrong index hash join when hash col is enum. [#28081](https://github.com/pingcap/tidb/pull/28081) - - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases. [#27678](https://github.com/pingcap/tidb/pull/27678) - - Keep the overflow check logic same with mysql [#26725](https://github.com/pingcap/tidb/pull/26725) - - Fix #26147 that `tidb` returns an `unknow` error with no message while it should return the error that contains `pd is timeout`. [#26682](https://github.com/pingcap/tidb/pull/26682) - - Fix wrong charset and collation for case when function [#26673](https://github.com/pingcap/tidb/pull/26673) - - Fix the issue that greatest(datetime) union null returns empty string [#26566](https://github.com/pingcap/tidb/pull/26566) + - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) + - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) -+ TiFlash ++ TiKV - - Fix the potential issue of data inconsistency after crashes when deployed on multi-disks [#2776](https://github.com/pingcap/tics/pull/2776) - - fix bug that SharedQueryBlockInputStream may loss block randomly. [#2762](https://github.com/pingcap/tics/pull/2762) - - Please add a release note, or a 'None' if it is not needed. [#2710](https://github.com/pingcap/tics/pull/2710) - - Fix concurrency between init store and DDL. [#2693](https://github.com/pingcap/tics/pull/2693) - - Fix false alert of expected internal DDL error [#2673](https://github.com/pingcap/tics/pull/2673) - - Fix the bug that filters unexpected data if the query contains "constant" "<"/"<="/">"/">=" "column" [#2635](https://github.com/pingcap/tics/pull/2635) - - Fix an overflow bug in decimal MOD(N, M). [#2609](https://github.com/pingcap/tics/pull/2609) - - Fix the potential panic when applying Snapshot with multiple DDL operations [#2606](https://github.com/pingcap/tics/pull/2606) - - Fix inaccurate store size on tiflash metric under heavy write scenario [#2598](https://github.com/pingcap/tics/pull/2598) - - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time [#2337](https://github.com/pingcap/tics/pull/2337) + - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) + - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) + - limit the hotspot report count. [#10621](https://github.com/tikv/tikv/pull/10621) + PD - - Fix the bug that PD would not fix down-peer in time. [#4083](https://github.com/tikv/pd/pull/4083) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3915](https://github.com/tikv/pd/pull/3915) - - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) + - dynamically adjust the retry limit according to the operator [#4048](https://github.com/tikv/pd/pull/4048) + - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) + - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) + ++ TiFlash + + - Support the `DATE()` function + - Add Grafana panels for write throughput per instance + - Optimize the performance about `leader-read` process + - Optimize the process about canceling `MPP` tasks + Tools - + Backup & Restore (BR) + + TiCDC - - Fix the bug that in concurrency mode, pd schedulers may not be restored if one or more lightning failed. [#1422](https://github.com/pingcap/br/pull/1422) - - Fix the bug that lightning local backend may met checksum mismatch error due to data loss. [#1416](https://github.com/pingcap/br/pull/1416) + - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) + - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) -## 以下 note 未分类。请将以下 note 进行分类 (Feature enhancements, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 +## Bug Fixes + TiDB @@ -69,7 +69,6 @@ TiDB version: 5.1.2 - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) - - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) @@ -95,31 +94,33 @@ TiDB version: 5.1.2 - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10912](https://github.com/tikv/tikv/pull/10912) - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10873](https://github.com/tikv/tikv/pull/10873) - - TiKV coprocessor slow log will only consider time spent on processing the request. - - Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) + - TiKV coprocessor slow log will only consider time spent on processing the request. Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10856](https://github.com/tikv/tikv/pull/10856) - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version - - Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) + - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version. Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - Fix TiKV delete files before it ingests to RocksDB. [#10741](https://github.com/tikv/tikv/pull/10741) - - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) - - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) - Fix the resolve failures caused by the left pessimisic locks. [#10653](https://github.com/tikv/tikv/pull/10653) - - limit the hotspot report count. [#10621](https://github.com/tikv/tikv/pull/10621) -+ PingCAP/TiFlash ++ TiFlash - - function result name should contain collator info [#2819](https://github.com/pingcap/tics/pull/2819) - - Support INET6_ATON and INET6_NTOA in TiFlash. [#2624](https://github.com/pingcap/tics/pull/2624) - - Support INET_ATON and INET_NTOA in TiFlash. [#2613](https://github.com/pingcap/tics/pull/2613) - - update client to fix race bug [#2583](https://github.com/pingcap/tics/pull/2583) - - expand streams after aggregation [#2537](https://github.com/pingcap/tics/pull/2537) - - Improve the mpp cancel process to cancel the mpp task ASAP [#2518](https://github.com/pingcap/tics/pull/2518) - - Fix the bug may cause metrics to display error value. [#2469](https://github.com/pingcap/tics/pull/2469) + - Fix the issue of unexpected results when TiFlash fails to establish MPP connections + - Fix the potential issue of data inconsistency that occurs when TiFlash is deployed on multiple disks + - Fix a bug that MPP queries get wrong results when TiFlash server is under high load + - Fix a potential bug that MPP queries hang forever + - Fix the issue of concurrency problem between store initialization and `DDL` + - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT` `<` | `<=` | `>` | `>=` `COLUMN` + - Fix the potential panic when applying `Snapshot` with multiple DDL operations + - Fix the issue that the store size in metrics is inaccurate under heavy writing + - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time + - Fix the issue of wrong results when new collation is enabled + - Fix the potential panic issue that occurs when resolving locks + - Fix a bug that metrics display wrong value + PD - - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) - - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) + - Fix the bug that PD would not fix down-peer in time. [#4083](https://github.com/tikv/pd/pull/4083) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3915](https://github.com/tikv/pd/pull/3915) + - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) + - Fix the bug that hot region scheduler can not work when the cluster has evict leader scheduler. [#3697](https://github.com/tikv/pd/pull/3697) + Tools @@ -130,27 +131,17 @@ TiDB version: 5.1.2 + Dumpling - fix pending on show table status in some mysql version [#333](https://github.com/pingcap/dumpling/pull/333) - - Support for backing up MySQL compatible databases that don't support START TRANSACTION ... WITH CONSISTENT SNAPSHOT - - Support for backing up MySQL compatible databases that don't support SHOW CREATE TABLE [#328](https://github.com/pingcap/dumpling/pull/328) + TiCDC - - Fix json encoding could panic when processing a string type value in some cases. [#2783](https://github.com/pingcap/ticdc/pull/2783) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2729](https://github.com/pingcap/ticdc/pull/2729) + - Fix json encoding may cause panic when processing a string type value in some cases. [#2783](https://github.com/pingcap/ticdc/pull/2783) - Fix OOM when TiCDC captures too many regions [#2725](https://github.com/pingcap/ticdc/pull/2725) - Fix gRPC keepalive error when memory pressure is high. [#2720](https://github.com/pingcap/ticdc/pull/2720) - - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) - - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2656](https://github.com/pingcap/ticdc/pull/2656) - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) - Fixed a bug in DDL handling when the owner restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) - - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) - - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) - - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2454](https://github.com/pingcap/ticdc/pull/2454) - fix a bug where synchronizing large tables to cdclog failed. [#2446](https://github.com/pingcap/ticdc/pull/2446) - - Fix CLI back-compatibility [#2414](https://github.com/pingcap/ticdc/pull/2414) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) \ No newline at end of file From a3ecb69de79f61eeb08c822b84416f2c18f09f8f Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 24 Sep 2021 14:22:48 +0800 Subject: [PATCH 07/33] add more tidb notes --- releases/release-5.1.2.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 50c4f7edb41e3..12237a97e49ac 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -65,6 +65,12 @@ TiDB version: 5.1.2 + TiDB + - Fix wrong index hash join when hash col is enum. [#28081](https://github.com/pingcap/tidb/pull/28081) + - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases. [#27678](https://github.com/pingcap/tidb/pull/27678) + - Keep the overflow check logic same with mysql [#26725](https://github.com/pingcap/tidb/pull/26725) + - Fix #26147 that `tidb` returns an `unknow` error with no message while it should return the error that contains `pd is timeout`. [#26682](https://github.com/pingcap/tidb/pull/26682) + - Fix wrong charset and collation for case when function [#26673](https://github.com/pingcap/tidb/pull/26673) + - Fix the issue that greatest(datetime) union null returns empty string [#26566](https://github.com/pingcap/tidb/pull/26566) - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) From 595252e145a5a63ffe5da9fa869d86e83b279516 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Sun, 26 Sep 2021 09:41:51 +0800 Subject: [PATCH 08/33] Update releases/release-5.1.2.md Co-authored-by: Yuanjia Zhang --- releases/release-5.1.2.md | 25 ++++++++++++++++++++++++- 1 file changed, 24 insertions(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 12237a97e49ac..2dbd6ddd778d2 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -33,7 +33,30 @@ TiDB version: 5.1.2 - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) - + - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) + - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) + - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) + - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) + - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) + - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) + - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) + - make `group_concat` function consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) + - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27506](https://github.com/pingcap/tidb/pull/27506) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27411](https://github.com/pingcap/tidb/pull/27411) + - expression: fix extract bug when argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) + - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27265](https://github.com/pingcap/tidb/pull/27265) + - fix wrong selection push down when having above agg [#27258](https://github.com/pingcap/tidb/pull/27258) + - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) + - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) + - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) + - planner: add missing distinct flag for Apply convert to join. [#26969](https://github.com/pingcap/tidb/pull/26969) + - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) + - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) + - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) + - planner: fix CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) + - Fix a bug 'select for update' does not correctly lock the data when a normal table join a partition table. [#26631](https://github.com/pingcap/tidb/pull/26631) + - Fix a panic when select for update on a normal table join a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) + - Fix the issue that point get does not use lite version resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + TiKV - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) From 03c94fe6e29b5b2765abe45bac82aeddf80e8af9 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Sun, 26 Sep 2021 10:11:58 +0800 Subject: [PATCH 09/33] Apply suggestions from code review --- releases/release-5.1.2.md | 24 ------------------------ 1 file changed, 24 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 2dbd6ddd778d2..806f0ff2043e1 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -33,30 +33,6 @@ TiDB version: 5.1.2 - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) - - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) - - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) - - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) - - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) - - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) - - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) - - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) - - make `group_concat` function consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) - - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27506](https://github.com/pingcap/tidb/pull/27506) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27411](https://github.com/pingcap/tidb/pull/27411) - - expression: fix extract bug when argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) - - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27265](https://github.com/pingcap/tidb/pull/27265) - - fix wrong selection push down when having above agg [#27258](https://github.com/pingcap/tidb/pull/27258) - - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) - - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) - - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) - - planner: add missing distinct flag for Apply convert to join. [#26969](https://github.com/pingcap/tidb/pull/26969) - - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) - - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) - - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) - - planner: fix CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) - - Fix a bug 'select for update' does not correctly lock the data when a normal table join a partition table. [#26631](https://github.com/pingcap/tidb/pull/26631) - - Fix a panic when select for update on a normal table join a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) - - Fix the issue that point get does not use lite version resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + TiKV - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) From 822f06bd6cc40bea8a138df501bf88c1d9297836 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sun, 26 Sep 2021 14:34:33 +0800 Subject: [PATCH 10/33] Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> Co-authored-by: Enwei Co-authored-by: xixirangrang <35301108+hfxsd@users.noreply.github.com> --- releases/release-5.1.2.md | 32 ++++++++++++++++---------------- 1 file changed, 16 insertions(+), 16 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 806f0ff2043e1..b8d4f4bbec85e 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -16,7 +16,7 @@ TiDB version: 5.1.2 - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - - Fix CLI back-compatibility [#2414](https://github.com/pingcap/ticdc/pull/2414) + - Fix the CLI compatibility issue with 4.0.x clusters on the default sort-engine option [#2414](https://github.com/pingcap/ticdc/pull/2414) ## Feature enhancements @@ -35,15 +35,15 @@ TiDB version: 5.1.2 - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) + TiKV - - Support changing CDC configs dynamically [#10686](https://github.com/tikv/tikv/pull/10686) - - Reduce resolved ts message size to save network bandwidth. [#10679](https://github.com/tikv/tikv/pull/10679) - - limit the hotspot report count. [#10621](https://github.com/tikv/tikv/pull/10621) + - Support dynamically modifying CDC (Change Data Capture) configurations [#10686](https://github.com/tikv/tikv/pull/10686) + - Reduce the size of Resolved TS message to save network bandwidth [#10679](https://github.com/tikv/tikv/pull/10679) + - Limit the counts of peer states (PeerStat) in the heartbeat message reported by a single store [#10621](https://github.com/tikv/tikv/pull/10621) + PD - - dynamically adjust the retry limit according to the operator [#4048](https://github.com/tikv/pd/pull/4048) - - allow empty region to be scheduled and use a sperate tolerance config in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) - - Improved the performance of synchronizing Region information between PDs. [#3933](https://github.com/tikv/pd/pull/3933) + - Allow empty regions to be scheduled and use a separate tolerance configuration in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) + - Improve the performance of synchronizing Region information between PDs [#3933](https://github.com/tikv/pd/pull/3933) + - Support dynamically adjusting the retry limit of a store based on generated Operator [#4048](https://github.com/tikv/pd/pull/4048) + TiFlash @@ -56,7 +56,7 @@ TiDB version: 5.1.2 + TiCDC - - Optimize memory management when unified sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) + - Optimize memory management when the Unified Sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) @@ -131,20 +131,20 @@ TiDB version: 5.1.2 + Backup & Restore (BR) - - fix the bug that the average speed isn't accurate in backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + - Fix the bug that the average speed isn't accurate during data backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + Dumpling - - fix pending on show table status in some mysql version [#333](https://github.com/pingcap/dumpling/pull/333) + - Fix pending on show table status in some MySQL versions (8.0.3, 8.0.23) [#333](https://github.com/pingcap/dumpling/pull/333) + TiCDC - - Fix json encoding may cause panic when processing a string type value in some cases. [#2783](https://github.com/pingcap/ticdc/pull/2783) - - Fix OOM when TiCDC captures too many regions [#2725](https://github.com/pingcap/ticdc/pull/2725) - - Fix gRPC keepalive error when memory pressure is high. [#2720](https://github.com/pingcap/ticdc/pull/2720) - - Fix a bug that causes TiCDC to panic on an unsigned tinyint [#2656](https://github.com/pingcap/ticdc/pull/2656) - - Fix open protocol, don't output an empty value when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) - - Fixed a bug in DDL handling when the owner restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) + - Fix a bug that json encoding may cause panic when processing a string type value that is `string` or `[]byte`. [#2783](https://github.com/pingcap/ticdc/pull/2783) + - Reduce gRPC window size to avoid OOM [#2725](https://github.com/pingcap/ticdc/pull/2725) + - Fix gRPC keepalive error under high memory pressure. [#2720](https://github.com/pingcap/ticdc/pull/2720) + - Fix a bug that an unsigned tinyint causes TiCDC to panic. [#2656](https://github.com/pingcap/ticdc/pull/2656) + - Fix empty value issue in open protocol. An empty value is no longer output when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) + - Fix a bug in DDL handling during manual restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) From 643085262cfdc5eac208d7a243d940029f640699 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Sun, 26 Sep 2021 14:35:08 +0800 Subject: [PATCH 11/33] Update releases/release-5.1.2.md Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> --- releases/release-5.1.2.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index b8d4f4bbec85e..db853774b782a 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -48,9 +48,9 @@ TiDB version: 5.1.2 + TiFlash - Support the `DATE()` function - - Add Grafana panels for write throughput per instance - - Optimize the performance about `leader-read` process - - Optimize the process about canceling `MPP` tasks + - Add write throughput per instance to Grafana panels + - Optimize the performance of the `leader-read` process + - Accelerate the process of canceling `MPP` tasks + Tools From 043e0d68228c8a2fb9e0a4e811bd1c5ece325200 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Sun, 26 Sep 2021 15:43:16 +0800 Subject: [PATCH 12/33] Update releases/release-5.1.2.md Co-authored-by: Yuanjia Zhang --- releases/release-5.1.2.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index db853774b782a..dbd1676766f15 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -31,8 +31,8 @@ TiDB version: 5.1.2 + TiDB - - Trigger auto-analyze based on histogram row count [#26708](https://github.com/pingcap/tidb/pull/26708) - - push down mod() to TiFlash. [#27865](https://github.com/pingcap/tidb/pull/27865) + - Trigger auto-analyze by histogram row count, increase the accuracy of this trigger action [#26708](https://github.com/pingcap/tidb/pull/26708) + - Push down mod() to TiFlash, increase the query performance. [#27865](https://github.com/pingcap/tidb/pull/27865) + TiKV - Support dynamically modifying CDC (Change Data Capture) configurations [#10686](https://github.com/tikv/tikv/pull/10686) From af41e4bdaa2afc3b7700ef4a1115fba999a92bf1 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Sun, 26 Sep 2021 19:33:29 +0800 Subject: [PATCH 13/33] Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> --- releases/release-5.1.2.md | 89 +++++++++++++++++++-------------------- 1 file changed, 44 insertions(+), 45 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index dbd1676766f15..60920b772298b 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -24,8 +24,8 @@ TiDB version: 5.1.2 + Dumpling - - Support for backing up MySQL compatible databases that don't support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#328](https://github.com/pingcap/dumpling/pull/328) - - Add a global gRPC connection pool and share gRPC connections among kv clients. [#2534](https://github.com/pingcap/ticdc/pull/2534) + - Support for backing up MySQL compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#328](https://github.com/pingcap/dumpling/pull/328) + - Add a global `gRPC` connection pool and share `gRPC` connections among `kv` clients [#2534](https://github.com/pingcap/ticdc/pull/2534) ## Improvements @@ -56,44 +56,43 @@ TiDB version: 5.1.2 + TiCDC - - Optimize memory management when the Unified Sorter is using memory to sort. [#2712](https://github.com/pingcap/ticdc/pull/2712) - - Optimize workerpool for fewer goroutines when concurrency is high. [#2488](https://github.com/pingcap/ticdc/pull/2488) + - Optimize memory management when the Unified Sorter is using memory to sort [#2712](https://github.com/pingcap/ticdc/pull/2712) + - Optimize workerpool for fewer goroutines when concurrency is high [#2488](https://github.com/pingcap/ticdc/pull/2488) - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) ## Bug Fixes + TiDB - - Fix wrong index hash join when hash col is enum. [#28081](https://github.com/pingcap/tidb/pull/28081) - - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases. [#27678](https://github.com/pingcap/tidb/pull/27678) - - Keep the overflow check logic same with mysql [#26725](https://github.com/pingcap/tidb/pull/26725) - - Fix #26147 that `tidb` returns an `unknow` error with no message while it should return the error that contains `pd is timeout`. [#26682](https://github.com/pingcap/tidb/pull/26682) - - Fix wrong charset and collation for case when function [#26673](https://github.com/pingcap/tidb/pull/26673) - - Fix the issue that greatest(datetime) union null returns empty string [#26566](https://github.com/pingcap/tidb/pull/26566) - - Fix `can not found column in Schema column` error for mpp queries [#28148](https://github.com/pingcap/tidb/pull/28148) - - Fix a bug that TiDB may crash when TiFlash is shutting down. [#28139](https://github.com/pingcap/tidb/pull/28139) - - This reverts commit d4cd12fe422fb18b6012607ee18b6acca40d9225. [#28091](https://github.com/pingcap/tidb/pull/28091) - - planner: fix the problem of using `enum like 'x%'` to build the wrong range [#28066](https://github.com/pingcap/tidb/pull/28066) - - fix expression rewrite makes between expr infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) - - execution: fix cte dead lock when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) - - Fix a bug that retryable deadlocks are incorrectly recorded into `INFORMATION_SCHEMA.DEADLOCKS` table. [#27535](https://github.com/pingcap/tidb/pull/27535) - - make `group_concat` function consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) - - Fix bug that count disctinct on multi-columns return wrong result when new collation is on. [#27506](https://github.com/pingcap/tidb/pull/27506) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected. [#27411](https://github.com/pingcap/tidb/pull/27411) - - expression: fix extract bug when argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) - - The undocumented `/debug/sub-optimal-plan` HTTP API has been removed. [#27265](https://github.com/pingcap/tidb/pull/27265) - - fix wrong selection push down when having above agg [#27258](https://github.com/pingcap/tidb/pull/27258) - - fix a bug that query on hash partition table return wrong reslut [#27164](https://github.com/pingcap/tidb/pull/27164) - - executor: fix unexpected behavior when casting invalid string to date [#27112](https://github.com/pingcap/tidb/pull/27112) - - fix a bug that creates partition fail if `NO_UNSIGNED_SUBTRACTION` is set. [#27053](https://github.com/pingcap/tidb/pull/27053) - - planner: add missing distinct flag for Apply convert to join. [#26969](https://github.com/pingcap/tidb/pull/26969) - - Fix an issue that NO_ZERO_IN_DATE does not work on the default values. [#26904](https://github.com/pingcap/tidb/pull/26904) - - store/copr: block the tiflash node for a period when it fails before. [#26897](https://github.com/pingcap/tidb/pull/26897) - - Fix then bug if the CTE is referenced more than once. [#26661](https://github.com/pingcap/tidb/pull/26661) - - planner: fix CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) - - Fix a bug 'select for update' does not correctly lock the data when a normal table join a partition table. [#26631](https://github.com/pingcap/tidb/pull/26631) - - Fix a panic when select for update on a normal table join a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) - - Fix the issue that point get does not use lite version resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + - Fix the potential wrong results of index hash join when the hash column is in the ENUM type [#28081](https://github.com/pingcap/tidb/pull/28081) + - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases [#27678](https://github.com/pingcap/tidb/pull/27678) + - Fix the compatibility issue of the overflow check by keeping the same logic as MySQL [#26725](https://github.com/pingcap/tidb/pull/26725) + - Fix the issue that TiDB returns an `unknow` error while it should return the `pd is timeout` error [#26682](https://github.com/pingcap/tidb/pull/26682) + - Fix the error of the case when function caused by the wrong charset and collation [#26673](https://github.com/pingcap/tidb/pull/26673) + - Fix the issue that `greatest(datetime) union null` returns an empty string [#26566](https://github.com/pingcap/tidb/pull/26566) + - Fix the potential `can not found column in Schema column` error for MPP queries [#28148](https://github.com/pingcap/tidb/pull/28148) + - Fix a bug that TiDB may panic when TiFlash is shutting down [#28139](https://github.com/pingcap/tidb/pull/28139) + - Fix the issue of wrong range caused by using `enum like 'x%'` [#28066](https://github.com/pingcap/tidb/pull/28066) + - Fix the issue that the `between` expression infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) + - Fix the Common Table Expression (CTE) dead lock issue when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) + - Fix a bug that retryable deadlocks are incorrectly recorded into the `INFORMATION_SCHEMA.DEADLOCKS` table [#27535](https://github.com/pingcap/tidb/pull/27535) + - Fix a bug that `GROUP_CONCAT` function does not consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) + - Fix a bug that the COUNT(DISTINCT) function on multiple columns returns wrong results when New Collation is on [#27506](https://github.com/pingcap/tidb/pull/27506) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected [#27411](https://github.com/pingcap/tidb/pull/27411) + - Fix a bug that the EXTRACT function returns wrong results when the argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) + - Remove the unused `/debug/sub-optimal-plan` HTTP API [#27265](https://github.com/pingcap/tidb/pull/27265) + - Fix the issue that a wrong selection is pushed down when the HAVING condition is used in the aggregate function [#27258](https://github.com/pingcap/tidb/pull/27258) + - Fix a bug that the query may return wrong results when the hash partition table deals with unsigned data [#27164](https://github.com/pingcap/tidb/pull/27164) + - Fix the unexpected behavior when casting an invalid string to DATE [#27112](https://github.com/pingcap/tidb/pull/27112) + - Fix a bug that creating partition fails if `NO_UNSIGNED_SUBTRACTION` is set [#27053](https://github.com/pingcap/tidb/pull/27053) + - Fix the issue that the distinct flag is missing when Apply is converted to Join [#26969](https://github.com/pingcap/tidb/pull/26969) + - Fix the issue that NO_ZERO_IN_DATE does not work on the default values [#26904](https://github.com/pingcap/tidb/pull/26904) + - Set a block duration for the newly recovered TiFlash node to avoid blocking queries during this time [#26897](https://github.com/pingcap/tidb/pull/26897) + - Fix a bug that might occur when the CTE is referenced more than once [#26661](https://github.com/pingcap/tidb/pull/26661) + - Fix a CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) + - Fix a bug that the 'SELECT FOR UPDATE' statement does not correctly lock the data when a normal table joins a partition table [#26631](https://github.com/pingcap/tidb/pull/26631) + - Fix the issue that the 'SELECT FOR UPDATE' statement returns an error when a normal table joins a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) + - Fix the issue that `PointGet` does not use the lite version of resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + TiKV @@ -113,11 +112,11 @@ TiDB version: 5.1.2 - Fix a potential bug that MPP queries hang forever - Fix the issue of concurrency problem between store initialization and `DDL` - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT` `<` | `<=` | `>` | `>=` `COLUMN` - - Fix the potential panic when applying `Snapshot` with multiple DDL operations + - Fix the potential panic issue when `Snapshot` is applied simultaneously with with multiple DDL operations - Fix the issue that the store size in metrics is inaccurate under heavy writing - - Fix the potential issue that TiFlash cannot GC the delta data after running for a long time - - Fix the issue of wrong results when new collation is enabled - - Fix the potential panic issue that occurs when resolving locks + - Fix the potential issue that TiFlash cannot perform GC for the delta data after running for a long time + - Fix the issue of wrong results when `new collation` is enabled + - Fix the potential panic issue that occurs during lock resolving - Fix a bug that metrics display wrong value + PD @@ -131,11 +130,11 @@ TiDB version: 5.1.2 + Backup & Restore (BR) - - Fix the bug that the average speed isn't accurate during data backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + - Fix the issue that the average speed is not accurate during data backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + Dumpling - - Fix pending on show table status in some MySQL versions (8.0.3, 8.0.23) [#333](https://github.com/pingcap/dumpling/pull/333) + - Fix the issue that Dumpling is pending when `show table status` returns incorrect results in some MySQL versions (8.0.3, 8.0.23) [#333](https://github.com/pingcap/dumpling/pull/333) + TiCDC @@ -145,8 +144,8 @@ TiDB version: 5.1.2 - Fix a bug that an unsigned tinyint causes TiCDC to panic. [#2656](https://github.com/pingcap/ticdc/pull/2656) - Fix empty value issue in open protocol. An empty value is no longer output when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) - Fix a bug in DDL handling during manual restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) - - Fix a bug in metadata management [#2559](https://github.com/pingcap/ticdc/pull/2559) - - Fix a bug that multiple processors could write the same table when this table is re-scheduling [#2493](https://github.com/pingcap/ticdc/pull/2493) - - Fix a bug that owner could meet ErrSchemaStorageTableMiss error and reset a changefeed by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) - - fix the bug that changefeed cannot be removed if meet GcTTL Exceeded Error [#2454](https://github.com/pingcap/ticdc/pull/2454) - - fix a bug where synchronizing large tables to cdclog failed. [#2446](https://github.com/pingcap/ticdc/pull/2446) + - Fix the issue that EtcdWorker's snapshot isolation might be wrongly violated when managing the metadata [#2559](https://github.com/pingcap/ticdc/pull/2559) + - Fix the issue that multiple processors could write in the same table when re-scheduling this table [#2493](https://github.com/pingcap/ticdc/pull/2493) + - Fix the issue of the ErrSchemaStorageTableMiss error and that a changefeed is reset by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) + - Fix the issue that changefeed cannot be removed when the GcTTL Exceeded Error occors [#2454](https://github.com/pingcap/ticdc/pull/2454) + - Fix the issue that replicating large tables to `cdclog` fails [#2446](https://github.com/pingcap/ticdc/pull/2446) From e797df4c899baa87c65426d7321ceb10ed5e38b2 Mon Sep 17 00:00:00 2001 From: qiancai Date: Sun, 26 Sep 2021 19:52:12 +0800 Subject: [PATCH 14/33] replace pr numbers with issue numbers --- releases/release-5.1.2.md | 82 +++++++++++++++++++-------------------- 1 file changed, 41 insertions(+), 41 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 60920b772298b..d678e3fe2350a 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -31,12 +31,12 @@ TiDB version: 5.1.2 + TiDB - - Trigger auto-analyze by histogram row count, increase the accuracy of this trigger action [#26708](https://github.com/pingcap/tidb/pull/26708) - - Push down mod() to TiFlash, increase the query performance. [#27865](https://github.com/pingcap/tidb/pull/27865) + - Trigger auto-analyze by histogram row count, increase the accuracy of this trigger action [#24237](https://github.com/pingcap/tidb/issues/24237) + - Push down mod() to TiFlash, increase the query performance. [#2318](https://github.com/pingcap/tics/issues/2318) + TiKV - - Support dynamically modifying CDC (Change Data Capture) configurations [#10686](https://github.com/tikv/tikv/pull/10686) - - Reduce the size of Resolved TS message to save network bandwidth [#10679](https://github.com/tikv/tikv/pull/10679) + - Support dynamically modifying CDC (Change Data Capture) configurations [#10645](https://github.com/tikv/tikv/issues/10645) + - Reduce the size of Resolved TS message to save network bandwidth [#2448](https://github.com/pingcap/ticdc/issues/2448) - Limit the counts of peer states (PeerStat) in the heartbeat message reported by a single store [#10621](https://github.com/tikv/tikv/pull/10621) + PD @@ -58,51 +58,51 @@ TiDB version: 5.1.2 - Optimize memory management when the Unified Sorter is using memory to sort [#2712](https://github.com/pingcap/ticdc/pull/2712) - Optimize workerpool for fewer goroutines when concurrency is high [#2488](https://github.com/pingcap/ticdc/pull/2488) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2378](https://github.com/pingcap/ticdc/pull/2378) + - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) ## Bug Fixes + TiDB - - Fix the potential wrong results of index hash join when the hash column is in the ENUM type [#28081](https://github.com/pingcap/tidb/pull/28081) + - Fix the potential wrong results of index hash join when the hash column is in the ENUM type [#27893](https://github.com/pingcap/tidb/issues/27893) - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases [#27678](https://github.com/pingcap/tidb/pull/27678) - - Fix the compatibility issue of the overflow check by keeping the same logic as MySQL [#26725](https://github.com/pingcap/tidb/pull/26725) - - Fix the issue that TiDB returns an `unknow` error while it should return the `pd is timeout` error [#26682](https://github.com/pingcap/tidb/pull/26682) - - Fix the error of the case when function caused by the wrong charset and collation [#26673](https://github.com/pingcap/tidb/pull/26673) - - Fix the issue that `greatest(datetime) union null` returns an empty string [#26566](https://github.com/pingcap/tidb/pull/26566) + - Fix the compatibility issue of the overflow check by keeping the same logic as MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) + - Fix the issue that TiDB returns an `unknow` error while it should return the `pd is timeout` error [#26147](https://github.com/pingcap/tidb/issues/26147) + - Fix the error of the case when function caused by the wrong charset and collation [#26662](https://github.com/pingcap/tidb/issues/26662) + - Fix the issue that `greatest(datetime) union null` returns an empty string [#26532](https://github.com/pingcap/tidb/issues/26532) - Fix the potential `can not found column in Schema column` error for MPP queries [#28148](https://github.com/pingcap/tidb/pull/28148) - - Fix a bug that TiDB may panic when TiFlash is shutting down [#28139](https://github.com/pingcap/tidb/pull/28139) - - Fix the issue of wrong range caused by using `enum like 'x%'` [#28066](https://github.com/pingcap/tidb/pull/28066) - - Fix the issue that the `between` expression infers wrong collation. [#27549](https://github.com/pingcap/tidb/pull/27549) - - Fix the Common Table Expression (CTE) dead lock issue when used with IndexLookupJoin [#27536](https://github.com/pingcap/tidb/pull/27536) - - Fix a bug that retryable deadlocks are incorrectly recorded into the `INFORMATION_SCHEMA.DEADLOCKS` table [#27535](https://github.com/pingcap/tidb/pull/27535) - - Fix a bug that `GROUP_CONCAT` function does not consider the collation [#27529](https://github.com/pingcap/tidb/pull/27529) - - Fix a bug that the COUNT(DISTINCT) function on multiple columns returns wrong results when New Collation is on [#27506](https://github.com/pingcap/tidb/pull/27506) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected [#27411](https://github.com/pingcap/tidb/pull/27411) - - Fix a bug that the EXTRACT function returns wrong results when the argument is a negative duration [#27367](https://github.com/pingcap/tidb/pull/27367) + - Fix a bug that TiDB may panic when TiFlash is shutting down [#28096](https://github.com/pingcap/tidb/issues/28096) + - Fix the issue of wrong range caused by using `enum like 'x%'` [#27130](https://github.com/pingcap/tidb/issues/27130) + - Fix the issue that the `between` expression infers wrong collation. [#27146](https://github.com/pingcap/tidb/issues/27146) + - Fix the Common Table Expression (CTE) dead lock issue when used with IndexLookupJoin [#27410](https://github.com/pingcap/tidb/issues/27410) + - Fix a bug that retryable deadlocks are incorrectly recorded into the `INFORMATION_SCHEMA.DEADLOCKS` table [#27400](https://github.com/pingcap/tidb/issues/27400) + - Fix a bug that `GROUP_CONCAT` function does not consider the collation [#27429](https://github.com/pingcap/tidb/issues/27429) + - Fix a bug that the COUNT(DISTINCT) function on multiple columns returns wrong results when New Collation is on [#27091](https://github.com/pingcap/tidb/issues/27091) + - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected [#27349](https://github.com/pingcap/tidb/issues/27349) + - Fix a bug that the EXTRACT function returns wrong results when the argument is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) - Remove the unused `/debug/sub-optimal-plan` HTTP API [#27265](https://github.com/pingcap/tidb/pull/27265) - - Fix the issue that a wrong selection is pushed down when the HAVING condition is used in the aggregate function [#27258](https://github.com/pingcap/tidb/pull/27258) - - Fix a bug that the query may return wrong results when the hash partition table deals with unsigned data [#27164](https://github.com/pingcap/tidb/pull/27164) - - Fix the unexpected behavior when casting an invalid string to DATE [#27112](https://github.com/pingcap/tidb/pull/27112) - - Fix a bug that creating partition fails if `NO_UNSIGNED_SUBTRACTION` is set [#27053](https://github.com/pingcap/tidb/pull/27053) - - Fix the issue that the distinct flag is missing when Apply is converted to Join [#26969](https://github.com/pingcap/tidb/pull/26969) - - Fix the issue that NO_ZERO_IN_DATE does not work on the default values [#26904](https://github.com/pingcap/tidb/pull/26904) + - Fix the issue that a wrong selection is pushed down when the HAVING condition is used in the aggregate function [#26496](https://github.com/pingcap/tidb/issues/26496) + - Fix a bug that the query may return wrong results when the hash partition table deals with unsigned data [#26569](https://github.com/pingcap/tidb/issues/26569) + - Fix the unexpected behavior when casting an invalid string to DATE [#26762](https://github.com/pingcap/tidb/issues/26762) + - Fix a bug that creating partition fails if `NO_UNSIGNED_SUBTRACTION` is set [#26765](https://github.com/pingcap/tidb/issues/26765) + - Fix the issue that the distinct flag is missing when Apply is converted to Join [#26958](https://github.com/pingcap/tidb/issues/26958) + - Fix the issue that NO_ZERO_IN_DATE does not work on the default values [#26766](https://github.com/pingcap/tidb/issues/26766) - Set a block duration for the newly recovered TiFlash node to avoid blocking queries during this time [#26897](https://github.com/pingcap/tidb/pull/26897) - - Fix a bug that might occur when the CTE is referenced more than once [#26661](https://github.com/pingcap/tidb/pull/26661) - - Fix a CTE bug when MergeJoin is used [#26658](https://github.com/pingcap/tidb/pull/26658) - - Fix a bug that the 'SELECT FOR UPDATE' statement does not correctly lock the data when a normal table joins a partition table [#26631](https://github.com/pingcap/tidb/pull/26631) - - Fix the issue that the 'SELECT FOR UPDATE' statement returns an error when a normal table joins a partition table [#26563](https://github.com/pingcap/tidb/pull/26563) + - Fix a bug that might occur when the CTE is referenced more than once [#26212](https://github.com/pingcap/tidb/issues/26212) + - Fix a CTE bug when MergeJoin is used [#25474](https://github.com/pingcap/tidb/issues/25474) + - Fix a bug that the 'SELECT FOR UPDATE' statement does not correctly lock the data when a normal table joins a partition table [#26251](https://github.com/pingcap/tidb/issues/26251) + - Fix the issue that the 'SELECT FOR UPDATE' statement returns an error when a normal table joins a partition table [#26250](https://github.com/pingcap/tidb/issues/26250) - Fix the issue that `PointGet` does not use the lite version of resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + TiKV - - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10912](https://github.com/tikv/tikv/pull/10912) - - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10873](https://github.com/tikv/tikv/pull/10873) + - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10902](https://github.com/tikv/tikv/issues/10902) + - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10813](https://github.com/tikv/tikv/issues/10813) - TiKV coprocessor slow log will only consider time spent on processing the request. Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) - - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10856](https://github.com/tikv/tikv/pull/10856) + - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10852](https://github.com/tikv/tikv/issues/10852) - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version. Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - - Fix TiKV delete files before it ingests to RocksDB. [#10741](https://github.com/tikv/tikv/pull/10741) - - Fix the resolve failures caused by the left pessimisic locks. [#10653](https://github.com/tikv/tikv/pull/10653) + - Fix TiKV delete files before it ingests to RocksDB. [#10438](https://github.com/tikv/tikv/issues/10438) + - Fix the resolve failures caused by the left pessimisic locks. [#26404](https://github.com/pingcap/tidb/issues/26404) + TiFlash @@ -121,8 +121,8 @@ TiDB version: 5.1.2 + PD - - Fix the bug that PD would not fix down-peer in time. [#4083](https://github.com/tikv/pd/pull/4083) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3915](https://github.com/tikv/pd/pull/3915) + - Fix the bug that PD would not fix down-peer in time. [#4077](https://github.com/tikv/pd/issues/4077) + - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3886](https://github.com/tikv/pd/issues/3886) - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) - Fix the bug that hot region scheduler can not work when the cluster has evict leader scheduler. [#3697](https://github.com/tikv/pd/pull/3697) @@ -130,7 +130,7 @@ TiDB version: 5.1.2 + Backup & Restore (BR) - - Fix the issue that the average speed is not accurate during data backup and restore [#1412](https://github.com/pingcap/br/pull/1412) + - Fix the issue that the average speed is not accurate during data backup and restore [#1405](https://github.com/pingcap/br/issues/1405) + Dumpling @@ -142,10 +142,10 @@ TiDB version: 5.1.2 - Reduce gRPC window size to avoid OOM [#2725](https://github.com/pingcap/ticdc/pull/2725) - Fix gRPC keepalive error under high memory pressure. [#2720](https://github.com/pingcap/ticdc/pull/2720) - Fix a bug that an unsigned tinyint causes TiCDC to panic. [#2656](https://github.com/pingcap/ticdc/pull/2656) - - Fix empty value issue in open protocol. An empty value is no longer output when there is no change in one transaction. [#2621](https://github.com/pingcap/ticdc/pull/2621) + - Fix empty value issue in open protocol. An empty value is no longer output when there is no change in one transaction. [#2612](https://github.com/pingcap/ticdc/issues/2612) - Fix a bug in DDL handling during manual restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) - Fix the issue that EtcdWorker's snapshot isolation might be wrongly violated when managing the metadata [#2559](https://github.com/pingcap/ticdc/pull/2559) - - Fix the issue that multiple processors could write in the same table when re-scheduling this table [#2493](https://github.com/pingcap/ticdc/pull/2493) - - Fix the issue of the ErrSchemaStorageTableMiss error and that a changefeed is reset by accident. [#2459](https://github.com/pingcap/ticdc/pull/2459) - - Fix the issue that changefeed cannot be removed when the GcTTL Exceeded Error occors [#2454](https://github.com/pingcap/ticdc/pull/2454) + - Fix the issue that multiple processors could write in the same table when re-scheduling this table [#2230](https://github.com/pingcap/ticdc/issues/2230) + - Fix the issue of the ErrSchemaStorageTableMiss error and that a changefeed is reset by accident. [#2422](https://github.com/pingcap/ticdc/issues/2422) + - Fix the issue that changefeed cannot be removed when the GcTTL Exceeded Error occors [#2391](https://github.com/pingcap/ticdc/issues/2391) - Fix the issue that replicating large tables to `cdclog` fails [#2446](https://github.com/pingcap/ticdc/pull/2446) From 7901389317f2c685058ddc092ab8ad6e922de25b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 10:20:02 +0800 Subject: [PATCH 15/33] Update releases/release-5.1.2.md Co-authored-by: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index d678e3fe2350a..75c85e6afd02d 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -16,7 +16,7 @@ TiDB version: 5.1.2 - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - - Fix the CLI compatibility issue with 4.0.x clusters on the default sort-engine option [#2414](https://github.com/pingcap/ticdc/pull/2414) + - Fix the CLI compatibility issue with 4.0.x clusters on the default sort-engine option [#2373](https://github.com/pingcap/ticdc/issues/2373) ## Feature enhancements From bb9056e0ef8ed3565daec9da6b3481d471ce63c7 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 10:21:12 +0800 Subject: [PATCH 16/33] Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> Co-authored-by: Enwei --- releases/release-5.1.2.md | 58 +++++++++++++++++++++------------------ 1 file changed, 31 insertions(+), 27 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 75c85e6afd02d..26fcb7263f650 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -24,7 +24,7 @@ TiDB version: 5.1.2 + Dumpling - - Support for backing up MySQL compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#328](https://github.com/pingcap/dumpling/pull/328) + - Support for backing up MySQL compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#309](https://github.com/pingcap/dumpling/issues/309) - Add a global `gRPC` connection pool and share `gRPC` connections among `kv` clients [#2534](https://github.com/pingcap/ticdc/pull/2534) ## Improvements @@ -33,17 +33,18 @@ TiDB version: 5.1.2 - Trigger auto-analyze by histogram row count, increase the accuracy of this trigger action [#24237](https://github.com/pingcap/tidb/issues/24237) - Push down mod() to TiFlash, increase the query performance. [#2318](https://github.com/pingcap/tics/issues/2318) + + TiKV - - Support dynamically modifying CDC (Change Data Capture) configurations [#10645](https://github.com/tikv/tikv/issues/10645) + - Support dynamically modifying TiCDC configurations [#10645] (https://github.com/tikv/tikv/issues/10645) - Reduce the size of Resolved TS message to save network bandwidth [#2448](https://github.com/pingcap/ticdc/issues/2448) - - Limit the counts of peer states (PeerStat) in the heartbeat message reported by a single store [#10621](https://github.com/tikv/tikv/pull/10621) + - Limit the counts of peer stats in the heartbeat message reported by a single store [#10621](https://github.com/tikv/tikv/pull/10621) + PD - Allow empty regions to be scheduled and use a separate tolerance configuration in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) - Improve the performance of synchronizing Region information between PDs [#3933](https://github.com/tikv/pd/pull/3933) - - Support dynamically adjusting the retry limit of a store based on generated Operator [#4048](https://github.com/tikv/pd/pull/4048) + - Support dynamically adjusting the retry limit of a store based on generated Operator [#3744](https://github.com/tikv/pd/issues/3744) + TiFlash @@ -56,8 +57,8 @@ TiDB version: 5.1.2 + TiCDC - - Optimize memory management when the Unified Sorter is using memory to sort [#2712](https://github.com/pingcap/ticdc/pull/2712) - - Optimize workerpool for fewer goroutines when concurrency is high [#2488](https://github.com/pingcap/ticdc/pull/2488) + - Optimize memory management when the Unified Sorter is using memory to sort [#2553](https://github.com/pingcap/ticdc/issues/2553) + - Optimize workerpool for fewer goroutines when concurrency is high [#2211](https://github.com/pingcap/ticdc/issues/2211) - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) ## Bug Fixes @@ -96,13 +97,22 @@ TiDB version: 5.1.2 + TiKV - - Fix bug when TiKV upgrade from 3.0 to 4.x and 5.x but there are still some files left by import. [#10902](https://github.com/tikv/tikv/issues/10902) - - RaftStore Snapshot GC fix: fix the issue that snapshot GC missed GC snapshot files when there's one snapshot file failed to be GC-ed. [#10813](https://github.com/tikv/tikv/issues/10813) - - TiKV coprocessor slow log will only consider time spent on processing the request. Drop log instead of blocking threads when slogger thread is overloaded and queue is filled up. [#10865](https://github.com/tikv/tikv/pull/10865) - - Bug fix: fix an unexpected panic when exceeds deadline on processing copr requests. [#10852](https://github.com/tikv/tikv/issues/10852) - - Fix TiKV panic when enable Titan and upgrade from pre-5.0 version. Fix newer TiKV can't rollback to 5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - - Fix TiKV delete files before it ingests to RocksDB. [#10438](https://github.com/tikv/tikv/issues/10438) - - Fix the resolve failures caused by the left pessimisic locks. [#26404](https://github.com/pingcap/tidb/issues/26404) + - Fix a bug that some files are missed to be imported during the process of importing snapshot files when upgrading TiKV from v3.x to v4.x or v5.x [#10902](https://github.com/tikv/tikv/issues/10902) + - Fix the issue that the GC (Garbage Collection) failure (such as file corrupted) of a single snapshot file stops the GC process of all other GC-able files [#10813](https://github.com/tikv/tikv/issues/10813) + - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) + - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) + - Fix a bug of the panic caused by timeout when processing Coprocessor requests [#10852](https://github.com/tikv/tikv/issues/10852) + - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10842](https://github.com/tikv/tikv/pull/10842) + - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) + - Fix the issue that TiKV might delete files before it ingests to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) + - Fix the parsing failure caused by the left pessimistic locks [#26404](https://github.com/pingcap/tidb/issues/26404) + ++ PD + + - Fix the issue that PD does not fix the down peers in time [#4077](https://github.com/tikv/pd/issues/4077) + - Fix the issue that the replica count of the default placement rules stays constant after `replication.max-replicas` is updated [#3886](https://github.com/tikv/pd/issues/3886) + - Fix a bug that PD might panic when scaling out TiKV [#3868](https://github.com/tikv/pd/issues/3868) + - Fix a bug that the hot region scheduler cannot work when the cluster has evict leader scheduler [#3697](https://github.com/tikv/pd/issues/3697) + TiFlash @@ -119,13 +129,6 @@ TiDB version: 5.1.2 - Fix the potential panic issue that occurs during lock resolving - Fix a bug that metrics display wrong value -+ PD - - - Fix the bug that PD would not fix down-peer in time. [#4077](https://github.com/tikv/pd/issues/4077) - - Fix an issue where data is not stored when using max-replicas or location-labels to indirectly update default placement rule [#3886](https://github.com/tikv/pd/issues/3886) - - Fix the bug that PD may panic during scaling out TiKV. [#3911](https://github.com/tikv/pd/pull/3911) - - Fix the bug that hot region scheduler can not work when the cluster has evict leader scheduler. [#3697](https://github.com/tikv/pd/pull/3697) - + Tools + Backup & Restore (BR) @@ -134,18 +137,19 @@ TiDB version: 5.1.2 + Dumpling - - Fix the issue that Dumpling is pending when `show table status` returns incorrect results in some MySQL versions (8.0.3, 8.0.23) [#333](https://github.com/pingcap/dumpling/pull/333) + - Fix the issue that Dumpling is pending when `show table status` returns incorrect results in some MySQL versions (8.0.3, 8.0.23) [#322](https://github.com/pingcap/dumpling/issues/322) + TiCDC - - Fix a bug that json encoding may cause panic when processing a string type value that is `string` or `[]byte`. [#2783](https://github.com/pingcap/ticdc/pull/2783) - - Reduce gRPC window size to avoid OOM [#2725](https://github.com/pingcap/ticdc/pull/2725) - - Fix gRPC keepalive error under high memory pressure. [#2720](https://github.com/pingcap/ticdc/pull/2720) - - Fix a bug that an unsigned tinyint causes TiCDC to panic. [#2656](https://github.com/pingcap/ticdc/pull/2656) + - Fix a bug that json encoding may cause panic when processing a string type value that is `string` or `[]byte`. [#2758](https://github.com/pingcap/ticdc/issues/2758) + - Reduce gRPC window size to avoid OOM [#2202](https://github.com/pingcap/ticdc/issues/2202) + - Fix gRPC keepalive error under high memory pressure. [#2202](https://github.com/pingcap/ticdc/issues/2202) + - Fix a bug that an unsigned tinyint causes TiCDC to panic. [#2648](https://github.com/pingcap/ticdc/issues/2648) - Fix empty value issue in open protocol. An empty value is no longer output when there is no change in one transaction. [#2612](https://github.com/pingcap/ticdc/issues/2612) - - Fix a bug in DDL handling during manual restarts. [#2607](https://github.com/pingcap/ticdc/pull/2607) + - Fix a bug in DDL handling during manual restarts [#2603](https://github.com/pingcap/ticdc/issues/2603) - Fix the issue that EtcdWorker's snapshot isolation might be wrongly violated when managing the metadata [#2559](https://github.com/pingcap/ticdc/pull/2559) - Fix the issue that multiple processors could write in the same table when re-scheduling this table [#2230](https://github.com/pingcap/ticdc/issues/2230) - Fix the issue of the ErrSchemaStorageTableMiss error and that a changefeed is reset by accident. [#2422](https://github.com/pingcap/ticdc/issues/2422) - Fix the issue that changefeed cannot be removed when the GcTTL Exceeded Error occors [#2391](https://github.com/pingcap/ticdc/issues/2391) - - Fix the issue that replicating large tables to `cdclog` fails [#2446](https://github.com/pingcap/ticdc/pull/2446) + - Fix the issue that replicating large tables to `cdclog` fails [#1259](https://github.com/pingcap/ticdc/issues/1259)[#2424](https://github.com/pingcap/ticdc/issues/2424) + From 12f01ec0dd70af523514c76f400dbd9a21188c51 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 12:37:11 +0800 Subject: [PATCH 17/33] fix --- releases/release-5.1.2.md | 107 +++++++++++++++++++------------------- 1 file changed, 53 insertions(+), 54 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 26fcb7263f650..c806483359f40 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -14,105 +14,105 @@ TiDB version: 5.1.2 + TiCDC - - Set compatible version from 5.1.0-alpha to 5.2.0-alpha [#2659](https://github.com/pingcap/ticdc/pull/2659) + - Set the compatible version from `5.1.0-alpha` to `5.2.0-alpha` [#2659](https://github.com/pingcap/ticdc/pull/2659) - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - - Fix the CLI compatibility issue with 4.0.x clusters on the default sort-engine option [#2373](https://github.com/pingcap/ticdc/issues/2373) + - Fix the CLI compatibility issue with 4.0.x clusters on the default `sort-engine` option [#2373](https://github.com/pingcap/ticdc/issues/2373) -## Feature enhancements +## Feature enhancement + Tools + Dumpling - - Support for backing up MySQL compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#309](https://github.com/pingcap/dumpling/issues/309) - - Add a global `gRPC` connection pool and share `gRPC` connections among `kv` clients [#2534](https://github.com/pingcap/ticdc/pull/2534) + - Support backing up MySQL-compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#309](https://github.com/pingcap/dumpling/issues/309) + - Add a global gRPC connection pool and share gRPC connections among KV clients [#2534](https://github.com/pingcap/ticdc/pull/2534) ## Improvements + TiDB - - Trigger auto-analyze by histogram row count, increase the accuracy of this trigger action [#24237](https://github.com/pingcap/tidb/issues/24237) - - Push down mod() to TiFlash, increase the query performance. [#2318](https://github.com/pingcap/tics/issues/2318) + - Trigger auto-analyze by histogram row count and increase the accuracy of this trigger action [#24237](https://github.com/pingcap/tidb/issues/24237) + - Push down `mod()` to TiFlash to increase the query performance [#2318](https://github.com/pingcap/tics/issues/2318) + TiKV - - Support dynamically modifying TiCDC configurations [#10645] (https://github.com/tikv/tikv/issues/10645) + - Support dynamically modifying TiCDC configurations [#10645](https://github.com/tikv/tikv/issues/10645) - Reduce the size of Resolved TS message to save network bandwidth [#2448](https://github.com/pingcap/ticdc/issues/2448) - Limit the counts of peer stats in the heartbeat message reported by a single store [#10621](https://github.com/tikv/tikv/pull/10621) + PD - - Allow empty regions to be scheduled and use a separate tolerance configuration in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) + - Allow empty Regions to be scheduled and use a separate tolerance configuration in scatter range scheduler [#4117](https://github.com/tikv/pd/pull/4117) - Improve the performance of synchronizing Region information between PDs [#3933](https://github.com/tikv/pd/pull/3933) - - Support dynamically adjusting the retry limit of a store based on generated Operator [#3744](https://github.com/tikv/pd/issues/3744) + - Support dynamically adjusting the retry limit of a store based on the generated operator [#3744](https://github.com/tikv/pd/issues/3744) + TiFlash - Support the `DATE()` function - Add write throughput per instance to Grafana panels - Optimize the performance of the `leader-read` process - - Accelerate the process of canceling `MPP` tasks + - Accelerate the process of canceling MPP tasks + Tools + TiCDC - - Optimize memory management when the Unified Sorter is using memory to sort [#2553](https://github.com/pingcap/ticdc/issues/2553) + - Optimize memory management when the Unified Sorter is using memory to sort data [#2553](https://github.com/pingcap/ticdc/issues/2553) - Optimize workerpool for fewer goroutines when concurrency is high [#2211](https://github.com/pingcap/ticdc/issues/2211) - - Reduce goroutine usage when a table's region transfer away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) + - Reduce goroutine usage when a table's Region transfer away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) ## Bug Fixes + TiDB - - Fix the potential wrong results of index hash join when the hash column is in the ENUM type [#27893](https://github.com/pingcap/tidb/issues/27893) - - Fix a batch client bug that recycle idle connection may block sending requests in some rare cases [#27678](https://github.com/pingcap/tidb/pull/27678) + - Fix the potential wrong results of index hash join when the hash column is the `ENUM` type [#27893](https://github.com/pingcap/tidb/issues/27893) + - Fix a batch client bug that recycle idle connection might block sending requests in some rare cases [#27678](https://github.com/pingcap/tidb/pull/27678) - Fix the compatibility issue of the overflow check by keeping the same logic as MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) - Fix the issue that TiDB returns an `unknow` error while it should return the `pd is timeout` error [#26147](https://github.com/pingcap/tidb/issues/26147) - - Fix the error of the case when function caused by the wrong charset and collation [#26662](https://github.com/pingcap/tidb/issues/26662) + - Fix the error of the `case when` function caused by the wrong charset and collation [#26662](https://github.com/pingcap/tidb/issues/26662) - Fix the issue that `greatest(datetime) union null` returns an empty string [#26532](https://github.com/pingcap/tidb/issues/26532) - Fix the potential `can not found column in Schema column` error for MPP queries [#28148](https://github.com/pingcap/tidb/pull/28148) - - Fix a bug that TiDB may panic when TiFlash is shutting down [#28096](https://github.com/pingcap/tidb/issues/28096) + - Fix a bug that TiDB might panic when TiFlash is shutting down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the issue of wrong range caused by using `enum like 'x%'` [#27130](https://github.com/pingcap/tidb/issues/27130) - - Fix the issue that the `between` expression infers wrong collation. [#27146](https://github.com/pingcap/tidb/issues/27146) + - Fix the issue that the `between` expression infers wrong collation [#27146](https://github.com/pingcap/tidb/issues/27146) - Fix the Common Table Expression (CTE) dead lock issue when used with IndexLookupJoin [#27410](https://github.com/pingcap/tidb/issues/27410) - Fix a bug that retryable deadlocks are incorrectly recorded into the `INFORMATION_SCHEMA.DEADLOCKS` table [#27400](https://github.com/pingcap/tidb/issues/27400) - - Fix a bug that `GROUP_CONCAT` function does not consider the collation [#27429](https://github.com/pingcap/tidb/issues/27429) - - Fix a bug that the COUNT(DISTINCT) function on multiple columns returns wrong results when New Collation is on [#27091](https://github.com/pingcap/tidb/issues/27091) - - Fix an issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected [#27349](https://github.com/pingcap/tidb/issues/27349) - - Fix a bug that the EXTRACT function returns wrong results when the argument is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) - - Remove the unused `/debug/sub-optimal-plan` HTTP API [#27265](https://github.com/pingcap/tidb/pull/27265) - - Fix the issue that a wrong selection is pushed down when the HAVING condition is used in the aggregate function [#26496](https://github.com/pingcap/tidb/issues/26496) - - Fix a bug that the query may return wrong results when the hash partition table deals with unsigned data [#26569](https://github.com/pingcap/tidb/issues/26569) - - Fix the unexpected behavior when casting an invalid string to DATE [#26762](https://github.com/pingcap/tidb/issues/26762) + - Fix a bug that the `GROUP_CONCAT` function does not consider the collation [#27429](https://github.com/pingcap/tidb/issues/27429) + - Fix a bug that the `COUNT(DISTINCT)` function on multiple columns returns wrong results when the new collation is enabled [#27091](https://github.com/pingcap/tidb/issues/27091) + - Fix the issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected [#27349](https://github.com/pingcap/tidb/issues/27349) + - Fix a bug that the `EXTRACT` function returns wrong results when the argument is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) + - Remove the unused `/debug/sub-optimal-plan` HTTP API [#27265](https://github.com/pingcap/tidb/pull/27265) + - Fix the issue that a wrong selection is pushed down when the `HAVING` condition is used in the aggregate function [#26496](https://github.com/pingcap/tidb/issues/26496) + - Fix a bug that the query might return wrong results when the hash partitioned table deals with unsigned data [#26569](https://github.com/pingcap/tidb/issues/26569) + - Fix the unexpected behavior when casting an invalid string to `DATE` [#26762](https://github.com/pingcap/tidb/issues/26762) - Fix a bug that creating partition fails if `NO_UNSIGNED_SUBTRACTION` is set [#26765](https://github.com/pingcap/tidb/issues/26765) - - Fix the issue that the distinct flag is missing when Apply is converted to Join [#26958](https://github.com/pingcap/tidb/issues/26958) - - Fix the issue that NO_ZERO_IN_DATE does not work on the default values [#26766](https://github.com/pingcap/tidb/issues/26766) - - Set a block duration for the newly recovered TiFlash node to avoid blocking queries during this time [#26897](https://github.com/pingcap/tidb/pull/26897) + - Fix the issue that the `distinct` flag is missing when `Apply` is converted to `Join` [#26958](https://github.com/pingcap/tidb/issues/26958) + - Fix the issue that `NO_ZERO_IN_DATE` does not work on the default values [#26766](https://github.com/pingcap/tidb/issues/26766) + - Set a block duration for the newly recovered TiFlash node to avoid blocking queries during this time [#26897](https://github.com/pingcap/tidb/pull/26897) - Fix a bug that might occur when the CTE is referenced more than once [#26212](https://github.com/pingcap/tidb/issues/26212) - Fix a CTE bug when MergeJoin is used [#25474](https://github.com/pingcap/tidb/issues/25474) - - Fix a bug that the 'SELECT FOR UPDATE' statement does not correctly lock the data when a normal table joins a partition table [#26251](https://github.com/pingcap/tidb/issues/26251) - - Fix the issue that the 'SELECT FOR UPDATE' statement returns an error when a normal table joins a partition table [#26250](https://github.com/pingcap/tidb/issues/26250) - - Fix the issue that `PointGet` does not use the lite version of resolve lock [#26562](https://github.com/pingcap/tidb/pull/26562) + - Fix a bug that the `SELECT FOR UPDATE` statement does not correctly lock the data when a normal table joins a partitioned table [#26251](https://github.com/pingcap/tidb/issues/26251) + - Fix the issue that the `SELECT FOR UPDATE` statement returns an error when a normal table joins a partitioned table [#26250](https://github.com/pingcap/tidb/issues/26250) + - Fix the issue that `PointGet` does not use the lite version of resolving lock [#26562](https://github.com/pingcap/tidb/pull/26562) + TiKV - - Fix a bug that some files are missed to be imported during the process of importing snapshot files when upgrading TiKV from v3.x to v4.x or v5.x [#10902](https://github.com/tikv/tikv/issues/10902) - - Fix the issue that the GC (Garbage Collection) failure (such as file corrupted) of a single snapshot file stops the GC process of all other GC-able files [#10813](https://github.com/tikv/tikv/issues/10813) - - The slow log of TiKV coprocessor only considers the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) + - Fix a bug that some files are missed during the process of importing snapshot files when upgrading TiKV from v3.x to later versions [#10902](https://github.com/tikv/tikv/issues/10902) + - Fix the potential disk full issue caused by corrupted snapshot files [#10813](https://github.com/tikv/tikv/issues/10813) + - Make the slow log of TiKV coprocessor only consider the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) - - Fix a bug of the panic caused by timeout when processing Coprocessor requests [#10852](https://github.com/tikv/tikv/issues/10852) + - Fix a panic issue that occurs when processing Coprocessor requests times out [#10852](https://github.com/tikv/tikv/issues/10852) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10842](https://github.com/tikv/tikv/pull/10842) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - - Fix the issue that TiKV might delete files before it ingests to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) + - Fix the issue that TiKV might delete files before it ingests data to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) - Fix the parsing failure caused by the left pessimistic locks [#26404](https://github.com/pingcap/tidb/issues/26404) - + + PD - Fix the issue that PD does not fix the down peers in time [#4077](https://github.com/tikv/pd/issues/4077) - Fix the issue that the replica count of the default placement rules stays constant after `replication.max-replicas` is updated [#3886](https://github.com/tikv/pd/issues/3886) - Fix a bug that PD might panic when scaling out TiKV [#3868](https://github.com/tikv/pd/issues/3868) - - Fix a bug that the hot region scheduler cannot work when the cluster has evict leader scheduler [#3697](https://github.com/tikv/pd/issues/3697) + - Fix a bug that the hot Region scheduler cannot work when the cluster has the evict leader scheduler [#3697](https://github.com/tikv/pd/issues/3697) + TiFlash @@ -120,12 +120,12 @@ TiDB version: 5.1.2 - Fix the potential issue of data inconsistency that occurs when TiFlash is deployed on multiple disks - Fix a bug that MPP queries get wrong results when TiFlash server is under high load - Fix a potential bug that MPP queries hang forever - - Fix the issue of concurrency problem between store initialization and `DDL` - - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT` `<` | `<=` | `>` | `>=` `COLUMN` - - Fix the potential panic issue when `Snapshot` is applied simultaneously with with multiple DDL operations + - Fix the issue of concurrency issue between store initialization and DDL + - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT`, `<`, `<=`, `>`, `>=` or `COLUMN` + - Fix the potential panic issue when `Snapshot` is applied simultaneously with multiple DDL operations - Fix the issue that the store size in metrics is inaccurate under heavy writing - Fix the potential issue that TiFlash cannot perform GC for the delta data after running for a long time - - Fix the issue of wrong results when `new collation` is enabled + - Fix the issue of wrong results when new collation is enabled - Fix the potential panic issue that occurs during lock resolving - Fix a bug that metrics display wrong value @@ -137,19 +137,18 @@ TiDB version: 5.1.2 + Dumpling - - Fix the issue that Dumpling is pending when `show table status` returns incorrect results in some MySQL versions (8.0.3, 8.0.23) [#322](https://github.com/pingcap/dumpling/issues/322) + - Fix the issue that Dumpling is pending when `show table status` returns incorrect results in some MySQL versions (8.0.3 and 8.0.23) [#322](https://github.com/pingcap/dumpling/issues/322) + TiCDC - - Fix a bug that json encoding may cause panic when processing a string type value that is `string` or `[]byte`. [#2758](https://github.com/pingcap/ticdc/issues/2758) + - Fix a bug that the JSON encoding might cause panic when processing a string type value that is `string` or `[]byte` [#2758](https://github.com/pingcap/ticdc/issues/2758) - Reduce gRPC window size to avoid OOM [#2202](https://github.com/pingcap/ticdc/issues/2202) - - Fix gRPC keepalive error under high memory pressure. [#2202](https://github.com/pingcap/ticdc/issues/2202) - - Fix a bug that an unsigned tinyint causes TiCDC to panic. [#2648](https://github.com/pingcap/ticdc/issues/2648) - - Fix empty value issue in open protocol. An empty value is no longer output when there is no change in one transaction. [#2612](https://github.com/pingcap/ticdc/issues/2612) + - Fix a gRPC keepalive error under high memory pressure [#2202](https://github.com/pingcap/ticdc/issues/2202) + - Fix a bug that an unsigned `tinyint` causes TiCDC to panic [#2648](https://github.com/pingcap/ticdc/issues/2648) + - Fix an empty value issue in TiCDC Open Protocol. An empty value is no longer output when there is no change in one transaction. [#2612](https://github.com/pingcap/ticdc/issues/2612) - Fix a bug in DDL handling during manual restarts [#2603](https://github.com/pingcap/ticdc/issues/2603) - - Fix the issue that EtcdWorker's snapshot isolation might be wrongly violated when managing the metadata [#2559](https://github.com/pingcap/ticdc/pull/2559) - - Fix the issue that multiple processors could write in the same table when re-scheduling this table [#2230](https://github.com/pingcap/ticdc/issues/2230) - - Fix the issue of the ErrSchemaStorageTableMiss error and that a changefeed is reset by accident. [#2422](https://github.com/pingcap/ticdc/issues/2422) - - Fix the issue that changefeed cannot be removed when the GcTTL Exceeded Error occors [#2391](https://github.com/pingcap/ticdc/issues/2391) - - Fix the issue that replicating large tables to `cdclog` fails [#1259](https://github.com/pingcap/ticdc/issues/1259)[#2424](https://github.com/pingcap/ticdc/issues/2424) - + - Fix the issue that `EtcdWorker`'s snapshot isolation might be wrongly violated when managing the metadata [#2559](https://github.com/pingcap/ticdc/pull/2559) + - Fix the issue that multiple processors might write data in the same table when re-scheduling this table [#2230](https://github.com/pingcap/ticdc/issues/2230) + - Fix the issue of the `ErrSchemaStorageTableMiss` error and the issue that a changefeed is reset by accident [#2422](https://github.com/pingcap/ticdc/issues/2422) + - Fix the issue that a changefeed cannot be removed when the `GcTTL Exceeded` error occurs [#2391](https://github.com/pingcap/ticdc/issues/2391) + - Fix the issue that replicating large tables to `cdclog` fails [#1259](https://github.com/pingcap/ticdc/issues/1259) [#2424](https://github.com/pingcap/ticdc/issues/2424) From 76288311ef1ecfaabdd553b7060517e29a7d5ece Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 12:40:25 +0800 Subject: [PATCH 18/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index c806483359f40..8666de75c845c 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -32,7 +32,6 @@ TiDB version: 5.1.2 + TiDB - Trigger auto-analyze by histogram row count and increase the accuracy of this trigger action [#24237](https://github.com/pingcap/tidb/issues/24237) - - Push down `mod()` to TiFlash to increase the query performance [#2318](https://github.com/pingcap/tics/issues/2318) + TiKV From 7c6b83ee759a3488d64f23c94c693c005c109aa6 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 12:41:35 +0800 Subject: [PATCH 19/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 8666de75c845c..d33eee59a3726 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -18,7 +18,7 @@ TiDB version: 5.1.2 - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - Fix the CLI compatibility issue with 4.0.x clusters on the default `sort-engine` option [#2373](https://github.com/pingcap/ticdc/issues/2373) -## Feature enhancement +## Feature enhancements + Tools From 9805f493910db07b4f2a08c5819c78b4ac8cbfd0 Mon Sep 17 00:00:00 2001 From: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> Date: Mon, 27 Sep 2021 14:49:41 +0800 Subject: [PATCH 20/33] Apply suggestions from code review --- releases/release-5.1.2.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index d33eee59a3726..15b122385edfc 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -147,7 +147,7 @@ TiDB version: 5.1.2 - Fix an empty value issue in TiCDC Open Protocol. An empty value is no longer output when there is no change in one transaction. [#2612](https://github.com/pingcap/ticdc/issues/2612) - Fix a bug in DDL handling during manual restarts [#2603](https://github.com/pingcap/ticdc/issues/2603) - Fix the issue that `EtcdWorker`'s snapshot isolation might be wrongly violated when managing the metadata [#2559](https://github.com/pingcap/ticdc/pull/2559) - - Fix the issue that multiple processors might write data in the same table when re-scheduling this table [#2230](https://github.com/pingcap/ticdc/issues/2230) - - Fix the issue of the `ErrSchemaStorageTableMiss` error and the issue that a changefeed is reset by accident [#2422](https://github.com/pingcap/ticdc/issues/2422) - - Fix the issue that a changefeed cannot be removed when the `GcTTL Exceeded` error occurs [#2391](https://github.com/pingcap/ticdc/issues/2391) - - Fix the issue that replicating large tables to `cdclog` fails [#1259](https://github.com/pingcap/ticdc/issues/1259) [#2424](https://github.com/pingcap/ticdc/issues/2424) + - Fix a bug that multiple processors might write data to the same table when TiCDC is rescheduling the table [#2230](https://github.com/pingcap/ticdc/issues/2230) + - Fix a bug that changefeed might be reset unexpectedly when TiCDC gets the `ErrSchemaStorageTableMiss` error [#2422](https://github.com/pingcap/ticdc/issues/2422) + - Fix a bug that changefeed cannot be removed when TiCDC gets the `ErrGCTTLExceeded` error [#2391](https://github.com/pingcap/ticdc/issues/2391) + - Fix a bug that TiCDC fails to synchronize large tables to cdclog [#1259](https://github.com/pingcap/ticdc/issues/1259) [#2424](https://github.com/pingcap/ticdc/issues/2424) From 495172f9ee0c8b6ace92742c78a0537ef1f2457b Mon Sep 17 00:00:00 2001 From: Liuxiaozhen12 <82579298+Liuxiaozhen12@users.noreply.github.com> Date: Mon, 27 Sep 2021 15:02:38 +0800 Subject: [PATCH 21/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 15b122385edfc..b3f805061da25 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -142,7 +142,7 @@ TiDB version: 5.1.2 - Fix a bug that the JSON encoding might cause panic when processing a string type value that is `string` or `[]byte` [#2758](https://github.com/pingcap/ticdc/issues/2758) - Reduce gRPC window size to avoid OOM [#2202](https://github.com/pingcap/ticdc/issues/2202) - - Fix a gRPC keepalive error under high memory pressure [#2202](https://github.com/pingcap/ticdc/issues/2202) + - Fix a gRPC `keepalive` error under high memory pressure [#2202](https://github.com/pingcap/ticdc/issues/2202) - Fix a bug that an unsigned `tinyint` causes TiCDC to panic [#2648](https://github.com/pingcap/ticdc/issues/2648) - Fix an empty value issue in TiCDC Open Protocol. An empty value is no longer output when there is no change in one transaction. [#2612](https://github.com/pingcap/ticdc/issues/2612) - Fix a bug in DDL handling during manual restarts [#2603](https://github.com/pingcap/ticdc/issues/2603) From 48eb24dd9c3169bf85438280be32777e6303c3c5 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 16:48:03 +0800 Subject: [PATCH 22/33] Update releases/release-5.1.2.md Co-authored-by: Enwei --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index b3f805061da25..4cf97b2a062fe 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -48,7 +48,7 @@ TiDB version: 5.1.2 + TiFlash - Support the `DATE()` function - - Add write throughput per instance to Grafana panels + - Add Grafana panels for write throughput per instance - Optimize the performance of the `leader-read` process - Accelerate the process of canceling MPP tasks From 67e91d4312e2f327d501da33f970a60bedf2a08e Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 17:41:42 +0800 Subject: [PATCH 23/33] Update releases/release-5.1.2.md Co-authored-by: Grace Cai --- releases/release-5.1.2.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 4cf97b2a062fe..203fef0fc1916 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -10,6 +10,18 @@ TiDB version: 5.1.2 ## Compatibility changes ++ TiDB + + + The following bug fixes change execution results, which might cause upgrade incompatibilities: + - Fix the issue that `greatest(datetime) union null` returns empty string [#26532](https://github.com/pingcap/tidb/issues/26532) + - Fix the issue that the `having` clause might not work correctly [#26496](https://github.com/pingcap/tidb/issues/26496) + - Fix the wrong execution results that occur when the collations around the `between` expression are different [#27146](https://github.com/pingcap/tidb/issues/27146) + - Fix the wrong execution results that occur when the column in the `group_concat` function has a non-bin collation [#27429](https://github.com/pingcap/tidb/issues/27429) + - Fix an issue that using a `count(distinct)` expression on multiple columns returns wrong result when the new collation is enabled [#27091](https://github.com/pingcap/tidb/issues/27091) + - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) + - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#26762](https://github.com/pingcap/tidb/issues/26762) + - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766] + + Tools + TiCDC From a72c1ac89ef9c7b83451c924bf9a0728ad57893f Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 27 Sep 2021 17:42:50 +0800 Subject: [PATCH 24/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 203fef0fc1916..b730845e65dbe 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -13,6 +13,7 @@ TiDB version: 5.1.2 + TiDB + The following bug fixes change execution results, which might cause upgrade incompatibilities: + - Fix the issue that `greatest(datetime) union null` returns empty string [#26532](https://github.com/pingcap/tidb/issues/26532) - Fix the issue that the `having` clause might not work correctly [#26496](https://github.com/pingcap/tidb/issues/26496) - Fix the wrong execution results that occur when the collations around the `between` expression are different [#27146](https://github.com/pingcap/tidb/issues/27146) From ee9c059863d13782c6c53ee7d2c4ffe374c60693 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 27 Sep 2021 17:47:21 +0800 Subject: [PATCH 25/33] Apply suggestions from code review --- releases/release-5.1.2.md | 8 -------- 1 file changed, 8 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index b730845e65dbe..db6339f6db080 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -82,24 +82,16 @@ TiDB version: 5.1.2 - Fix the compatibility issue of the overflow check by keeping the same logic as MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) - Fix the issue that TiDB returns an `unknow` error while it should return the `pd is timeout` error [#26147](https://github.com/pingcap/tidb/issues/26147) - Fix the error of the `case when` function caused by the wrong charset and collation [#26662](https://github.com/pingcap/tidb/issues/26662) - - Fix the issue that `greatest(datetime) union null` returns an empty string [#26532](https://github.com/pingcap/tidb/issues/26532) - Fix the potential `can not found column in Schema column` error for MPP queries [#28148](https://github.com/pingcap/tidb/pull/28148) - Fix a bug that TiDB might panic when TiFlash is shutting down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the issue of wrong range caused by using `enum like 'x%'` [#27130](https://github.com/pingcap/tidb/issues/27130) - - Fix the issue that the `between` expression infers wrong collation [#27146](https://github.com/pingcap/tidb/issues/27146) - Fix the Common Table Expression (CTE) dead lock issue when used with IndexLookupJoin [#27410](https://github.com/pingcap/tidb/issues/27410) - Fix a bug that retryable deadlocks are incorrectly recorded into the `INFORMATION_SCHEMA.DEADLOCKS` table [#27400](https://github.com/pingcap/tidb/issues/27400) - - Fix a bug that the `GROUP_CONCAT` function does not consider the collation [#27429](https://github.com/pingcap/tidb/issues/27429) - - Fix a bug that the `COUNT(DISTINCT)` function on multiple columns returns wrong results when the new collation is enabled [#27091](https://github.com/pingcap/tidb/issues/27091) - Fix the issue that the `TABLESAMPLE` query result from partitioned tables is not sorted as expected [#27349](https://github.com/pingcap/tidb/issues/27349) - - Fix a bug that the `EXTRACT` function returns wrong results when the argument is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) - Remove the unused `/debug/sub-optimal-plan` HTTP API [#27265](https://github.com/pingcap/tidb/pull/27265) - - Fix the issue that a wrong selection is pushed down when the `HAVING` condition is used in the aggregate function [#26496](https://github.com/pingcap/tidb/issues/26496) - Fix a bug that the query might return wrong results when the hash partitioned table deals with unsigned data [#26569](https://github.com/pingcap/tidb/issues/26569) - - Fix the unexpected behavior when casting an invalid string to `DATE` [#26762](https://github.com/pingcap/tidb/issues/26762) - Fix a bug that creating partition fails if `NO_UNSIGNED_SUBTRACTION` is set [#26765](https://github.com/pingcap/tidb/issues/26765) - Fix the issue that the `distinct` flag is missing when `Apply` is converted to `Join` [#26958](https://github.com/pingcap/tidb/issues/26958) - - Fix the issue that `NO_ZERO_IN_DATE` does not work on the default values [#26766](https://github.com/pingcap/tidb/issues/26766) - Set a block duration for the newly recovered TiFlash node to avoid blocking queries during this time [#26897](https://github.com/pingcap/tidb/pull/26897) - Fix a bug that might occur when the CTE is referenced more than once [#26212](https://github.com/pingcap/tidb/issues/26212) - Fix a CTE bug when MergeJoin is used [#25474](https://github.com/pingcap/tidb/issues/25474) From 39bc08ffce068af3446b2060ed627ea06245f0e2 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 27 Sep 2021 17:55:38 +0800 Subject: [PATCH 26/33] Apply suggestions from code review --- releases/release-5.1.2.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index db6339f6db080..280fd13a45efa 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -21,7 +21,7 @@ TiDB version: 5.1.2 - Fix an issue that using a `count(distinct)` expression on multiple columns returns wrong result when the new collation is enabled [#27091](https://github.com/pingcap/tidb/issues/27091) - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#26762](https://github.com/pingcap/tidb/issues/26762) - - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766] + - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766] (https://github.com/pingcap/tidb/issues/26766) + Tools @@ -79,9 +79,9 @@ TiDB version: 5.1.2 - Fix the potential wrong results of index hash join when the hash column is the `ENUM` type [#27893](https://github.com/pingcap/tidb/issues/27893) - Fix a batch client bug that recycle idle connection might block sending requests in some rare cases [#27678](https://github.com/pingcap/tidb/pull/27678) - - Fix the compatibility issue of the overflow check by keeping the same logic as MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) + - Fix the issue that the overflow check of the `FLOAT64` type is different with that of MySQL [#23897](https://github.com/pingcap/tidb/issues/23897) - Fix the issue that TiDB returns an `unknow` error while it should return the `pd is timeout` error [#26147](https://github.com/pingcap/tidb/issues/26147) - - Fix the error of the `case when` function caused by the wrong charset and collation [#26662](https://github.com/pingcap/tidb/issues/26662) + - Fix the wrong character set and collation for the `case when` expression [#26662](https://github.com/pingcap/tidb/issues/26662) - Fix the potential `can not found column in Schema column` error for MPP queries [#28148](https://github.com/pingcap/tidb/pull/28148) - Fix a bug that TiDB might panic when TiFlash is shutting down [#28096](https://github.com/pingcap/tidb/issues/28096) - Fix the issue of wrong range caused by using `enum like 'x%'` [#27130](https://github.com/pingcap/tidb/issues/27130) From 2cb972e17688955a06046889a23235e321470707 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 27 Sep 2021 17:57:31 +0800 Subject: [PATCH 27/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 280fd13a45efa..0d2900b6644ce 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -21,7 +21,7 @@ TiDB version: 5.1.2 - Fix an issue that using a `count(distinct)` expression on multiple columns returns wrong result when the new collation is enabled [#27091](https://github.com/pingcap/tidb/issues/27091) - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#26762](https://github.com/pingcap/tidb/issues/26762) - - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766] (https://github.com/pingcap/tidb/issues/26766) + - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766](https://github.com/pingcap/tidb/issues/26766) + Tools From 350bf7f083161103af77a8c4f8d4e67da2f741ab Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Mon, 27 Sep 2021 18:36:59 +0800 Subject: [PATCH 28/33] Update releases/release-5.1.2.md Co-authored-by: Enwei --- releases/release-5.1.2.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 0d2900b6644ce..39fcab331123d 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -124,14 +124,14 @@ TiDB version: 5.1.2 - Fix the potential issue of data inconsistency that occurs when TiFlash is deployed on multiple disks - Fix a bug that MPP queries get wrong results when TiFlash server is under high load - Fix a potential bug that MPP queries hang forever - - Fix the issue of concurrency issue between store initialization and DDL - - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT`, `<`, `<=`, `>`, `>=` or `COLUMN` + - Fix the panic issue when operating store initialization and DDL simultaneously + - Fix a bug of incorrect results that occurs when queries contain filters like `CONSTANT`, `<`, `<=`, `>`, `>=`, or `COLUMN` - Fix the potential panic issue when `Snapshot` is applied simultaneously with multiple DDL operations - Fix the issue that the store size in metrics is inaccurate under heavy writing - - Fix the potential issue that TiFlash cannot perform GC for the delta data after running for a long time - - Fix the issue of wrong results when new collation is enabled - - Fix the potential panic issue that occurs during lock resolving - - Fix a bug that metrics display wrong value + - Fix the potential issue that TiFlash cannot garbage-collect the delta data after running for a long time + - Fix the issue of wrong results when the new collation is enabled + - Fix the potential panic issue that occurs when resolving locks + - Fix a potential bug that metrics display wrong values + Tools From 6c7e4f41818e360549aa810cca85d76f7c8e5fea Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 19:26:57 +0800 Subject: [PATCH 29/33] Update releases/release-5.1.2.md Co-authored-by: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> --- releases/release-5.1.2.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 39fcab331123d..c17a78378298f 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -101,14 +101,14 @@ TiDB version: 5.1.2 + TiKV - - Fix a bug that some files are missed during the process of importing snapshot files when upgrading TiKV from v3.x to later versions [#10902](https://github.com/tikv/tikv/issues/10902) + - Fix a panic issue that occurs after TiKV is upgraded from v3.x to later versions [#10902](https://github.com/tikv/tikv/issues/10902) - Fix the potential disk full issue caused by corrupted snapshot files [#10813](https://github.com/tikv/tikv/issues/10813) - Make the slow log of TiKV coprocessor only consider the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) - Fix a panic issue that occurs when processing Coprocessor requests times out [#10852](https://github.com/tikv/tikv/issues/10852) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10842](https://github.com/tikv/tikv/pull/10842) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - - Fix the issue that TiKV might delete files before it ingests data to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) + - Fix the issue that TiKV might delete files before ingesting data to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) - Fix the parsing failure caused by the left pessimistic locks [#26404](https://github.com/pingcap/tidb/issues/26404) + PD From e47aab78b4ba4f780d8d5198e83a1631f6f46920 Mon Sep 17 00:00:00 2001 From: Enwei Date: Mon, 27 Sep 2021 13:28:31 +0200 Subject: [PATCH 30/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index c17a78378298f..763c3d27693e5 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -105,7 +105,7 @@ TiDB version: 5.1.2 - Fix the potential disk full issue caused by corrupted snapshot files [#10813](https://github.com/tikv/tikv/issues/10813) - Make the slow log of TiKV coprocessor only consider the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) - - Fix a panic issue that occurs when processing Coprocessor requests times out [#10852](https://github.com/tikv/tikv/issues/10852) + - Fix a panic issue that occurs when TiKV processes Coprocessor requests times out [#10852](https://github.com/tikv/tikv/issues/10852) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10842](https://github.com/tikv/tikv/pull/10842) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - Fix the issue that TiKV might delete files before ingesting data to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) From d3279c5234cb70e8d78cf290fccf026f81566c70 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 19:29:01 +0800 Subject: [PATCH 31/33] Update releases/release-5.1.2.md --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 763c3d27693e5..87272be9ce5ba 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -73,7 +73,7 @@ TiDB version: 5.1.2 - Optimize workerpool for fewer goroutines when concurrency is high [#2211](https://github.com/pingcap/ticdc/issues/2211) - Reduce goroutine usage when a table's Region transfer away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) -## Bug Fixes +## Bug fixes + TiDB From 8fc30baf1b15e41e5ce546f4ec8afce851391991 Mon Sep 17 00:00:00 2001 From: Enwei Date: Mon, 27 Sep 2021 13:39:21 +0200 Subject: [PATCH 32/33] Apply suggestions from code review --- releases/release-5.1.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 87272be9ce5ba..70e9bcc3872b7 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -105,7 +105,7 @@ TiDB version: 5.1.2 - Fix the potential disk full issue caused by corrupted snapshot files [#10813](https://github.com/tikv/tikv/issues/10813) - Make the slow log of TiKV coprocessor only consider the time spent on processing requests [#10841](https://github.com/tikv/tikv/issues/10841) - Drop log instead of blocking threads when the slogger thread is overloaded and the queue is filled up [#10841](https://github.com/tikv/tikv/issues/10841) - - Fix a panic issue that occurs when TiKV processes Coprocessor requests times out [#10852](https://github.com/tikv/tikv/issues/10852) + - Fix a panic issue that occurs when processing Coprocessor requests times out [#10852](https://github.com/tikv/tikv/issues/10852) - Fix the TiKV panic issue that occurs when upgrading from a pre-5.0 version with Titan enabled [#10842](https://github.com/tikv/tikv/pull/10842) - Fix the issue that TiKV of a newer version cannot be rolled back to v5.0.x [#10842](https://github.com/tikv/tikv/pull/10842) - Fix the issue that TiKV might delete files before ingesting data to RocksDB [#10438](https://github.com/tikv/tikv/issues/10438) From 83b8e43619bfc6d8c7b3c3d8059b32027a5de720 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 27 Sep 2021 19:39:38 +0800 Subject: [PATCH 33/33] move notes --- releases/release-5.1.2.md | 22 +++++++++------------- 1 file changed, 9 insertions(+), 13 deletions(-) diff --git a/releases/release-5.1.2.md b/releases/release-5.1.2.md index 87272be9ce5ba..115fb9f78e850 100644 --- a/releases/release-5.1.2.md +++ b/releases/release-5.1.2.md @@ -13,7 +13,7 @@ TiDB version: 5.1.2 + TiDB + The following bug fixes change execution results, which might cause upgrade incompatibilities: - + - Fix the issue that `greatest(datetime) union null` returns empty string [#26532](https://github.com/pingcap/tidb/issues/26532) - Fix the issue that the `having` clause might not work correctly [#26496](https://github.com/pingcap/tidb/issues/26496) - Fix the wrong execution results that occur when the collations around the `between` expression are different [#27146](https://github.com/pingcap/tidb/issues/27146) @@ -22,23 +22,12 @@ TiDB version: 5.1.2 - Fix the result wrong that occurs when the argument of the `extract` function is a negative duration [#27236](https://github.com/pingcap/tidb/issues/27236) - Fix the issue that inserting an invalid date does not report an error when the `SQL_MODE` is 'STRICT_TRANS_TABLES' [#26762](https://github.com/pingcap/tidb/issues/26762) - Fix the issue that using an invalid default date does not report an error when the `SQL_MODE` is 'NO_ZERO_IN_DATE' [#26766](https://github.com/pingcap/tidb/issues/26766) - + + Tools + TiCDC - Set the compatible version from `5.1.0-alpha` to `5.2.0-alpha` [#2659](https://github.com/pingcap/ticdc/pull/2659) - - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) - - Fix the CLI compatibility issue with 4.0.x clusters on the default `sort-engine` option [#2373](https://github.com/pingcap/ticdc/issues/2373) - -## Feature enhancements - -+ Tools - - + Dumpling - - - Support backing up MySQL-compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#309](https://github.com/pingcap/dumpling/issues/309) - - Add a global gRPC connection pool and share gRPC connections among KV clients [#2534](https://github.com/pingcap/ticdc/pull/2534) ## Improvements @@ -73,6 +62,12 @@ TiDB version: 5.1.2 - Optimize workerpool for fewer goroutines when concurrency is high [#2211](https://github.com/pingcap/ticdc/issues/2211) - Reduce goroutine usage when a table's Region transfer away from a TiKV node [#2284](https://github.com/pingcap/ticdc/issues/2284) + + Dumpling + + - Support backing up MySQL-compatible databases that do not support `START TRANSACTION ... WITH CONSISTENT SNAPSHOT` and `SHOW CREATE TABLE` [#309](https://github.com/pingcap/dumpling/issues/309) + - Add a global gRPC connection pool and share gRPC connections among KV clients [#2534](https://github.com/pingcap/ticdc/pull/2534) + - Prohibit operating TiCDC clusters across major and minor versions [#2599](https://github.com/pingcap/ticdc/pull/2599) + ## Bug fixes + TiDB @@ -142,6 +137,7 @@ TiDB version: 5.1.2 + Dumpling - Fix the issue that Dumpling is pending when `show table status` returns incorrect results in some MySQL versions (8.0.3 and 8.0.23) [#322](https://github.com/pingcap/dumpling/issues/322) + - Fix the CLI compatibility issue with 4.0.x clusters on the default `sort-engine` option [#2373](https://github.com/pingcap/ticdc/issues/2373) + TiCDC