From 60015d726199c129b022149b7d0ff0d0104071d7 Mon Sep 17 00:00:00 2001 From: ti-srebot <66930949+ti-srebot@users.noreply.github.com> Date: Fri, 29 Apr 2022 18:07:07 +0800 Subject: [PATCH 01/45] releases: add TiDB 5.4.1-18-07-05 release notes * releases: add TiDB 5.4.1-18-07-05 release notes * Update releases/release-5.4.1-18-07-05.md --- releases/release-5.4.1-18-07-05.md | 187 +++++++++++++++++++++++++++++ 1 file changed, 187 insertions(+) create mode 100644 releases/release-5.4.1-18-07-05.md diff --git a/releases/release-5.4.1-18-07-05.md b/releases/release-5.4.1-18-07-05.md new file mode 100644 index 000000000000..27668c55d2bd --- /dev/null +++ b/releases/release-5.4.1-18-07-05.md @@ -0,0 +1,187 @@ +--- +title: TiDB 5.4.1 Release Notes +category: Releases +--- + + + +# TiDB 5.4.1 Release Notes + +Release Date: April 29, 2022 + +TiDB version: 5.4.1 + +## __unsorted + ++ PingCAP/TiDB + + - ```release-note [#34335](https://github.com/pingcap/tidb/pull/34335) + - ```release-note [#34317](https://github.com/pingcap/tidb/pull/34317) + - ```release-note [#34302](https://github.com/pingcap/tidb/pull/34302) + - ```release-note [#34271](https://github.com/pingcap/tidb/pull/34271) + - ```release-note [#34268](https://github.com/pingcap/tidb/pull/34268) + - lightning: split and scatter regions in batches [#34258](https://github.com/pingcap/tidb/pull/34258) + - ```release-note [#34253](https://github.com/pingcap/tidb/pull/34253) + - ```release-note [#34245](https://github.com/pingcap/tidb/pull/34245) + - ```release-note [#34226](https://github.com/pingcap/tidb/pull/34226) + - ```release-note [#34189](https://github.com/pingcap/tidb/pull/34189) + - ```release-note [#34139](https://github.com/pingcap/tidb/pull/34139) + - Fix the problem of high use of reArrangeFallback cpu. [#34063](https://github.com/pingcap/tidb/pull/34063) + - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#34025](https://github.com/pingcap/tidb/pull/34025) + - ```release-note [#34019](https://github.com/pingcap/tidb/pull/34019) + - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33988](https://github.com/pingcap/tidb/pull/33988) + - ```release-note [#33961](https://github.com/pingcap/tidb/pull/33961) + - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33816](https://github.com/pingcap/tidb/pull/33816) + - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33605](https://github.com/pingcap/tidb/pull/33605) + - fix bug #33509 [#33577](https://github.com/pingcap/tidb/pull/33577) + - fix a bug that compress function may report error [#33557](https://github.com/pingcap/tidb/pull/33557) + - Fix the issue that NewCollationEnable config not checked during restoration. [#33532](https://github.com/pingcap/tidb/pull/33532) + - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query. [#33517](https://github.com/pingcap/tidb/pull/33517) + - Fix the issue that BR not retry enough when region not consistency during restoration. [#33470](https://github.com/pingcap/tidb/pull/33470) + - Add retry to avoid precheck failure when query execution timeout [#33148](https://github.com/pingcap/tidb/pull/33148) + - executor: fix wrong result of delete multiple tables using left join [#33123](https://github.com/pingcap/tidb/pull/33123) + - Support multi k8s in grafana dashboards [#32953](https://github.com/pingcap/tidb/pull/32953) + - planner: Fix the issue that TiDB may dispatch duplicated tasks to TiFlash [#32841](https://github.com/pingcap/tidb/pull/32841) + - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32812](https://github.com/pingcap/tidb/pull/32812) + - lightning: fix checksum encountered “GC life time is shorter than transaction duration” error [#32799](https://github.com/pingcap/tidb/pull/32799) + - Fix BR failure on backup rawkv. [#32793](https://github.com/pingcap/tidb/pull/32793) + - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#32704](https://github.com/pingcap/tidb/pull/32704) + - Fix the problem of tidb oom when exporting data using chunk rpc [#32578](https://github.com/pingcap/tidb/pull/32578) + - fix date formate identifies '\n' as invalid separator [#32504](https://github.com/pingcap/tidb/pull/32504) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32390](https://github.com/pingcap/tidb/pull/32390) + - Fix a bug that caused region unbalanced after restoring. [#32129](https://github.com/pingcap/tidb/pull/32129) + - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31842](https://github.com/pingcap/tidb/pull/31842) + - fix greatest and least function with collation get wrong result [#31838](https://github.com/pingcap/tidb/pull/31838) + - fix load data will panic in some case [#31774](https://github.com/pingcap/tidb/pull/31774) + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31351](https://github.com/pingcap/tidb/pull/31351) + + ++ TiKV/TiKV + + - Fixes that successfully committed optimistic transactions may report false WriteConflict on network errors. [#12378](https://github.com/tikv/tikv/pull/12378) + - Fix panicking when replica read is enabled and there is a long time network condition [#12310](https://github.com/tikv/tikv/pull/12310) + - fix tikv panic and peer unexpected destroy due to fake merge target [#12295](https://github.com/tikv/tikv/pull/12295) + - Fix stale message cause panic [#12285](https://github.com/tikv/tikv/pull/12285) + - Solve the problem of raft msg memory metrics overflow, which will cause intermittent packet loss and oom. [#12227](https://github.com/tikv/tikv/pull/12227) + - Fix crash when profiling in Ubuntu 18.04. [#12208](https://github.com/tikv/tikv/pull/12208) + - metrics: support multi k8s in grafana dashboards. [#12138](https://github.com/tikv/tikv/pull/12138) + - Fix potential linearizability violation in replica reads. [#12121](https://github.com/tikv/tikv/pull/12121) + - fix panic when target peer is replaced with an destroyed uninitialized peer during merge [#12086](https://github.com/tikv/tikv/pull/12086) + - Fixes the bug that TiKV keep running over 2 years may panic. [#12042](https://github.com/tikv/tikv/pull/12042) + - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12001](https://github.com/tikv/tikv/pull/12001) + - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11905](https://github.com/tikv/tikv/pull/11905) + - fix potential high latency caused by destroying a peer [#11881](https://github.com/tikv/tikv/pull/11881) + + ++ PingCAP/TiFlash + + - fix potential data corruption for large indices [#4790](https://github.com/pingcap/tiflash/pull/4790) + - Fix the problem of TiFlash crashing when the memory limit is enabled [#4776](https://github.com/pingcap/tiflash/pull/4776) + - Fix potential query error when select on a table with many delete operations [#4760](https://github.com/pingcap/tiflash/pull/4760) + - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4729](https://github.com/pingcap/tiflash/pull/4729) + - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4717](https://github.com/pingcap/tiflash/pull/4717) + - Fix a bug that MPP tasks may leak threads forever [#4642](https://github.com/pingcap/tiflash/pull/4642) + - Fix the problem that empty segments cannot be merged after gc [#4522](https://github.com/pingcap/tiflash/pull/4522) + - Fix wrong result of cast(float as decimal) when overflow happens [#4388](https://github.com/pingcap/tiflash/pull/4388) + - fix the problem that expired data was not recycled timely due to slow gc speed [#4255](https://github.com/pingcap/tiflash/pull/4255) + - Fix the bug that canceled MPP query may cause tasks hang forever when local tunnel is enabled. [#4237](https://github.com/pingcap/tiflash/pull/4237) + - Fix bug that enable elastic thread pool may introduce memory leak. [#4231](https://github.com/pingcap/tiflash/pull/4231) + - Fix memory leak when a query is cancelled. [#4230](https://github.com/pingcap/tiflash/pull/4230) + - metrics: support multi-k8s in grafana dashboards [#4213](https://github.com/pingcap/tiflash/pull/4213) + - metrics: support multi-k8s in grafana dashboards [#4206](https://github.com/pingcap/tiflash/pull/4206) + - Fix cast datetime to decimal wrong result bug [#4160](https://github.com/pingcap/tiflash/pull/4160) + - Avoid the potential of crash when apply snapshot under heavy ddl scenario [#4143](https://github.com/pingcap/tiflash/pull/4143) + - Fix the bug that invalid storage dir configurations lead to unexpected behavior [#4135](https://github.com/pingcap/tiflash/pull/4135) + - Fix the bug that some exceptions are not handled properly [#4115](https://github.com/pingcap/tiflash/pull/4115) + - Fix cast to decimal overflow bug [#4082](https://github.com/pingcap/tiflash/pull/4082) + - fix error result for function `in` [#4078](https://github.com/pingcap/tiflash/pull/4078) + - fix date format identifies '\n' as invalid separator [#4060](https://github.com/pingcap/tiflash/pull/4060) + - Fix potential query error after add column under heavy read workload [#4028](https://github.com/pingcap/tiflash/pull/4028) + - Fix the problem of TiFlash crashing when the memory limit is enabled [#3919](https://github.com/pingcap/tiflash/pull/3919) + + ++ PD + + - None. [#4849](https://github.com/tikv/pd/pull/4849) + - Fix the issue that the label distribution has residual labels [#4826](https://github.com/tikv/pd/pull/4826) + - metrics: support multi-k8s in grafana dashboards [#4717](https://github.com/tikv/pd/pull/4717) + - None. [#4664](https://github.com/tikv/pd/pull/4664) + + ++ Tools + + + PingCAP/TiCDC + + - save table checkpoint after a DDL is filtered [#5290](https://github.com/pingcap/tiflow/pull/5290) + - Fix TiCDC incorrectly display stale metrics data on dashboard. [#5260](https://github.com/pingcap/tiflow/pull/5260) + - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5241](https://github.com/pingcap/tiflow/pull/5241) + - `None`. [#5227](https://github.com/pingcap/tiflow/pull/5227) + - Fix a bug that checkpoint flushing will be called too frequently [#5201](https://github.com/pingcap/tiflow/pull/5201) + - fix tracker panic when pk of downstream table orders behind [#5167](https://github.com/pingcap/tiflow/pull/5167) + - `None`. [#5137](https://github.com/pingcap/tiflow/pull/5137) + - send one heartbeat for successive skipped GTID when enable relay log [#5093](https://github.com/pingcap/tiflow/pull/5093) + - fix DML construct error issue caused by `rename tables` DDL. [#5079](https://github.com/pingcap/tiflow/pull/5079) + - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default). [#5000](https://github.com/pingcap/tiflow/pull/5000) + - `None`. [#4869](https://github.com/pingcap/tiflow/pull/4869) + - Syncer will use working directory of DM-worker rather than /tmp to write internal files, and clean it after task is stopped [#4805](https://github.com/pingcap/tiflow/pull/4805) + - Fix that there're lot of log of "checkpoint has no change, skip sync flush checkpoint" and performance may drop [#4801](https://github.com/pingcap/tiflow/pull/4801) + - Fix stale metrics caused by owner changes. [#4800](https://github.com/pingcap/tiflow/pull/4800) + - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4789](https://github.com/pingcap/tiflow/pull/4789) + - fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4779](https://github.com/pingcap/tiflow/pull/4779) + - fix `Canal-JSON` meet `unsigned` SQL Type and nullable, which cause CDC server panic. [#4745](https://github.com/pingcap/tiflow/pull/4745) + - Fix checkpoint metrics when tables are being scheduled. [#4729](https://github.com/pingcap/tiflow/pull/4729) + - metrics: support multi-k8s in grafana dashboards [#4709](https://github.com/pingcap/tiflow/pull/4709) + - Fix stability problem in workerpool, which is used by Unified Sorter. [#4683](https://github.com/pingcap/tiflow/pull/4683) + - Fix a bug that sequence should not be replicated even if force-replication is true. [#4667](https://github.com/pingcap/tiflow/pull/4667) + - fix `Canal-JSON` meet `unsigned` SQL typed in `string`, which cause CDC server panic. [#4657](https://github.com/pingcap/tiflow/pull/4657) + - `None`. [#4649](https://github.com/pingcap/tiflow/pull/4649) + - Please add a release note. +`None`. [#4648](https://github.com/pingcap/tiflow/pull/4648) + - Fix a bug that long varchar will report error of "Column length too big..." [#4646](https://github.com/pingcap/tiflow/pull/4646) + - `None`. [#4615](https://github.com/pingcap/tiflow/pull/4615) + - `None`. [#4595](https://github.com/pingcap/tiflow/pull/4595) + - `None`. [#4575](https://github.com/pingcap/tiflow/pull/4575) + - Fix a bug that owner exits abnormally when PD leader is killed [#4533](https://github.com/pingcap/tiflow/pull/4533) + - allow user set the configuration of Kafka producer dial/write/read timeout [#4521](https://github.com/pingcap/tiflow/pull/4521) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#4513](https://github.com/pingcap/tiflow/pull/4513) + - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4509](https://github.com/pingcap/tiflow/pull/4509) + - `None`. [#4466](https://github.com/pingcap/tiflow/pull/4466) + - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4438](https://github.com/pingcap/tiflow/pull/4438) + - None. [#4431](https://github.com/pingcap/tiflow/pull/4431) + + +## Improvements + ++ PingCAP/TiDB + + - ```release-note [#34067](https://github.com/pingcap/tidb/pull/34067) + + ++ Tools + + + PingCAP/TiCDC + + - `None`. [#4828](https://github.com/pingcap/tiflow/pull/4828) + + +## Bug Fixes + ++ PingCAP/TiDB + + - executor: fix CTE is block when query report error [#33190](https://github.com/pingcap/tidb/pull/33190) + - planner: fix wrong range calculation for Nulleq function on Enum values [#32496](https://github.com/pingcap/tidb/pull/32496) + + ++ PingCAP/TiFlash + + - Fix the potential crash issue that occurs when TLS is enabled [#4689](https://github.com/pingcap/tiflash/pull/4689) + - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#4496](https://github.com/pingcap/tiflash/pull/4496) + - Fix the issue that a query containing `JOIN` could be hung if an error was encountered [#4270](https://github.com/pingcap/tiflash/pull/4270) + + ++ PD + + - Fix the issue that duration fields of dr-autosync cannot be set [#4660](https://github.com/tikv/pd/pull/4660) + + From 33c5fb7d51af6685371255a830dbd82b2530f46f Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 18:44:04 +0800 Subject: [PATCH 02/45] rename file --- ...ase-5.4.1-18-07-05.md => release-5.4.1.md} | 76 +++++++++---------- 1 file changed, 34 insertions(+), 42 deletions(-) rename releases/{release-5.4.1-18-07-05.md => release-5.4.1.md} (98%) diff --git a/releases/release-5.4.1-18-07-05.md b/releases/release-5.4.1.md similarity index 98% rename from releases/release-5.4.1-18-07-05.md rename to releases/release-5.4.1.md index 27668c55d2bd..522a50d4ba37 100644 --- a/releases/release-5.4.1-18-07-05.md +++ b/releases/release-5.4.1.md @@ -7,10 +7,42 @@ category: Releases # TiDB 5.4.1 Release Notes -Release Date: April 29, 2022 +Release Date: May xx, 2022 TiDB version: 5.4.1 +## Improvements + ++ PingCAP/TiDB + + - ```release-note [#34067](https://github.com/pingcap/tidb/pull/34067) + + ++ Tools + + + PingCAP/TiCDC + + - `None`. [#4828](https://github.com/pingcap/tiflow/pull/4828) + +## Bug Fixes + ++ PingCAP/TiDB + + - executor: fix CTE is block when query report error [#33190](https://github.com/pingcap/tidb/pull/33190) + - planner: fix wrong range calculation for Nulleq function on Enum values [#32496](https://github.com/pingcap/tidb/pull/32496) + + ++ PingCAP/TiFlash + + - Fix the potential crash issue that occurs when TLS is enabled [#4689](https://github.com/pingcap/tiflash/pull/4689) + - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#4496](https://github.com/pingcap/tiflash/pull/4496) + - Fix the issue that a query containing `JOIN` could be hung if an error was encountered [#4270](https://github.com/pingcap/tiflash/pull/4270) + + ++ PD + + - Fix the issue that duration fields of dr-autosync cannot be set [#4660](https://github.com/tikv/pd/pull/4660) + ## __unsorted + PingCAP/TiDB @@ -55,7 +87,6 @@ TiDB version: 5.4.1 - fix load data will panic in some case [#31774](https://github.com/pingcap/tidb/pull/31774) - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31351](https://github.com/pingcap/tidb/pull/31351) - + TiKV/TiKV - Fixes that successfully committed optimistic transactions may report false WriteConflict on network errors. [#12378](https://github.com/tikv/tikv/pull/12378) @@ -72,7 +103,6 @@ TiDB version: 5.4.1 - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11905](https://github.com/tikv/tikv/pull/11905) - fix potential high latency caused by destroying a peer [#11881](https://github.com/tikv/tikv/pull/11881) - + PingCAP/TiFlash - fix potential data corruption for large indices [#4790](https://github.com/pingcap/tiflash/pull/4790) @@ -99,7 +129,6 @@ TiDB version: 5.4.1 - Fix potential query error after add column under heavy read workload [#4028](https://github.com/pingcap/tiflash/pull/4028) - Fix the problem of TiFlash crashing when the memory limit is enabled [#3919](https://github.com/pingcap/tiflash/pull/3919) - + PD - None. [#4849](https://github.com/tikv/pd/pull/4849) @@ -107,7 +136,6 @@ TiDB version: 5.4.1 - metrics: support multi-k8s in grafana dashboards [#4717](https://github.com/tikv/pd/pull/4717) - None. [#4664](https://github.com/tikv/pd/pull/4664) - + Tools + PingCAP/TiCDC @@ -148,40 +176,4 @@ If you don't think this PR needs a release note then fill it with `None`. [#4513 - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4509](https://github.com/pingcap/tiflow/pull/4509) - `None`. [#4466](https://github.com/pingcap/tiflow/pull/4466) - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4438](https://github.com/pingcap/tiflow/pull/4438) - - None. [#4431](https://github.com/pingcap/tiflow/pull/4431) - - -## Improvements - -+ PingCAP/TiDB - - - ```release-note [#34067](https://github.com/pingcap/tidb/pull/34067) - - -+ Tools - - + PingCAP/TiCDC - - - `None`. [#4828](https://github.com/pingcap/tiflow/pull/4828) - - -## Bug Fixes - -+ PingCAP/TiDB - - - executor: fix CTE is block when query report error [#33190](https://github.com/pingcap/tidb/pull/33190) - - planner: fix wrong range calculation for Nulleq function on Enum values [#32496](https://github.com/pingcap/tidb/pull/32496) - - -+ PingCAP/TiFlash - - - Fix the potential crash issue that occurs when TLS is enabled [#4689](https://github.com/pingcap/tiflash/pull/4689) - - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#4496](https://github.com/pingcap/tiflash/pull/4496) - - Fix the issue that a query containing `JOIN` could be hung if an error was encountered [#4270](https://github.com/pingcap/tiflash/pull/4270) - - -+ PD - - - Fix the issue that duration fields of dr-autosync cannot be set [#4660](https://github.com/tikv/pd/pull/4660) - - + - None. [#4431](https://github.com/pingcap/tiflow/pull/4431) \ No newline at end of file From 53d31b8f14205961a2a40a01520b7206c1ed322b Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 18:51:14 +0800 Subject: [PATCH 03/45] replace pr with issue --- TOC.md | 1 + releases/release-5.4.1.md | 358 +++++++++++++++++------------------ releases/release-notes.md | 1 + releases/release-timeline.md | 1 + 4 files changed, 182 insertions(+), 179 deletions(-) diff --git a/TOC.md b/TOC.md index af5b1fa58997..af75e47130f9 100644 --- a/TOC.md +++ b/TOC.md @@ -769,6 +769,7 @@ - v6.0 - [6.0.0-DMR](/releases/release-6.0.0-dmr.md) - v5.4 + - [5.4.1](/releases/release-5.4.1.md) - [5.4.0](/releases/release-5.4.0.md) - v5.3 - [5.3.1](/releases/release-5.3.1.md) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 522a50d4ba37..6df7fc0fe5f3 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -1,179 +1,179 @@ ---- -title: TiDB 5.4.1 Release Notes -category: Releases ---- - - - -# TiDB 5.4.1 Release Notes - -Release Date: May xx, 2022 - -TiDB version: 5.4.1 - -## Improvements - -+ PingCAP/TiDB - - - ```release-note [#34067](https://github.com/pingcap/tidb/pull/34067) - - -+ Tools - - + PingCAP/TiCDC - - - `None`. [#4828](https://github.com/pingcap/tiflow/pull/4828) - -## Bug Fixes - -+ PingCAP/TiDB - - - executor: fix CTE is block when query report error [#33190](https://github.com/pingcap/tidb/pull/33190) - - planner: fix wrong range calculation for Nulleq function on Enum values [#32496](https://github.com/pingcap/tidb/pull/32496) - - -+ PingCAP/TiFlash - - - Fix the potential crash issue that occurs when TLS is enabled [#4689](https://github.com/pingcap/tiflash/pull/4689) - - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#4496](https://github.com/pingcap/tiflash/pull/4496) - - Fix the issue that a query containing `JOIN` could be hung if an error was encountered [#4270](https://github.com/pingcap/tiflash/pull/4270) - - -+ PD - - - Fix the issue that duration fields of dr-autosync cannot be set [#4660](https://github.com/tikv/pd/pull/4660) - -## __unsorted - -+ PingCAP/TiDB - - - ```release-note [#34335](https://github.com/pingcap/tidb/pull/34335) - - ```release-note [#34317](https://github.com/pingcap/tidb/pull/34317) - - ```release-note [#34302](https://github.com/pingcap/tidb/pull/34302) - - ```release-note [#34271](https://github.com/pingcap/tidb/pull/34271) - - ```release-note [#34268](https://github.com/pingcap/tidb/pull/34268) - - lightning: split and scatter regions in batches [#34258](https://github.com/pingcap/tidb/pull/34258) - - ```release-note [#34253](https://github.com/pingcap/tidb/pull/34253) - - ```release-note [#34245](https://github.com/pingcap/tidb/pull/34245) - - ```release-note [#34226](https://github.com/pingcap/tidb/pull/34226) - - ```release-note [#34189](https://github.com/pingcap/tidb/pull/34189) - - ```release-note [#34139](https://github.com/pingcap/tidb/pull/34139) - - Fix the problem of high use of reArrangeFallback cpu. [#34063](https://github.com/pingcap/tidb/pull/34063) - - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#34025](https://github.com/pingcap/tidb/pull/34025) - - ```release-note [#34019](https://github.com/pingcap/tidb/pull/34019) - - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33988](https://github.com/pingcap/tidb/pull/33988) - - ```release-note [#33961](https://github.com/pingcap/tidb/pull/33961) - - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33816](https://github.com/pingcap/tidb/pull/33816) - - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33605](https://github.com/pingcap/tidb/pull/33605) - - fix bug #33509 [#33577](https://github.com/pingcap/tidb/pull/33577) - - fix a bug that compress function may report error [#33557](https://github.com/pingcap/tidb/pull/33557) - - Fix the issue that NewCollationEnable config not checked during restoration. [#33532](https://github.com/pingcap/tidb/pull/33532) - - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query. [#33517](https://github.com/pingcap/tidb/pull/33517) - - Fix the issue that BR not retry enough when region not consistency during restoration. [#33470](https://github.com/pingcap/tidb/pull/33470) - - Add retry to avoid precheck failure when query execution timeout [#33148](https://github.com/pingcap/tidb/pull/33148) - - executor: fix wrong result of delete multiple tables using left join [#33123](https://github.com/pingcap/tidb/pull/33123) - - Support multi k8s in grafana dashboards [#32953](https://github.com/pingcap/tidb/pull/32953) - - planner: Fix the issue that TiDB may dispatch duplicated tasks to TiFlash [#32841](https://github.com/pingcap/tidb/pull/32841) - - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32812](https://github.com/pingcap/tidb/pull/32812) - - lightning: fix checksum encountered “GC life time is shorter than transaction duration” error [#32799](https://github.com/pingcap/tidb/pull/32799) - - Fix BR failure on backup rawkv. [#32793](https://github.com/pingcap/tidb/pull/32793) - - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#32704](https://github.com/pingcap/tidb/pull/32704) - - Fix the problem of tidb oom when exporting data using chunk rpc [#32578](https://github.com/pingcap/tidb/pull/32578) - - fix date formate identifies '\n' as invalid separator [#32504](https://github.com/pingcap/tidb/pull/32504) - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#32390](https://github.com/pingcap/tidb/pull/32390) - - Fix a bug that caused region unbalanced after restoring. [#32129](https://github.com/pingcap/tidb/pull/32129) - - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31842](https://github.com/pingcap/tidb/pull/31842) - - fix greatest and least function with collation get wrong result [#31838](https://github.com/pingcap/tidb/pull/31838) - - fix load data will panic in some case [#31774](https://github.com/pingcap/tidb/pull/31774) - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#31351](https://github.com/pingcap/tidb/pull/31351) - -+ TiKV/TiKV - - - Fixes that successfully committed optimistic transactions may report false WriteConflict on network errors. [#12378](https://github.com/tikv/tikv/pull/12378) - - Fix panicking when replica read is enabled and there is a long time network condition [#12310](https://github.com/tikv/tikv/pull/12310) - - fix tikv panic and peer unexpected destroy due to fake merge target [#12295](https://github.com/tikv/tikv/pull/12295) - - Fix stale message cause panic [#12285](https://github.com/tikv/tikv/pull/12285) - - Solve the problem of raft msg memory metrics overflow, which will cause intermittent packet loss and oom. [#12227](https://github.com/tikv/tikv/pull/12227) - - Fix crash when profiling in Ubuntu 18.04. [#12208](https://github.com/tikv/tikv/pull/12208) - - metrics: support multi k8s in grafana dashboards. [#12138](https://github.com/tikv/tikv/pull/12138) - - Fix potential linearizability violation in replica reads. [#12121](https://github.com/tikv/tikv/pull/12121) - - fix panic when target peer is replaced with an destroyed uninitialized peer during merge [#12086](https://github.com/tikv/tikv/pull/12086) - - Fixes the bug that TiKV keep running over 2 years may panic. [#12042](https://github.com/tikv/tikv/pull/12042) - - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#12001](https://github.com/tikv/tikv/pull/12001) - - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11905](https://github.com/tikv/tikv/pull/11905) - - fix potential high latency caused by destroying a peer [#11881](https://github.com/tikv/tikv/pull/11881) - -+ PingCAP/TiFlash - - - fix potential data corruption for large indices [#4790](https://github.com/pingcap/tiflash/pull/4790) - - Fix the problem of TiFlash crashing when the memory limit is enabled [#4776](https://github.com/pingcap/tiflash/pull/4776) - - Fix potential query error when select on a table with many delete operations [#4760](https://github.com/pingcap/tiflash/pull/4760) - - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4729](https://github.com/pingcap/tiflash/pull/4729) - - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4717](https://github.com/pingcap/tiflash/pull/4717) - - Fix a bug that MPP tasks may leak threads forever [#4642](https://github.com/pingcap/tiflash/pull/4642) - - Fix the problem that empty segments cannot be merged after gc [#4522](https://github.com/pingcap/tiflash/pull/4522) - - Fix wrong result of cast(float as decimal) when overflow happens [#4388](https://github.com/pingcap/tiflash/pull/4388) - - fix the problem that expired data was not recycled timely due to slow gc speed [#4255](https://github.com/pingcap/tiflash/pull/4255) - - Fix the bug that canceled MPP query may cause tasks hang forever when local tunnel is enabled. [#4237](https://github.com/pingcap/tiflash/pull/4237) - - Fix bug that enable elastic thread pool may introduce memory leak. [#4231](https://github.com/pingcap/tiflash/pull/4231) - - Fix memory leak when a query is cancelled. [#4230](https://github.com/pingcap/tiflash/pull/4230) - - metrics: support multi-k8s in grafana dashboards [#4213](https://github.com/pingcap/tiflash/pull/4213) - - metrics: support multi-k8s in grafana dashboards [#4206](https://github.com/pingcap/tiflash/pull/4206) - - Fix cast datetime to decimal wrong result bug [#4160](https://github.com/pingcap/tiflash/pull/4160) - - Avoid the potential of crash when apply snapshot under heavy ddl scenario [#4143](https://github.com/pingcap/tiflash/pull/4143) - - Fix the bug that invalid storage dir configurations lead to unexpected behavior [#4135](https://github.com/pingcap/tiflash/pull/4135) - - Fix the bug that some exceptions are not handled properly [#4115](https://github.com/pingcap/tiflash/pull/4115) - - Fix cast to decimal overflow bug [#4082](https://github.com/pingcap/tiflash/pull/4082) - - fix error result for function `in` [#4078](https://github.com/pingcap/tiflash/pull/4078) - - fix date format identifies '\n' as invalid separator [#4060](https://github.com/pingcap/tiflash/pull/4060) - - Fix potential query error after add column under heavy read workload [#4028](https://github.com/pingcap/tiflash/pull/4028) - - Fix the problem of TiFlash crashing when the memory limit is enabled [#3919](https://github.com/pingcap/tiflash/pull/3919) - -+ PD - - - None. [#4849](https://github.com/tikv/pd/pull/4849) - - Fix the issue that the label distribution has residual labels [#4826](https://github.com/tikv/pd/pull/4826) - - metrics: support multi-k8s in grafana dashboards [#4717](https://github.com/tikv/pd/pull/4717) - - None. [#4664](https://github.com/tikv/pd/pull/4664) - -+ Tools - - + PingCAP/TiCDC - - - save table checkpoint after a DDL is filtered [#5290](https://github.com/pingcap/tiflow/pull/5290) - - Fix TiCDC incorrectly display stale metrics data on dashboard. [#5260](https://github.com/pingcap/tiflow/pull/5260) - - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5241](https://github.com/pingcap/tiflow/pull/5241) - - `None`. [#5227](https://github.com/pingcap/tiflow/pull/5227) - - Fix a bug that checkpoint flushing will be called too frequently [#5201](https://github.com/pingcap/tiflow/pull/5201) - - fix tracker panic when pk of downstream table orders behind [#5167](https://github.com/pingcap/tiflow/pull/5167) - - `None`. [#5137](https://github.com/pingcap/tiflow/pull/5137) - - send one heartbeat for successive skipped GTID when enable relay log [#5093](https://github.com/pingcap/tiflow/pull/5093) - - fix DML construct error issue caused by `rename tables` DDL. [#5079](https://github.com/pingcap/tiflow/pull/5079) - - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default). [#5000](https://github.com/pingcap/tiflow/pull/5000) - - `None`. [#4869](https://github.com/pingcap/tiflow/pull/4869) - - Syncer will use working directory of DM-worker rather than /tmp to write internal files, and clean it after task is stopped [#4805](https://github.com/pingcap/tiflow/pull/4805) - - Fix that there're lot of log of "checkpoint has no change, skip sync flush checkpoint" and performance may drop [#4801](https://github.com/pingcap/tiflow/pull/4801) - - Fix stale metrics caused by owner changes. [#4800](https://github.com/pingcap/tiflow/pull/4800) - - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4789](https://github.com/pingcap/tiflow/pull/4789) - - fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4779](https://github.com/pingcap/tiflow/pull/4779) - - fix `Canal-JSON` meet `unsigned` SQL Type and nullable, which cause CDC server panic. [#4745](https://github.com/pingcap/tiflow/pull/4745) - - Fix checkpoint metrics when tables are being scheduled. [#4729](https://github.com/pingcap/tiflow/pull/4729) - - metrics: support multi-k8s in grafana dashboards [#4709](https://github.com/pingcap/tiflow/pull/4709) - - Fix stability problem in workerpool, which is used by Unified Sorter. [#4683](https://github.com/pingcap/tiflow/pull/4683) - - Fix a bug that sequence should not be replicated even if force-replication is true. [#4667](https://github.com/pingcap/tiflow/pull/4667) - - fix `Canal-JSON` meet `unsigned` SQL typed in `string`, which cause CDC server panic. [#4657](https://github.com/pingcap/tiflow/pull/4657) - - `None`. [#4649](https://github.com/pingcap/tiflow/pull/4649) - - Please add a release note. -`None`. [#4648](https://github.com/pingcap/tiflow/pull/4648) - - Fix a bug that long varchar will report error of "Column length too big..." [#4646](https://github.com/pingcap/tiflow/pull/4646) - - `None`. [#4615](https://github.com/pingcap/tiflow/pull/4615) - - `None`. [#4595](https://github.com/pingcap/tiflow/pull/4595) - - `None`. [#4575](https://github.com/pingcap/tiflow/pull/4575) - - Fix a bug that owner exits abnormally when PD leader is killed [#4533](https://github.com/pingcap/tiflow/pull/4533) - - allow user set the configuration of Kafka producer dial/write/read timeout [#4521](https://github.com/pingcap/tiflow/pull/4521) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#4513](https://github.com/pingcap/tiflow/pull/4513) - - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4509](https://github.com/pingcap/tiflow/pull/4509) - - `None`. [#4466](https://github.com/pingcap/tiflow/pull/4466) - - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4438](https://github.com/pingcap/tiflow/pull/4438) - - None. [#4431](https://github.com/pingcap/tiflow/pull/4431) \ No newline at end of file +--- +title: TiDB 5.4.1 Release Notes +category: Releases +--- + + + +# TiDB 5.4.1 Release Notes + +Release Date: May xx, 2022 + +TiDB version: 5.4.1 + +## Improvements + ++ PingCAP/TiDB + + - ```release-note [#33887](https://github.com/pingcap/tidb/issues/33887) + + ++ Tools + + + PingCAP/TiCDC + + - `None`. [#4784](https://github.com/pingcap/tiflow/issues/4784) + +## Bug Fixes + ++ PingCAP/TiDB + + - executor: fix CTE is block when query report error [#31302](https://github.com/pingcap/tidb/issues/31302) + - planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) + + ++ PingCAP/TiFlash + + - Fix the potential crash issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) + - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#4437](https://github.com/pingcap/tiflash/issues/4437) + - Fix the issue that a query containing `JOIN` could be hung if an error was encountered [#4195](https://github.com/pingcap/tiflash/issues/4195) + + ++ PD + + - Fix the issue that duration fields of dr-autosync cannot be set [#4651](https://github.com/tikv/pd/issues/4651) + +## __unsorted + ++ PingCAP/TiDB + + - ```release-note [#27937](https://github.com/pingcap/tidb/issues/27937) + - ```release-note [#34216](https://github.com/pingcap/tidb/issues/34216) + - ```release-note [#34256](https://github.com/pingcap/tidb/issues/34256) + - ```release-note [#33665](https://github.com/pingcap/tidb/issues/33665) + - ```release-note [#34237](https://github.com/pingcap/tidb/issues/34237) + - lightning: split and scatter regions in batches [#33618](https://github.com/pingcap/tidb/issues/33618) + - ```release-note [#32459](https://github.com/pingcap/tidb/issues/32459) + - ```release-note [#34099](https://github.com/pingcap/tidb/issues/34099) + - ```release-note [#34213](https://github.com/pingcap/tidb/issues/34213) + - ```release-note [#34180](https://github.com/pingcap/tidb/issues/34180) + - ```release-note [#34139](https://github.com/pingcap/tidb/pull/34139) + - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) + - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) + - ```release-note [#33801](https://github.com/pingcap/tidb/issues/33801) + - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) + - ```release-note [#33893](https://github.com/pingcap/tidb/issues/33893) + - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) + - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) + - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) + - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) + - Fix the issue that NewCollationEnable config not checked during restoration. [#33422](https://github.com/pingcap/tidb/issues/33422) + - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query. [#33322](https://github.com/pingcap/tidb/issues/33322) + - Fix the issue that BR not retry enough when region not consistency during restoration. [#33419](https://github.com/pingcap/tidb/issues/33419) + - Add retry to avoid precheck failure when query execution timeout [#31797](https://github.com/pingcap/tidb/issues/31797) + - executor: fix wrong result of delete multiple tables using left join [#31321](https://github.com/pingcap/tidb/issues/31321) + - Support multi k8s in grafana dashboards [#32593](https://github.com/pingcap/tidb/issues/32593) + - planner: Fix the issue that TiDB may dispatch duplicated tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) + - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32754](https://github.com/pingcap/tidb/issues/32754) + - lightning: fix checksum encountered “GC life time is shorter than transaction duration” error [#32733](https://github.com/pingcap/tidb/issues/32733) + - Fix BR failure on backup rawkv. [#32607](https://github.com/pingcap/tidb/issues/32607) + - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) + - Fix the problem of tidb oom when exporting data using chunk rpc [#31981](https://github.com/pingcap/tidb/issues/31981) + - fix date formate identifies '\n' as invalid separator [#32504](https://github.com/pingcap/tidb/pull/32504) + - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tidb/issues/31034) + - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) + - fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - fix load data will panic in some case [#31589](https://github.com/pingcap/tidb/issues/31589) + - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) + ++ TiKV/TiKV + + - Fixes that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) + - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) + - fix tikv panic and peer unexpected destroy due to fake merge target [#12232](https://github.com/tikv/tikv/issues/12232) + - Fix stale message cause panic [#12023](https://github.com/tikv/tikv/issues/12023) + - Solve the problem of raft msg memory metrics overflow, which will cause intermittent packet loss and oom. [#12160](https://github.com/tikv/tikv/issues/12160) + - Fix crash when profiling in Ubuntu 18.04. [#9765](https://github.com/tikv/tikv/issues/9765) + - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + - Fix potential linearizability violation in replica reads. [#12109](https://github.com/tikv/tikv/issues/12109) + - fix panic when target peer is replaced with an destroyed uninitialized peer during merge [#12048](https://github.com/tikv/tikv/issues/12048) + - Fixes the bug that TiKV keep running over 2 years may panic. [#11940](https://github.com/tikv/tikv/issues/11940) + - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) + - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) + - fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) + ++ PingCAP/TiFlash + + - fix potential data corruption for large indices [#4778](https://github.com/pingcap/tiflash/issues/4778) + - Fix the problem of TiFlash crashing when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) + - Fix potential query error when select on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) + - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4192](https://github.com/pingcap/tiflash/issues/4192) + - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4414](https://github.com/pingcap/tiflash/issues/4414) + - Fix a bug that MPP tasks may leak threads forever [#4238](https://github.com/pingcap/tiflash/issues/4238) + - Fix the problem that empty segments cannot be merged after gc [#4511](https://github.com/pingcap/tiflash/issues/4511) + - Fix wrong result of cast(float as decimal) when overflow happens [#3998](https://github.com/pingcap/tiflash/issues/3998) + - fix the problem that expired data was not recycled timely due to slow gc speed [#4146](https://github.com/pingcap/tiflash/issues/4146) + - Fix the bug that canceled MPP query may cause tasks hang forever when local tunnel is enabled. [#4229](https://github.com/pingcap/tiflash/issues/4229) + - Fix bug that enable elastic thread pool may introduce memory leak. [#4098](https://github.com/pingcap/tiflash/issues/4098) + - Fix memory leak when a query is cancelled. [#4098](https://github.com/pingcap/tiflash/issues/4098) + - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) + - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) + - Fix cast datetime to decimal wrong result bug [#4151](https://github.com/pingcap/tiflash/issues/4151) + - Avoid the potential of crash when apply snapshot under heavy ddl scenario [#4072](https://github.com/pingcap/tiflash/issues/4072) + - Fix the bug that invalid storage dir configurations lead to unexpected behavior [#4093](https://github.com/pingcap/tiflash/issues/4093) + - Fix the bug that some exceptions are not handled properly [#4101](https://github.com/pingcap/tiflash/issues/4101) + - Fix cast to decimal overflow bug [#3920](https://github.com/pingcap/tiflash/issues/3920) + - fix error result for function `in` [#4016](https://github.com/pingcap/tiflash/issues/4016) + - fix date format identifies '\n' as invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) + - Fix potential query error after add column under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) + - Fix the problem of TiFlash crashing when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) + ++ PD + + - None. [#4805](https://github.com/tikv/pd/issues/4805) + - Fix the issue that the label distribution has residual labels [#4825](https://github.com/tikv/pd/issues/4825) + - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) + - None. [#4808](https://github.com/tikv/pd/issues/4808) + ++ Tools + + + PingCAP/TiCDC + + - save table checkpoint after a DDL is filtered [#5272](https://github.com/pingcap/tiflow/issues/5272) + - Fix TiCDC incorrectly display stale metrics data on dashboard. [#4774](https://github.com/pingcap/tiflow/issues/4774) + - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) + - `None`. [#5197](https://github.com/pingcap/tiflow/issues/5197) + - Fix a bug that checkpoint flushing will be called too frequently [#5063](https://github.com/pingcap/tiflow/issues/5063) + - fix tracker panic when pk of downstream table orders behind [#5159](https://github.com/pingcap/tiflow/issues/5159) + - `None`. [#5136](https://github.com/pingcap/tiflow/issues/5136) + - send one heartbeat for successive skipped GTID when enable relay log [#5063](https://github.com/pingcap/tiflow/issues/5063) + - fix DML construct error issue caused by `rename tables` DDL. [#5059](https://github.com/pingcap/tiflow/issues/5059) + - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default). [#4963](https://github.com/pingcap/tiflow/issues/4963) + - `None`. [#4858](https://github.com/pingcap/tiflow/issues/4858) + - Syncer will use working directory of DM-worker rather than /tmp to write internal files, and clean it after task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) + - Fix that there're lot of log of "checkpoint has no change, skip sync flush checkpoint" and performance may drop [#4619](https://github.com/pingcap/tiflow/issues/4619) + - Fix stale metrics caused by owner changes. [#4774](https://github.com/pingcap/tiflow/issues/4774) + - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) + - fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4777](https://github.com/pingcap/tiflow/issues/4777) + - fix `Canal-JSON` meet `unsigned` SQL Type and nullable, which cause CDC server panic. [#4736](https://github.com/pingcap/tiflow/issues/4736) + - Fix checkpoint metrics when tables are being scheduled. [#4714](https://github.com/pingcap/tiflow/issues/4714) + - metrics: support multi-k8s in grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) + - Fix stability problem in workerpool, which is used by Unified Sorter. [#4447](https://github.com/pingcap/tiflow/issues/4447) + - Fix a bug that sequence should not be replicated even if force-replication is true. [#4552](https://github.com/pingcap/tiflow/issues/4552) + - fix `Canal-JSON` meet `unsigned` SQL typed in `string`, which cause CDC server panic. [#4635](https://github.com/pingcap/tiflow/issues/4635) + - `None`. [#4554](https://github.com/pingcap/tiflow/issues/4554) + - Please add a release note. +`None`. [#4565](https://github.com/pingcap/tiflow/issues/4565) + - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) + - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) + - `None`. [#4588](https://github.com/pingcap/tiflow/issues/4588) + - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) + - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) + - allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Please add a release note. +If you don't think this PR needs a release note then fill it with `None`. [#4287](https://github.com/pingcap/tiflow/issues/4287) + - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) + - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) + - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) + - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) \ No newline at end of file diff --git a/releases/release-notes.md b/releases/release-notes.md index 960dd2d2ce13..409050da08e2 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -11,6 +11,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.4 +- [5.4.1](/releases/release-5.4.1.md) - [5.4.0](/releases/release-5.4.0.md) ## 5.3 diff --git a/releases/release-timeline.md b/releases/release-timeline.md index b7c99fe6fff4..749c79f27ca3 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,6 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | +| [5.4.1](/releases/release-5.4.1.md) | 2022-05-xx | | [5.2.4](/releases/release-5.2.4.md) | 2022-04-26 | | [6.0.0-DMR](/releases/release-6.0.0-dmr.md) | 2022-04-07 | | [5.3.1](/releases/release-5.3.1.md) | 2022-03-03 | From 39b71545f09914351d353f0c5e706dab13fe8aff Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 18:55:04 +0800 Subject: [PATCH 04/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 6df7fc0fe5f3..117112f26cb5 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -79,7 +79,7 @@ TiDB version: 5.4.1 - Fix BR failure on backup rawkv. [#32607](https://github.com/pingcap/tidb/issues/32607) - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) - Fix the problem of tidb oom when exporting data using chunk rpc [#31981](https://github.com/pingcap/tidb/issues/31981) - - fix date formate identifies '\n' as invalid separator [#32504](https://github.com/pingcap/tidb/pull/32504) + - fix date formate identifies '\n' as invalid separator [#32504](https://github.com/pingcap/tidb/issues/32232) - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tidb/issues/31034) - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) From 4b0c14ced921d10ad7ae750d4eed859f3abb9236 Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 19:59:45 +0800 Subject: [PATCH 05/45] move notes to the corresponding categories --- releases/release-5.4.1.md | 208 ++++++++++++++++++++------------------ 1 file changed, 111 insertions(+), 97 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 117112f26cb5..189742e3b9fa 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -13,121 +13,150 @@ TiDB version: 5.4.1 ## Improvements -+ PingCAP/TiDB - - - ```release-note [#33887](https://github.com/pingcap/tidb/issues/33887) ++ TiDB + - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) + Tools - + PingCAP/TiCDC + + TiCDC - - `None`. [#4784](https://github.com/pingcap/tiflow/issues/4784) + - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Support multiple Kubernetes clusters in Grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) + - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) + + + TiDB Data Migration (DM) + + - (dup: release-6.0.0-dmr.md > Improvements> Tools> TiDB Data Migration (DM))- Support Syncer using the working directory of the DM-worker rather than `/tmp` to write internal files, and cleaning the directory after the task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) ## Bug Fixes -+ PingCAP/TiDB ++ TiDB + + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) + - (dup: release-5.3.1.md > Bug fixes> TiDB)- Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix load data panic if the data is broken at an escape character [#31589](https://github.com/pingcap/tidb/issues/31589) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) + - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) + - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) + - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) + - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) + - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) + - Fix the issue that NewCollationEnable config not checked during restoration. [#33422](https://github.com/pingcap/tidb/issues/33422) + - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query. [#33322](https://github.com/pingcap/tidb/issues/33322) + - Fix the issue that BR not retry enough when region not consistency during restoration. [#33419](https://github.com/pingcap/tidb/issues/33419) + - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) + - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) - - executor: fix CTE is block when query report error [#31302](https://github.com/pingcap/tidb/issues/31302) - - planner: fix wrong range calculation for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) ++ TiKV + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that TiKV panics and destroys peers unexpectedly because the target Region to be merged is invalid [#12232](https://github.com/tikv/tikv/issues/12232) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that stale messages cause TiKV to panic [#12023](https://github.com/tikv/tikv/issues/12023) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue of intermittent packet loss and out of memory (OOM) caused by the overflow of memory metrics [#12160](https://github.com/tikv/tikv/issues/12160) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the potential panic issue that occurs when TiKV performs profiling on Ubuntu 18.04 [#9765](https://github.com/tikv/tikv/issues/9765) + - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that replica reads might violate the linearizability [#12109](https://github.com/tikv/tikv/issues/12109) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the TiKV panic issue that occurs when the target peer is replaced with the peer that is destroyed without being initialized when merging a Region [#12048](https://github.com/tikv/tikv/issues/12048) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that TiKV might panic if it has been running for 2 years or more [#11940](https://github.com/tikv/tikv/issues/11940) + - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) + - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + ++ TiFlash + + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix possible metadata corruption caused by Region merge on a lagging Region peer [#4437](https://github.com/pingcap/tiflash/issues/4437) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that a query containing `JOIN` might be hung if an error occurs [#4195](https://github.com/pingcap/tiflash/issues/4195) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix a bug that MPP tasks might leak threads forever [#4238](https://github.com/pingcap/tiflash/issues/4238) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the overflow that occurs when casting `FLOAT` to `DECIMAL` [#3998](https://github.com/pingcap/tiflash/issues/3998) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue that expired data is recycled slowly [#4146](https://github.com/pingcap/tiflash/issues/4146) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix a bug that canceled MPP queries might cause tasks to hang forever when the local tunnel is enabled [#4229](https://github.com/pingcap/tiflash/issues/4229) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue of memory leak that occurs when a query is canceled [#4098](https://github.com/pingcap/tiflash/issues/4098) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue of memory leak that occurs when a query is canceled [#4098](https://github.com/pingcap/tiflash/issues/4098) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the wrong result that occurs when casting `DATETIME` to `DECIMAL` [#4151](https://github.com/pingcap/tiflash/issues/4151) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the potential issue of TiFlash panic when `Snapshot` is applied simultaneously with multiple DDL operations [#4072](https://github.com/pingcap/tiflash/issues/4072) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the bug that invalid storage directory configurations lead to unexpected behaviors [#4093](https://github.com/pingcap/tiflash/issues/4093) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the bug that some exceptions are not handled properly [#4101](https://github.com/pingcap/tiflash/issues/4101) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that casting `INT` to `DECIMAL` might cause overflow [#3920](https://github.com/pingcap/tiflash/issues/3920) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the result of `IN` is incorrect in multi-value expressions [#4016](https://github.com/pingcap/tiflash/issues/4016) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the date format identifies `' +'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) -+ PingCAP/TiFlash ++ PD - - Fix the potential crash issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) - - Fix the metadata corruption issue when `Prepare Merge` is triggered after a new election is finished but the isolated peer is not informed [#4437](https://github.com/pingcap/tiflash/issues/4437) - - Fix the issue that a query containing `JOIN` could be hung if an error was encountered [#4195](https://github.com/pingcap/tiflash/issues/4195) + - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) ++ Tools -+ PD + + Backup & Restore (BR) + - (dup: release-5.2.4.md > Bug fixes> Tools> Backup & Restore (BR))- Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) + + + TiCDC + + - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) + - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiCDC)- Fix the TiCDC panic issue that might occur because `Canal-JSON` does not support nil [#4736](https://github.com/pingcap/tiflow/issues/4736) + - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a stability problem in workerpool used by Unified Sorter [#4447](https://github.com/pingcap/tiflow/issues/4447) + - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that sequence is incorrectly replicated in some cases [#4563](https://github.com/pingcap/tiflow/issues/4552) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiCDC)- Fix the TiCDC panic issue that might occur when `Canal-JSON` incorrectly handles `string` [#4635](https://github.com/pingcap/tiflow/issues/4635) + - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) + - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that MySQL sink generates duplicated `replace` SQL statements when `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) + + + TiDB Data Migration (DM) - - Fix the issue that duration fields of dr-autosync cannot be set [#4651](https://github.com/tikv/pd/issues/4651) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + + + TiDB Lightning + + - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix the checksum error “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Lightning)- Fix the issue that TiDB Lightning gets stuck when it fails to check empty tables [#31797](https://github.com/pingcap/tidb/issues/31797) + - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) ## __unsorted + PingCAP/TiDB - - ```release-note [#27937](https://github.com/pingcap/tidb/issues/27937) - - ```release-note [#34216](https://github.com/pingcap/tidb/issues/34216) - - ```release-note [#34256](https://github.com/pingcap/tidb/issues/34256) - - ```release-note [#33665](https://github.com/pingcap/tidb/issues/33665) - - ```release-note [#34237](https://github.com/pingcap/tidb/issues/34237) + - release-note [#33887](https://github.com/pingcap/tidb/issues/33887) + - release-note [#27937](https://github.com/pingcap/tidb/issues/27937) + - release-note [#34216](https://github.com/pingcap/tidb/issues/34216) + - release-note [#34256](https://github.com/pingcap/tidb/issues/34256) + - release-note [#33665](https://github.com/pingcap/tidb/issues/33665) + - release-note [#34237](https://github.com/pingcap/tidb/issues/34237) - lightning: split and scatter regions in batches [#33618](https://github.com/pingcap/tidb/issues/33618) - - ```release-note [#32459](https://github.com/pingcap/tidb/issues/32459) - - ```release-note [#34099](https://github.com/pingcap/tidb/issues/34099) - - ```release-note [#34213](https://github.com/pingcap/tidb/issues/34213) - - ```release-note [#34180](https://github.com/pingcap/tidb/issues/34180) - - ```release-note [#34139](https://github.com/pingcap/tidb/pull/34139) - - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) - - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) - - ```release-note [#33801](https://github.com/pingcap/tidb/issues/33801) - - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) - - ```release-note [#33893](https://github.com/pingcap/tidb/issues/33893) - - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) - - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) - - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) - - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) - - Fix the issue that NewCollationEnable config not checked during restoration. [#33422](https://github.com/pingcap/tidb/issues/33422) - - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query. [#33322](https://github.com/pingcap/tidb/issues/33322) - - Fix the issue that BR not retry enough when region not consistency during restoration. [#33419](https://github.com/pingcap/tidb/issues/33419) - - Add retry to avoid precheck failure when query execution timeout [#31797](https://github.com/pingcap/tidb/issues/31797) - - executor: fix wrong result of delete multiple tables using left join [#31321](https://github.com/pingcap/tidb/issues/31321) + - release-note [#32459](https://github.com/pingcap/tidb/issues/32459) + - release-note [#34099](https://github.com/pingcap/tidb/issues/34099) + - release-note [#34213](https://github.com/pingcap/tidb/issues/34213) + - release-note [#34180](https://github.com/pingcap/tidb/issues/34180) + - release-note [#34139](https://github.com/pingcap/tidb/pull/34139) + - release-note [#33801](https://github.com/pingcap/tidb/issues/33801) + - release-note [#33893](https://github.com/pingcap/tidb/issues/33893) - Support multi k8s in grafana dashboards [#32593](https://github.com/pingcap/tidb/issues/32593) - - planner: Fix the issue that TiDB may dispatch duplicated tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32754](https://github.com/pingcap/tidb/issues/32754) - - lightning: fix checksum encountered “GC life time is shorter than transaction duration” error [#32733](https://github.com/pingcap/tidb/issues/32733) - - Fix BR failure on backup rawkv. [#32607](https://github.com/pingcap/tidb/issues/32607) - - planner: make queries with the extra column `_tidb_rowid` can use PointGet [#31543](https://github.com/pingcap/tidb/issues/31543) - - Fix the problem of tidb oom when exporting data using chunk rpc [#31981](https://github.com/pingcap/tidb/issues/31981) - - fix date formate identifies '\n' as invalid separator [#32504](https://github.com/pingcap/tidb/issues/32232) - - Fix the bug that lightning may not clean up metadata schema when some of the import contains no source files. [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix a bug that caused region unbalanced after restoring. [#31034](https://github.com/pingcap/tidb/issues/31034) - - Fixed a bug that turning on tidb_restricted_read_only won't automatically turn on tidb_super_read_only [#31745](https://github.com/pingcap/tidb/issues/31745) - - fix greatest and least function with collation get wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - - fix load data will panic in some case [#31589](https://github.com/pingcap/tidb/issues/31589) - - Fix a data race that may cause "invalid transaction" error when executing a query using index lookup join. [#30468](https://github.com/pingcap/tidb/issues/30468) + TiKV/TiKV - - Fixes that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) + - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) - - fix tikv panic and peer unexpected destroy due to fake merge target [#12232](https://github.com/tikv/tikv/issues/12232) - - Fix stale message cause panic [#12023](https://github.com/tikv/tikv/issues/12023) - - Solve the problem of raft msg memory metrics overflow, which will cause intermittent packet loss and oom. [#12160](https://github.com/tikv/tikv/issues/12160) - - Fix crash when profiling in Ubuntu 18.04. [#9765](https://github.com/tikv/tikv/issues/9765) - - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) - - Fix potential linearizability violation in replica reads. [#12109](https://github.com/tikv/tikv/issues/12109) - - fix panic when target peer is replaced with an destroyed uninitialized peer during merge [#12048](https://github.com/tikv/tikv/issues/12048) - - Fixes the bug that TiKV keep running over 2 years may panic. [#11940](https://github.com/tikv/tikv/issues/11940) - - Reduce CDC recovery time by reduce the number regions that need resolved lock. [#11993](https://github.com/tikv/tikv/issues/11993) - - Fix a potential panic (#11746) when snapshot files have been deleted but the peer's status is still Applying. [#11746](https://github.com/tikv/tikv/issues/11746) - - fix potential high latency caused by destroying a peer [#10210](https://github.com/tikv/tikv/issues/10210) + PingCAP/TiFlash - fix potential data corruption for large indices [#4778](https://github.com/pingcap/tiflash/issues/4778) - - Fix the problem of TiFlash crashing when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) - Fix potential query error when select on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4192](https://github.com/pingcap/tiflash/issues/4192) - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4414](https://github.com/pingcap/tiflash/issues/4414) - - Fix a bug that MPP tasks may leak threads forever [#4238](https://github.com/pingcap/tiflash/issues/4238) - Fix the problem that empty segments cannot be merged after gc [#4511](https://github.com/pingcap/tiflash/issues/4511) - - Fix wrong result of cast(float as decimal) when overflow happens [#3998](https://github.com/pingcap/tiflash/issues/3998) - - fix the problem that expired data was not recycled timely due to slow gc speed [#4146](https://github.com/pingcap/tiflash/issues/4146) - - Fix the bug that canceled MPP query may cause tasks hang forever when local tunnel is enabled. [#4229](https://github.com/pingcap/tiflash/issues/4229) - - Fix bug that enable elastic thread pool may introduce memory leak. [#4098](https://github.com/pingcap/tiflash/issues/4098) - - Fix memory leak when a query is cancelled. [#4098](https://github.com/pingcap/tiflash/issues/4098) - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) - - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) - - Fix cast datetime to decimal wrong result bug [#4151](https://github.com/pingcap/tiflash/issues/4151) - - Avoid the potential of crash when apply snapshot under heavy ddl scenario [#4072](https://github.com/pingcap/tiflash/issues/4072) - - Fix the bug that invalid storage dir configurations lead to unexpected behavior [#4093](https://github.com/pingcap/tiflash/issues/4093) - - Fix the bug that some exceptions are not handled properly [#4101](https://github.com/pingcap/tiflash/issues/4101) - - Fix cast to decimal overflow bug [#3920](https://github.com/pingcap/tiflash/issues/3920) - - fix error result for function `in` [#4016](https://github.com/pingcap/tiflash/issues/4016) - - fix date format identifies '\n' as invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) - - Fix potential query error after add column under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - - Fix the problem of TiFlash crashing when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) + PD @@ -140,8 +169,8 @@ TiDB version: 5.4.1 + PingCAP/TiCDC + - `None`. [#4784](https://github.com/pingcap/tiflow/issues/4784) - save table checkpoint after a DDL is filtered [#5272](https://github.com/pingcap/tiflow/issues/5272) - - Fix TiCDC incorrectly display stale metrics data on dashboard. [#4774](https://github.com/pingcap/tiflow/issues/4774) - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) - `None`. [#5197](https://github.com/pingcap/tiflow/issues/5197) - Fix a bug that checkpoint flushing will be called too frequently [#5063](https://github.com/pingcap/tiflow/issues/5063) @@ -151,29 +180,14 @@ TiDB version: 5.4.1 - fix DML construct error issue caused by `rename tables` DDL. [#5059](https://github.com/pingcap/tiflow/issues/5059) - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default). [#4963](https://github.com/pingcap/tiflow/issues/4963) - `None`. [#4858](https://github.com/pingcap/tiflow/issues/4858) - - Syncer will use working directory of DM-worker rather than /tmp to write internal files, and clean it after task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) - - Fix that there're lot of log of "checkpoint has no change, skip sync flush checkpoint" and performance may drop [#4619](https://github.com/pingcap/tiflow/issues/4619) - - Fix stale metrics caused by owner changes. [#4774](https://github.com/pingcap/tiflow/issues/4774) - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) - fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4777](https://github.com/pingcap/tiflow/issues/4777) - - fix `Canal-JSON` meet `unsigned` SQL Type and nullable, which cause CDC server panic. [#4736](https://github.com/pingcap/tiflow/issues/4736) - Fix checkpoint metrics when tables are being scheduled. [#4714](https://github.com/pingcap/tiflow/issues/4714) - - metrics: support multi-k8s in grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) - - Fix stability problem in workerpool, which is used by Unified Sorter. [#4447](https://github.com/pingcap/tiflow/issues/4447) - - Fix a bug that sequence should not be replicated even if force-replication is true. [#4552](https://github.com/pingcap/tiflow/issues/4552) - - fix `Canal-JSON` meet `unsigned` SQL typed in `string`, which cause CDC server panic. [#4635](https://github.com/pingcap/tiflow/issues/4635) - `None`. [#4554](https://github.com/pingcap/tiflow/issues/4554) - - Please add a release note. -`None`. [#4565](https://github.com/pingcap/tiflow/issues/4565) - - Fix a bug that long varchar will report error of "Column length too big..." [#4637](https://github.com/pingcap/tiflow/issues/4637) + - Please add a release note. `None`. [#4565](https://github.com/pingcap/tiflow/issues/4565) - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) - `None`. [#4588](https://github.com/pingcap/tiflow/issues/4588) - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - - Fix a bug that owner exits abnormally when PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - - allow user set the configuration of Kafka producer dial/write/read timeout [#4385](https://github.com/pingcap/tiflow/issues/4385) - - Please add a release note. -If you don't think this PR needs a release note then fill it with `None`. [#4287](https://github.com/pingcap/tiflow/issues/4287) - - Fix a bug that MySQL sink will generate duplicated replace SQL if `batch-replace-enable` is disabled. [#4501](https://github.com/pingcap/tiflow/issues/4501) + - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#4287](https://github.com/pingcap/tiflow/issues/4287) - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - - Fix the issue that update statement execute error in safemode may cause DM-worker panic. [#4317](https://github.com/pingcap/tiflow/issues/4317) - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) \ No newline at end of file From 18f6bbc48bfb217802f69e9acf1d235c5a31a6fe Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 22:49:50 +0800 Subject: [PATCH 06/45] adjust sequence --- releases/release-5.4.1.md | 66 ++++++++++++++++++++++++++++++++------- 1 file changed, 54 insertions(+), 12 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 189742e3b9fa..967d9d463f5c 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -1,29 +1,67 @@ --- title: TiDB 5.4.1 Release Notes -category: Releases --- - # TiDB 5.4.1 Release Notes Release Date: May xx, 2022 TiDB version: 5.4.1 +## Compatibility changes + ++ TiDB + + - note 1 + - note 2 + ++ TiKV + + - note 1 + - note 2 + ## Improvements + TiDB - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) ++ TiKV + + - note 1 + ++ PD + + - note 1 + ++ TiDB Dashboard + + - note 1 + ++ TiFlash + + - note 1 + + Tools + + Backup & Restore (BR) + + - note 1 + + TiCDC - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Support multiple Kubernetes clusters in Grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) + + Dumpling + + - note 1 + + + TiDB Lightning + + - note 1 + + TiDB Data Migration (DM) - (dup: release-6.0.0-dmr.md > Improvements> Tools> TiDB Data Migration (DM))- Support Syncer using the working directory of the DM-worker rather than `/tmp` to write internal files, and cleaning the directory after the task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) @@ -68,6 +106,10 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) ++ PD + + - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) + + TiFlash - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) @@ -91,10 +133,6 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) -+ PD - - - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) - + Tools + Backup & Restore (BR) @@ -111,18 +149,22 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that MySQL sink generates duplicated `replace` SQL statements when `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - + TiDB Data Migration (DM) - - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - + TiDB Lightning - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix the checksum error “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Lightning)- Fix the issue that TiDB Lightning gets stuck when it fails to check empty tables [#31797](https://github.com/pingcap/tidb/issues/31797) - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) + + Dumpling + + - note 1 + + + TiDB Data Migration (DM) + + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + ## __unsorted + PingCAP/TiDB From d84e7a477439feaa9e028d6e712152411d6cb440 Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 23:24:44 +0800 Subject: [PATCH 07/45] add a missing word --- releases/release-5.4.1.md | 7 +++---- releases/release-6.0.0-dmr.md | 2 +- 2 files changed, 4 insertions(+), 5 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 967d9d463f5c..34e1260ce180 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -73,7 +73,7 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) - (dup: release-5.3.1.md > Bug fixes> TiDB)- Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) @@ -98,7 +98,6 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that stale messages cause TiKV to panic [#12023](https://github.com/tikv/tikv/issues/12023) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue of intermittent packet loss and out of memory (OOM) caused by the overflow of memory metrics [#12160](https://github.com/tikv/tikv/issues/12160) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the potential panic issue that occurs when TiKV performs profiling on Ubuntu 18.04 [#9765](https://github.com/tikv/tikv/issues/9765) - - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that replica reads might violate the linearizability [#12109](https://github.com/tikv/tikv/issues/12109) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the TiKV panic issue that occurs when the target peer is replaced with the peer that is destroyed without being initialized when merging a Region [#12048](https://github.com/tikv/tikv/issues/12048) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that TiKV might panic if it has been running for 2 years or more [#11940](https://github.com/tikv/tikv/issues/11940) @@ -128,8 +127,7 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the bug that some exceptions are not handled properly [#4101](https://github.com/pingcap/tiflash/issues/4101) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that casting `INT` to `DECIMAL` might cause overflow [#3920](https://github.com/pingcap/tiflash/issues/3920) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the result of `IN` is incorrect in multi-value expressions [#4016](https://github.com/pingcap/tiflash/issues/4016) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the date format identifies `' -'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) + - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the date format identifies `'\n'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) @@ -190,6 +188,7 @@ TiDB version: 5.4.1 - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) + - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + PingCAP/TiFlash diff --git a/releases/release-6.0.0-dmr.md b/releases/release-6.0.0-dmr.md index 907af4fdac9c..7d7e77ed9ca9 100644 --- a/releases/release-6.0.0-dmr.md +++ b/releases/release-6.0.0-dmr.md @@ -463,7 +463,7 @@ TiDB v6.0.0 is a DMR, and its version is 6.0.0-DMR. - Fix wrong collation of the `json` type when this type is processed using builtin-func [#31320](https://github.com/pingcap/tidb/issues/31320) - Fix a bug that PD rules are not deleted when the count of TiFlash replicas is set to 0 [#32190](https://github.com/pingcap/tidb/issues/32190) - Fix the issue that `alter column set default` wrongly updates the table schema [#31074](https://github.com/pingcap/tidb/issues/31074) - - Fix the issue that `date_format` in TiDB handles in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) + - Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - Fix a bug that errors may occur when updating partitioned tables using join [#31629](https://github.com/pingcap/tidb/issues/31629) - Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - Fix possible panic in `upper()` and `lower()` functions [#32488](https://github.com/pingcap/tidb/issues/32488) From dbc5a9d73d3fd2e70f70c5bad8214910a063bc28 Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 29 Apr 2022 23:32:13 +0800 Subject: [PATCH 08/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 34e1260ce180..9da9d27b9834 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -104,6 +104,7 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + PD @@ -188,7 +189,6 @@ TiDB version: 5.4.1 - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) - - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + PingCAP/TiFlash From 909661c5bc4d981e20629df644ae975230fbfb99 Mon Sep 17 00:00:00 2001 From: Shirly Date: Sat, 7 May 2022 14:01:50 +0800 Subject: [PATCH 09/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 9da9d27b9834..4066d5acf08a 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -204,7 +204,6 @@ TiDB version: 5.4.1 - None. [#4805](https://github.com/tikv/pd/issues/4805) - Fix the issue that the label distribution has residual labels [#4825](https://github.com/tikv/pd/issues/4825) - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) - - None. [#4808](https://github.com/tikv/pd/issues/4808) + Tools From fb2c2d8a66ad786121c90fca2000927767bce1b4 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 9 May 2022 10:18:07 +0800 Subject: [PATCH 10/45] Apply suggestions from code review Co-authored-by: Shirly Co-authored-by: guo-shaoge Co-authored-by: cfzjywxk --- releases/release-5.4.1.md | 12 ++++-------- 1 file changed, 4 insertions(+), 8 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 4066d5acf08a..460d9b52693d 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -33,7 +33,7 @@ TiDB version: 5.4.1 + PD - - note 1 + - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) + TiDB Dashboard @@ -41,7 +41,7 @@ TiDB version: 5.4.1 + TiFlash - - note 1 + - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) + Tools @@ -104,11 +104,12 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + PD - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) + -Fix the issue that when there exists a store with more than a big free disk(2T for example) no balance operator generated even when one or more stores with its disk full. [#4805](https://github.com/tikv/pd/issues/4805) + - Fix the issue that in the metrics the label distribution has residual labels [#4825](https://github.com/tikv/pd/issues/4825) + TiFlash @@ -199,11 +200,6 @@ TiDB version: 5.4.1 - Fix the problem that empty segments cannot be merged after gc [#4511](https://github.com/pingcap/tiflash/issues/4511) - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) -+ PD - - - None. [#4805](https://github.com/tikv/pd/issues/4805) - - Fix the issue that the label distribution has residual labels [#4825](https://github.com/tikv/pd/issues/4825) - - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) + Tools From e984389c5928ac1457ef1b8cb4a4b384c3e5f841 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 9 May 2022 10:55:19 +0800 Subject: [PATCH 11/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 4 ---- 1 file changed, 4 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 460d9b52693d..588447093783 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -186,10 +186,6 @@ TiDB version: 5.4.1 - Support multi k8s in grafana dashboards [#32593](https://github.com/pingcap/tidb/issues/32593) - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32754](https://github.com/pingcap/tidb/issues/32754) -+ TiKV/TiKV - - - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) - - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) + PingCAP/TiFlash From 1728dba12d6f2be11fb228e87410fb01a6089c48 Mon Sep 17 00:00:00 2001 From: qiancai Date: Mon, 9 May 2022 11:24:24 +0800 Subject: [PATCH 12/45] apply comments from reviewers --- releases/release-5.4.1.md | 36 +++++++++++++++++++++++++++++++++++- 1 file changed, 35 insertions(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 588447093783..c1ece916bf40 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -26,10 +26,13 @@ TiDB version: 5.4.1 + TiDB - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) + - Add more debug information for `Apply` executor [#33887](https://github.com/pingcap/tidb/issues/33887) + - Improve the `TopN` pruning logic for analyze version 2 [#34256](https://github.com/pingcap/tidb/issues/34256) + - Support multi k8s in grafana dashboards [#32593](https://github.com/pingcap/tidb/issues/32593) + TiKV - - note 1 + - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + PD @@ -91,6 +94,12 @@ TiDB version: 5.4.1 - Fix the issue that BR not retry enough when region not consistency during restoration. [#33419](https://github.com/pingcap/tidb/issues/33419) - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) + - Fix a bug that the initial `TopN` of the table's statistics may not be correctly sorted [#34216](https://github.com/pingcap/tidb/issues/34216) + - Fix reading from `INFORMATION_SCHEMA.ATTRIBUTES` return error by skipping the unidentifiable table attributes [#33665](https://github.com/pingcap/tidb/issues/33665) + - Fix a bug that even though `@@tidb_enable_parallel_apply` is set, the apply operator is not paralleled when order property exists [#34237](https://github.com/pingcap/tidb/issues/34237) + - Fix a bug that '0000-00-00 00:00:00' can be inserted into a datetime column in spite of the `NO_ZERO_DATE` sql_mode restriction [#34099](https://github.com/pingcap/tidb/issues/34099) + - Fix query `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table cause TiDB server OOM, it can be triggered when checking slow query on the Dashboard [#33893](https://github.com/pingcap/tidb/issues/33893) + - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32754](https://github.com/pingcap/tidb/issues/32754) + TiKV @@ -104,6 +113,11 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + - Fix panic invalid assertion in resource metering. [#12234](https://github.com/tikv/tikv/issues/12234) + - Fix the issue that slow score calculation is inaccurate in corner cases. [#12254](https://github.com/tikv/tikv/issues/12254) + - Fix the oom issue caused by the resolved_ts module and add more metrics. [#12159](https://github.com/tikv/tikv/issues/12159) + - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) + - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) + PD @@ -132,11 +146,21 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the date format identifies `'\n'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) + - fix potential data corruption for large indices [#4778](https://github.com/pingcap/tiflash/issues/4778) + - Fix potential query error when select on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) + - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4192](https://github.com/pingcap/tiflash/issues/4192) + - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4414](https://github.com/pingcap/tiflash/issues/4414) + - Fix the problem that empty segments cannot be merged after gc [#4511](https://github.com/pingcap/tiflash/issues/4511) + Tools + Backup & Restore (BR) - (dup: release-5.2.4.md > Bug fixes> Tools> Backup & Restore (BR))- Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) + - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) + - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query.[#33322](https://github.com/pingcap/tidb/issues/33322) + - Fix a bug that caused region unbalanced after restoring.[#31034](https://github.com/pingcap/tidb/issues/31034) + - Fix the issue that BR not retry enough when region not consistency during restoration.[#33419](https://github.com/pingcap/tidb/issues/33419) + - Fix a bug that caused BR panics sometime when merge small file enabled.[#33801](https://github.com/pingcap/tidb/issues/33801) + TiCDC @@ -148,12 +172,18 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiCDC)- Fix the TiCDC panic issue that might occur when `Canal-JSON` incorrectly handles `string` [#4635](https://github.com/pingcap/tiflow/issues/4635) - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that MySQL sink generates duplicated `replace` SQL statements when `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) + - Fix the DML construct error issue caused by `rename tables` DDL [#5059](https://github.com/pingcap/tiflow/issues/5059) + - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default) [#4963](https://github.com/pingcap/tiflow/issues/4963) + - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) + - Fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4777](https://github.com/pingcap/tiflow/issues/4777) + - Fix checkpoint metrics when tables are being scheduled [#4714](https://github.com/pingcap/tiflow/issues/4714) + TiDB Lightning - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix the checksum error “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Lightning)- Fix the issue that TiDB Lightning gets stuck when it fails to check empty tables [#31797](https://github.com/pingcap/tidb/issues/31797) - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix the issue that Lightning precheck doesn't check local disk resources and cluster available.[#34213](https://github.com/pingcap/tidb/issues/34213) + Dumpling @@ -164,6 +194,10 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + - Fix the issue that manual execute the filtered DDL makes the task failed [#5272](https://github.com/pingcap/tiflow/issues/5272) + - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) + - Fix the issue that tracker panic when pk of downstream table orders behind [#5159](https://github.com/pingcap/tiflow/issues/5159) + - Fix the issue that CPU usage may increased and print large amount logs when GTID enabled and task auto resumed. [#5063](https://github.com/pingcap/tiflow/issues/5063) ## __unsorted From ed5e7cc189ab8feb02fb2fce8212e0604ecb1777 Mon Sep 17 00:00:00 2001 From: qiancai Date: Mon, 9 May 2022 11:27:56 +0800 Subject: [PATCH 13/45] remove empty and duplicated notes --- releases/release-5.4.1.md | 83 +-------------------------------------- 1 file changed, 2 insertions(+), 81 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index c1ece916bf40..2fe07650ab7e 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -36,11 +36,7 @@ TiDB version: 5.4.1 + PD - - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) - -+ TiDB Dashboard - - - note 1 + - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) + TiFlash @@ -48,23 +44,11 @@ TiDB version: 5.4.1 + Tools - + Backup & Restore (BR) - - - note 1 - + TiCDC - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Support multiple Kubernetes clusters in Grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) - + Dumpling - - - note 1 - - + TiDB Lightning - - - note 1 - + TiDB Data Migration (DM) - (dup: release-6.0.0-dmr.md > Improvements> Tools> TiDB Data Migration (DM))- Support Syncer using the working directory of the DM-worker rather than `/tmp` to write internal files, and cleaning the directory after the task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) @@ -185,10 +169,6 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the issue that Lightning precheck doesn't check local disk resources and cluster available.[#34213](https://github.com/pingcap/tidb/issues/34213) - + Dumpling - - - note 1 - + TiDB Data Migration (DM) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) @@ -197,63 +177,4 @@ TiDB version: 5.4.1 - Fix the issue that manual execute the filtered DDL makes the task failed [#5272](https://github.com/pingcap/tiflow/issues/5272) - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) - Fix the issue that tracker panic when pk of downstream table orders behind [#5159](https://github.com/pingcap/tiflow/issues/5159) - - Fix the issue that CPU usage may increased and print large amount logs when GTID enabled and task auto resumed. [#5063](https://github.com/pingcap/tiflow/issues/5063) - -## __unsorted - -+ PingCAP/TiDB - - - release-note [#33887](https://github.com/pingcap/tidb/issues/33887) - - release-note [#27937](https://github.com/pingcap/tidb/issues/27937) - - release-note [#34216](https://github.com/pingcap/tidb/issues/34216) - - release-note [#34256](https://github.com/pingcap/tidb/issues/34256) - - release-note [#33665](https://github.com/pingcap/tidb/issues/33665) - - release-note [#34237](https://github.com/pingcap/tidb/issues/34237) - - lightning: split and scatter regions in batches [#33618](https://github.com/pingcap/tidb/issues/33618) - - release-note [#32459](https://github.com/pingcap/tidb/issues/32459) - - release-note [#34099](https://github.com/pingcap/tidb/issues/34099) - - release-note [#34213](https://github.com/pingcap/tidb/issues/34213) - - release-note [#34180](https://github.com/pingcap/tidb/issues/34180) - - release-note [#34139](https://github.com/pingcap/tidb/pull/34139) - - release-note [#33801](https://github.com/pingcap/tidb/issues/33801) - - release-note [#33893](https://github.com/pingcap/tidb/issues/33893) - - Support multi k8s in grafana dashboards [#32593](https://github.com/pingcap/tidb/issues/32593) - - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32754](https://github.com/pingcap/tidb/issues/32754) - - -+ PingCAP/TiFlash - - - fix potential data corruption for large indices [#4778](https://github.com/pingcap/tiflash/issues/4778) - - Fix potential query error when select on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) - - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4192](https://github.com/pingcap/tiflash/issues/4192) - - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4414](https://github.com/pingcap/tiflash/issues/4414) - - Fix the problem that empty segments cannot be merged after gc [#4511](https://github.com/pingcap/tiflash/issues/4511) - - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) - - -+ Tools - - + PingCAP/TiCDC - - - `None`. [#4784](https://github.com/pingcap/tiflow/issues/4784) - - save table checkpoint after a DDL is filtered [#5272](https://github.com/pingcap/tiflow/issues/5272) - - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) - - `None`. [#5197](https://github.com/pingcap/tiflow/issues/5197) - - Fix a bug that checkpoint flushing will be called too frequently [#5063](https://github.com/pingcap/tiflow/issues/5063) - - fix tracker panic when pk of downstream table orders behind [#5159](https://github.com/pingcap/tiflow/issues/5159) - - `None`. [#5136](https://github.com/pingcap/tiflow/issues/5136) - - send one heartbeat for successive skipped GTID when enable relay log [#5063](https://github.com/pingcap/tiflow/issues/5063) - - fix DML construct error issue caused by `rename tables` DDL. [#5059](https://github.com/pingcap/tiflow/issues/5059) - - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default). [#4963](https://github.com/pingcap/tiflow/issues/4963) - - `None`. [#4858](https://github.com/pingcap/tiflow/issues/4858) - - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) - - fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4777](https://github.com/pingcap/tiflow/issues/4777) - - Fix checkpoint metrics when tables are being scheduled. [#4714](https://github.com/pingcap/tiflow/issues/4714) - - `None`. [#4554](https://github.com/pingcap/tiflow/issues/4554) - - Please add a release note. `None`. [#4565](https://github.com/pingcap/tiflow/issues/4565) - - `None`. [#4607](https://github.com/pingcap/tiflow/issues/4607) - - `None`. [#4588](https://github.com/pingcap/tiflow/issues/4588) - - `None`. [#4561](https://github.com/pingcap/tiflow/issues/4561) - - Please add a release note. If you don't think this PR needs a release note then fill it with `None`. [#4287](https://github.com/pingcap/tiflow/issues/4287) - - `None`. [#4128](https://github.com/pingcap/tiflow/issues/4128) - - None. [#4353](https://github.com/pingcap/tiflow/issues/4353) \ No newline at end of file + - Fix the issue that CPU usage may increased and print large amount logs when GTID enabled and task auto resumed. [#5063](https://github.com/pingcap/tiflow/issues/5063) \ No newline at end of file From 5664ac9c0276e220923186f104338ad39ee7e796 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Mon, 9 May 2022 16:41:30 +0800 Subject: [PATCH 14/45] Apply suggestions from code review Co-authored-by: 3pointer --- releases/release-5.4.1.md | 3 --- 1 file changed, 3 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 2fe07650ab7e..ea7727ee98df 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -69,13 +69,10 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) - - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) - Fix the issue that NewCollationEnable config not checked during restoration. [#33422](https://github.com/pingcap/tidb/issues/33422) - - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query. [#33322](https://github.com/pingcap/tidb/issues/33322) - - Fix the issue that BR not retry enough when region not consistency during restoration. [#33419](https://github.com/pingcap/tidb/issues/33419) - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) - Fix a bug that the initial `TopN` of the table's statistics may not be correctly sorted [#34216](https://github.com/pingcap/tidb/issues/34216) From e4c9ef3d016e3cef8d4ab517cdc13dd6112ed7ab Mon Sep 17 00:00:00 2001 From: qiancai Date: Mon, 9 May 2022 16:44:51 +0800 Subject: [PATCH 15/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index ea7727ee98df..837e127d692f 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -68,7 +68,6 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) - - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) @@ -142,6 +141,8 @@ TiDB version: 5.4.1 - Fix a bug that caused region unbalanced after restoring.[#31034](https://github.com/pingcap/tidb/issues/31034) - Fix the issue that BR not retry enough when region not consistency during restoration.[#33419](https://github.com/pingcap/tidb/issues/33419) - Fix a bug that caused BR panics sometime when merge small file enabled.[#33801](https://github.com/pingcap/tidb/issues/33801) + - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) + + TiCDC From 0f78c920148a78cb3320f263a13bc830b344e160 Mon Sep 17 00:00:00 2001 From: qiancai Date: Mon, 9 May 2022 17:11:20 +0800 Subject: [PATCH 16/45] remove #33422 --- releases/release-5.4.1.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 837e127d692f..70b10058a97c 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -71,7 +71,6 @@ TiDB version: 5.4.1 - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) - - Fix the issue that NewCollationEnable config not checked during restoration. [#33422](https://github.com/pingcap/tidb/issues/33422) - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) - Fix a bug that the initial `TopN` of the table's statistics may not be correctly sorted [#34216](https://github.com/pingcap/tidb/issues/34216) From be6b77618589db518d4dabb48c28b74d43ba0f76 Mon Sep 17 00:00:00 2001 From: qiancai Date: Mon, 9 May 2022 17:23:54 +0800 Subject: [PATCH 17/45] remove empty line --- releases/release-5.4.1.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 70b10058a97c..c0f0fb9c38a2 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -142,7 +142,6 @@ TiDB version: 5.4.1 - Fix a bug that caused BR panics sometime when merge small file enabled.[#33801](https://github.com/pingcap/tidb/issues/33801) - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) - + TiCDC - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) From 42495976f8cefc2fcab142da70961e408a180da3 Mon Sep 17 00:00:00 2001 From: Aolin Zhang Date: Tue, 10 May 2022 11:44:25 +0800 Subject: [PATCH 18/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index c0f0fb9c38a2..ac6544b8a3a5 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -32,11 +32,11 @@ TiDB version: 5.4.1 + TiKV - - metrics: support multi k8s in grafana dashboards. [#12104](https://github.com/tikv/tikv/issues/12104) + - Support monitoring multi-k8s in Grafana [#12104](https://github.com/tikv/tikv/issues/12104) + PD - - metrics: support multi-k8s in grafana dashboards [#4673](https://github.com/tikv/pd/issues/4673) + - Support monitoring multi-k8s in Grafana [#4673](https://github.com/tikv/pd/issues/4673) + TiFlash @@ -92,16 +92,16 @@ TiDB version: 5.4.1 - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - - Fix panic invalid assertion in resource metering. [#12234](https://github.com/tikv/tikv/issues/12234) - - Fix the issue that slow score calculation is inaccurate in corner cases. [#12254](https://github.com/tikv/tikv/issues/12254) - - Fix the oom issue caused by the resolved_ts module and add more metrics. [#12159](https://github.com/tikv/tikv/issues/12159) - - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors. [#34066](https://github.com/pingcap/tidb/issues/34066) + - Fix panic invalid assertion in resource metering [#12234](https://github.com/tikv/tikv/issues/12234) + - Fix the issue that slow score calculation is inaccurate in corner cases [#12254](https://github.com/tikv/tikv/issues/12254) + - Fix the OOM issue caused by the resolved_ts module and add more metrics [#12159](https://github.com/tikv/tikv/issues/12159) + - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors [#34066](https://github.com/pingcap/tidb/issues/34066) - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) + PD - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) - -Fix the issue that when there exists a store with more than a big free disk(2T for example) no balance operator generated even when one or more stores with its disk full. [#4805](https://github.com/tikv/pd/issues/4805) + - Fix the issue that when there exists a store with more than a big free disk (2T for example) no balance operator generated even when one or more stores with its disk full [#4805](https://github.com/tikv/pd/issues/4805) - Fix the issue that in the metrics the label distribution has residual labels [#4825](https://github.com/tikv/pd/issues/4825) + TiFlash From f2de9d4856ce60103ca99e4e1852263ee7852ac7 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 10 May 2022 12:16:59 +0800 Subject: [PATCH 19/45] Apply suggestions from code review --- releases/release-5.4.1.md | 27 ++++++++++++++------------- 1 file changed, 14 insertions(+), 13 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index ac6544b8a3a5..7ef5cf50114d 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -27,8 +27,9 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) - Add more debug information for `Apply` executor [#33887](https://github.com/pingcap/tidb/issues/33887) - - Improve the `TopN` pruning logic for analyze version 2 [#34256](https://github.com/pingcap/tidb/issues/34256) - - Support multi k8s in grafana dashboards [#32593](https://github.com/pingcap/tidb/issues/32593) + - Improve the `TopN` pruning logic for Analyze Version 2 used for +collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#32593](https://github.com/pingcap/tidb/issues/32593) + TiKV @@ -68,17 +69,17 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) - - Fix the issue that privilege-related operations may fail for upgraded clusters. [#33588](https://github.com/pingcap/tidb/issues/33588) - - fix bug #33509 [#33509](https://github.com/pingcap/tidb/issues/33509) - - fix a bug that compress function may report error [#33397](https://github.com/pingcap/tidb/issues/33397) - - Fix the problem of high use of reArrangeFallback cpu. [#30353](https://github.com/pingcap/tidb/issues/30353) - - Fix the issue that the table attributes don't support index and won't be updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) - - Fix a bug that the initial `TopN` of the table's statistics may not be correctly sorted [#34216](https://github.com/pingcap/tidb/issues/34216) - - Fix reading from `INFORMATION_SCHEMA.ATTRIBUTES` return error by skipping the unidentifiable table attributes [#33665](https://github.com/pingcap/tidb/issues/33665) - - Fix a bug that even though `@@tidb_enable_parallel_apply` is set, the apply operator is not paralleled when order property exists [#34237](https://github.com/pingcap/tidb/issues/34237) - - Fix a bug that '0000-00-00 00:00:00' can be inserted into a datetime column in spite of the `NO_ZERO_DATE` sql_mode restriction [#34099](https://github.com/pingcap/tidb/issues/34099) - - Fix query `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table cause TiDB server OOM, it can be triggered when checking slow query on the Dashboard [#33893](https://github.com/pingcap/tidb/issues/33893) - - Fix the bug that locking with NOWAIT does not return immediately when encountering a lock. [#32754](https://github.com/pingcap/tidb/issues/32754) + - Fix the issue that granting the `all` privilege might fail in clusters that are upgraded from v4.0 [#33588](https://github.com/pingcap/tidb/issues/33588) + - Fix the issue of session panic that occurs when executing the prepared statement after table schema change with the MySQL binary protocol [#33509](https://github.com/pingcap/tidb/issues/33509) + - Fix the issue that executing SQL statements that have the `compress()` expression with `tidb_enable_vectorized_expression` enabled will fail [#33397](https://github.com/pingcap/tidb/issues/33397) + - Fix the issue of high CPU usage by the `reArrangeFallback` function [#30353](https://github.com/pingcap/tidb/issues/30353) + - Fix the issue that the table attributes are not indexed when a new partition is added and the issue that the table range information are not updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) + - Fix a bug that the `TopN` statistical information of a table during the initialization is not correctly sorted [#34216](https://github.com/pingcap/tidb/issues/34216) + - Fix the error reporting that occurs when reading from the `INFORMATION_SCHEMA.ATTRIBUTES` table by skipping the unidentifiable table attributes [#33665](https://github.com/pingcap/tidb/issues/33665) + - Fix a bug that even if `@@tidb_enable_parallel_apply` is set, the `Apply` operator is not paralleled when an `order` property exists [#34237](https://github.com/pingcap/tidb/issues/34237) + - Fix a bug that `'0000-00-00 00:00:00'` can be inserted into a `datetime` column despite of the `NO_ZERO_DATE` sql_mode restriction [#34099](https://github.com/pingcap/tidb/issues/34099) + - Fix the issue that the TiDB server might run out of memory when querying the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table. This issue can be triggered when you check slow queries on the Grafana dashboard. [#33893](https://github.com/pingcap/tidb/issues/33893) + - Fix a bug that in the `NOWAIT` statement, a transaction being executed does not return immediately when encountering a lock [#32754](https://github.com/pingcap/tidb/issues/32754) + TiKV From b56dfe754620f331aed3bde7ba43d999ea82f0f8 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Tue, 10 May 2022 14:33:31 +0800 Subject: [PATCH 20/45] Apply suggestions from code review --- releases/release-5.4.1.md | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 7ef5cf50114d..0013b8827a66 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -41,7 +41,7 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + TiFlash - - metrics: support multi-k8s in grafana dashboards [#4129](https://github.com/pingcap/tiflash/issues/4129) + - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#4129](https://github.com/pingcap/tiflash/issues/4129) + Tools @@ -126,22 +126,22 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the date format identifies `'\n'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) - - fix potential data corruption for large indices [#4778](https://github.com/pingcap/tiflash/issues/4778) - - Fix potential query error when select on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) - - Fix bug that TiFlash query will meet keepalive timeout error randomly. [#4192](https://github.com/pingcap/tiflash/issues/4192) - - Avoid leaving data on tiflash node which doesn't corresponding to any region range [#4414](https://github.com/pingcap/tiflash/issues/4414) - - Fix the problem that empty segments cannot be merged after gc [#4511](https://github.com/pingcap/tiflash/issues/4511) + - Fix potential data corruption in DTFiles [#4778](https://github.com/pingcap/tiflash/issues/4778) + - Fix potential query errors when selecting on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) + - Fix a bug that TiFlash reports keepalive timeout errors randomly [#4192](https://github.com/pingcap/tiflash/issues/4192) + - Fix a bug that data not matching any region range remains on a TiFlash node [#4414](https://github.com/pingcap/tiflash/issues/4414) + - Fix a bug that empty segments cannot be merged after GC [#4511](https://github.com/pingcap/tiflash/issues/4511) + Tools + Backup & Restore (BR) - (dup: release-5.2.4.md > Bug fixes> Tools> Backup & Restore (BR))- Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) - - Fix a bug of duplicate primary key when insert record into table after incremental restoration. [#33596](https://github.com/pingcap/tidb/issues/33596) - - Fix a bug that BR incremental restore return error by mistake caused by ddl job with empty query.[#33322](https://github.com/pingcap/tidb/issues/33322) - - Fix a bug that caused region unbalanced after restoring.[#31034](https://github.com/pingcap/tidb/issues/31034) - - Fix the issue that BR not retry enough when region not consistency during restoration.[#33419](https://github.com/pingcap/tidb/issues/33419) - - Fix a bug that caused BR panics sometime when merge small file enabled.[#33801](https://github.com/pingcap/tidb/issues/33801) - - Fix the issue that the schedulers won't be resumed after BR/Lightning exits abnormally. [#33546](https://github.com/pingcap/tidb/issues/33546) + - Fix duplicate primary keys when inserting a record into a table after incremental restoration [#33596](https://github.com/pingcap/tidb/issues/33596) + - Fix a bug that BR incremental restore returns errors mistakenly due to DDL jobs with empty query [#33322](https://github.com/pingcap/tidb/issues/33322) + - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) + - Fix the issue that BR does not retry enough when Regions are not consistent during restoration [#33419](https://github.com/pingcap/tidb/issues/33419) + - Fix BR panic that occurs occasionally when merging small file is enabled [#33801](https://github.com/pingcap/tidb/issues/33801) + - Fix the issue that schedulers do not resume after BR or TiDB Lightning exits abnormally [#33546](https://github.com/pingcap/tidb/issues/33546) + TiCDC From 0dec9563372f3381b7e2cc49f9d793ee9d4fe0f7 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 10 May 2022 15:10:53 +0800 Subject: [PATCH 21/45] Apply suggestions from code review --- releases/release-5.4.1.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 0013b8827a66..4bf754cfd15c 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -58,6 +58,12 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + TiDB +- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) +- (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) +- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) +- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) +- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets the wrong result when using TiFlash to scan tables with empty range although TiFlash does not support reading tables with empty range yet [#33083](https://github.com/pingcap/tidb/issues/33083) +- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the `MAX` or `MIN` function on the `ENUM` or `SET` column returns a wrong result when the new collation is enabled in TiDB [#31638](https://github.com/pingcap/tidb/issues/31638) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) @@ -80,6 +86,8 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Fix a bug that `'0000-00-00 00:00:00'` can be inserted into a `datetime` column despite of the `NO_ZERO_DATE` sql_mode restriction [#34099](https://github.com/pingcap/tidb/issues/34099) - Fix the issue that the TiDB server might run out of memory when querying the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table. This issue can be triggered when you check slow queries on the Grafana dashboard. [#33893](https://github.com/pingcap/tidb/issues/33893) - Fix a bug that in the `NOWAIT` statement, a transaction being executed does not return immediately when encountering a lock [#32754](https://github.com/pingcap/tidb/issues/32754) + - Fix a bug that cause creating table with `GBK` charset and `gbk_bin` collation fail [#31308](Can't create GBK table with collation · Issue #31308 · pingcap/tidb) + - Fix bug that when `enable-new-charset` is `on`, creating a `GBK` charset table with collation fail with error "Unknown character set" [#31297](br restore failed with "Unknown character set: 'gbk'" if table CHARSET=gbk · Issue #31297 · pingcap/) + TiKV From 62a96eaec8979d494c3d449ec0e166a6c47a3fd4 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 10 May 2022 15:11:32 +0800 Subject: [PATCH 22/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 4bf754cfd15c..0ddf39c52886 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -58,12 +58,12 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + TiDB -- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) -- (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) -- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) -- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) -- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets the wrong result when using TiFlash to scan tables with empty range although TiFlash does not support reading tables with empty range yet [#33083](https://github.com/pingcap/tidb/issues/33083) -- (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the `MAX` or `MIN` function on the `ENUM` or `SET` column returns a wrong result when the new collation is enabled in TiDB [#31638](https://github.com/pingcap/tidb/issues/31638) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets the wrong result when using TiFlash to scan tables with empty range although TiFlash does not support reading tables with empty range yet [#33083](https://github.com/pingcap/tidb/issues/33083) + - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the `MAX` or `MIN` function on the `ENUM` or `SET` column returns a wrong result when the new collation is enabled in TiDB [#31638](https://github.com/pingcap/tidb/issues/31638) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) From 96b09e4da3d93cc7ece4cae5e089534ec26c6ec5 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 10 May 2022 15:26:22 +0800 Subject: [PATCH 23/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 0ddf39c52886..96f87c1e44ad 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -86,8 +86,8 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Fix a bug that `'0000-00-00 00:00:00'` can be inserted into a `datetime` column despite of the `NO_ZERO_DATE` sql_mode restriction [#34099](https://github.com/pingcap/tidb/issues/34099) - Fix the issue that the TiDB server might run out of memory when querying the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table. This issue can be triggered when you check slow queries on the Grafana dashboard. [#33893](https://github.com/pingcap/tidb/issues/33893) - Fix a bug that in the `NOWAIT` statement, a transaction being executed does not return immediately when encountering a lock [#32754](https://github.com/pingcap/tidb/issues/32754) - - Fix a bug that cause creating table with `GBK` charset and `gbk_bin` collation fail [#31308](Can't create GBK table with collation · Issue #31308 · pingcap/tidb) - - Fix bug that when `enable-new-charset` is `on`, creating a `GBK` charset table with collation fail with error "Unknown character set" [#31297](br restore failed with "Unknown character set: 'gbk'" if table CHARSET=gbk · Issue #31297 · pingcap/) + - Fix a bug that causes a failure when creating a table with the `GBK` charset and `gbk_bin` collation [#31308](https://github.com/pingcap/tidb/issues/31308) + - Fix a bug that when `enable-new-charset` is `on`, creating a `GBK` charset table with collation fails with the "Unknown character set" error [#31297](https://github.com/pingcap/tidb/issues/31297) + TiKV From 34284dc4e47a07b6afe126c0a86321036cd5df33 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Tue, 10 May 2022 15:56:30 +0800 Subject: [PATCH 24/45] Apply suggestions from code review --- releases/release-5.4.1.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 96f87c1e44ad..5172f95f308d 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -59,7 +59,6 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + TiDB - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets the wrong result when using TiFlash to scan tables with empty range although TiFlash does not support reading tables with empty range yet [#33083](https://github.com/pingcap/tidb/issues/33083) @@ -143,6 +142,8 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + Tools + Backup & Restore (BR) + + - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> Backup & Restore (BR))- Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) - (dup: release-5.2.4.md > Bug fixes> Tools> Backup & Restore (BR))- Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) - Fix duplicate primary keys when inserting a record into a table after incremental restoration [#33596](https://github.com/pingcap/tidb/issues/33596) - Fix a bug that BR incremental restore returns errors mistakenly due to DDL jobs with empty query [#33322](https://github.com/pingcap/tidb/issues/33322) From b773c78910b0d3e23e1294adfa9911f8065a02a2 Mon Sep 17 00:00:00 2001 From: Aolin Date: Tue, 10 May 2022 16:14:31 +0800 Subject: [PATCH 25/45] Apply suggestions from code review --- releases/release-5.4.1.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 5172f95f308d..cd859ab4b355 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -33,11 +33,11 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + TiKV - - Support monitoring multi-k8s in Grafana [#12104](https://github.com/tikv/tikv/issues/12104) + - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#12104](https://github.com/tikv/tikv/issues/12104) + PD - - Support monitoring multi-k8s in Grafana [#4673](https://github.com/tikv/pd/issues/4673) + - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#4673](https://github.com/tikv/pd/issues/4673) + TiFlash From 814994847a27e0139224222f1a154b7872f0b19d Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Tue, 10 May 2022 16:17:33 +0800 Subject: [PATCH 26/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index cd859ab4b355..c45ebd33a2ac 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -162,11 +162,11 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiCDC)- Fix the TiCDC panic issue that might occur when `Canal-JSON` incorrectly handles `string` [#4635](https://github.com/pingcap/tiflow/issues/4635) - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that MySQL sink generates duplicated `replace` SQL statements when `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - - Fix the DML construct error issue caused by `rename tables` DDL [#5059](https://github.com/pingcap/tiflow/issues/5059) - - Fix a rare likelihood that replication be stuck if the owner is changed when the new scheduler is enabled (disabled by default) [#4963](https://github.com/pingcap/tiflow/issues/4963) - - Fix ErrProcessorDuplicateOperations when new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) - - Fix the issue that ticdc failed to start when connects to multiple pd endpoints with tls-enabled and the 1st endpoint is not available [#4777](https://github.com/pingcap/tiflow/issues/4777) - - Fix checkpoint metrics when tables are being scheduled [#4714](https://github.com/pingcap/tiflow/issues/4714) + - Fix the DML construct error caused by the `rename tables` DDL [#5059](https://github.com/pingcap/tiflow/issues/5059) + - Fix the issue that in rare cases replication can be stuck if the owner is changed and the new scheduler is enabled (disabled by default) [#4963](https://github.com/pingcap/tiflow/issues/4963) + - Fix the issue that the error ErrProcessorDuplicateOperations is reported when the new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) + - Fix the issue that TiCDC fails to start when the first PD set in `--pd` is not available after TLS is enabled [#4777](https://github.com/pingcap/tiflow/issues/4777) + - Fix the issue that the checkpoint metrics is missing when tables are being scheduled [#4714](https://github.com/pingcap/tiflow/issues/4714) + TiDB Lightning From 76fbbf0e7e82441f9b97696bf636cf2fb2132910 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Tue, 10 May 2022 19:11:46 +0800 Subject: [PATCH 27/45] Apply suggestions from code review Co-authored-by: xixirangrang --- releases/release-5.4.1.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index c45ebd33a2ac..e02329884287 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -134,8 +134,8 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) - Fix potential data corruption in DTFiles [#4778](https://github.com/pingcap/tiflash/issues/4778) - - Fix potential query errors when selecting on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) - - Fix a bug that TiFlash reports keepalive timeout errors randomly [#4192](https://github.com/pingcap/tiflash/issues/4192) + - Fix potential errors when querying on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) + - Fix a bug that TiFlash reports many "Keepalive watchdog fired" errors randomly [#4192](https://github.com/pingcap/tiflash/issues/4192) - Fix a bug that data not matching any region range remains on a TiFlash node [#4414](https://github.com/pingcap/tiflash/issues/4414) - Fix a bug that empty segments cannot be merged after GC [#4511](https://github.com/pingcap/tiflash/issues/4511) @@ -148,8 +148,8 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Fix duplicate primary keys when inserting a record into a table after incremental restoration [#33596](https://github.com/pingcap/tidb/issues/33596) - Fix a bug that BR incremental restore returns errors mistakenly due to DDL jobs with empty query [#33322](https://github.com/pingcap/tidb/issues/33322) - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) - - Fix the issue that BR does not retry enough when Regions are not consistent during restoration [#33419](https://github.com/pingcap/tidb/issues/33419) - - Fix BR panic that occurs occasionally when merging small file is enabled [#33801](https://github.com/pingcap/tidb/issues/33801) + - Fix the issue that BR does not retry enough times when Regions are not consistent during restoration [#33419](https://github.com/pingcap/tidb/issues/33419) + - Fix the issue that BR might panic occasionally when merging small files is enabled [#33801](https://github.com/pingcap/tidb/issues/33801) - Fix the issue that schedulers do not resume after BR or TiDB Lightning exits abnormally [#33546](https://github.com/pingcap/tidb/issues/33546) + TiCDC From 97f20e1abd76bc891636b46d46d460bbeee97608 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 10 May 2022 20:29:31 +0800 Subject: [PATCH 28/45] Update releases/release-5.4.1.md Co-authored-by: Aolin --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index e02329884287..719c28fabf18 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -180,7 +180,7 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - - Fix the issue that manual execute the filtered DDL makes the task failed [#5272](https://github.com/pingcap/tiflow/issues/5272) + - Fix the issue that in some cases manually executing the filtered DDL in the downstream might cause task resumption failure [#5272](https://github.com/pingcap/tiflow/issues/5272) - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) - Fix the issue that tracker panic when pk of downstream table orders behind [#5159](https://github.com/pingcap/tiflow/issues/5159) - Fix the issue that CPU usage may increased and print large amount logs when GTID enabled and task auto resumed. [#5063](https://github.com/pingcap/tiflow/issues/5063) \ No newline at end of file From 6f38ff23de6eb9eab1847246f39751ed519732f2 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 10 May 2022 20:30:59 +0800 Subject: [PATCH 29/45] Apply suggestions from code review --- releases/release-5.4.1.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 719c28fabf18..42eb054280fd 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -173,7 +173,7 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix the checksum error “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Lightning)- Fix the issue that TiDB Lightning gets stuck when it fails to check empty tables [#31797](https://github.com/pingcap/tidb/issues/31797) - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - - Fix the issue that Lightning precheck doesn't check local disk resources and cluster available.[#34213](https://github.com/pingcap/tidb/issues/34213) + - Fix the issue that the precheck does not check local disk resources and cluster availability [#34213](https://github.com/pingcap/tidb/issues/34213) + TiDB Data Migration (DM) @@ -181,6 +181,6 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - Fix the issue that in some cases manually executing the filtered DDL in the downstream might cause task resumption failure [#5272](https://github.com/pingcap/tiflow/issues/5272) - - Fix a bug that no data is return by `query-status` when upstream doesn't turn on binlog [#5121](https://github.com/pingcap/tiflow/issues/5121) - - Fix the issue that tracker panic when pk of downstream table orders behind [#5159](https://github.com/pingcap/tiflow/issues/5159) - - Fix the issue that CPU usage may increased and print large amount logs when GTID enabled and task auto resumed. [#5063](https://github.com/pingcap/tiflow/issues/5063) \ No newline at end of file + - Fix a bug that no data is returned for the `query-status` command when binlog is not enabled in the upstream [#5121](https://github.com/pingcap/tiflow/issues/5121) + - Fix the DM worker panic issue that occurs when the primary key is not first in the index returned by the `SHOW CREATE TABLE` statement [#5159](https://github.com/pingcap/tiflow/issues/5159) + - Fix the issue that CPU usage may increase and a large amount of log is printed when GTID is enabled or when the task is automatically resumed [#5063](https://github.com/pingcap/tiflow/issues/5063) \ No newline at end of file From 33bd1ca20fd5038a88da0cbf3c2cb559877e9fb7 Mon Sep 17 00:00:00 2001 From: Aolin Date: Tue, 10 May 2022 20:57:37 +0800 Subject: [PATCH 30/45] Apply suggestions from code review --- releases/release-5.4.1.md | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 42eb054280fd..3e014c3e68e1 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -100,17 +100,17 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - - Fix panic invalid assertion in resource metering [#12234](https://github.com/tikv/tikv/issues/12234) - - Fix the issue that slow score calculation is inaccurate in corner cases [#12254](https://github.com/tikv/tikv/issues/12254) - - Fix the OOM issue caused by the resolved_ts module and add more metrics [#12159](https://github.com/tikv/tikv/issues/12159) - - Fix that successfully committed optimistic transactions may report false WriteConflict on network errors [#34066](https://github.com/pingcap/tidb/issues/34066) - - Fix panicking when replica read is enabled and there is a long time network condition [#12046](https://github.com/tikv/tikv/issues/12046) + - Fix the panic issue caused by invalid assertion in resource metering [#12234](https://github.com/tikv/tikv/issues/12234) + - Fix the issue that slow score calculation is inaccurate in some corner cases [#12254](https://github.com/tikv/tikv/issues/12254) + - Fix the OOM issue caused by the `resolved_ts` module and add more metrics [#12159](https://github.com/tikv/tikv/issues/12159) + - Fix the issue that successfully committed optimistic transactions may report the `Write Conflict` error when the network is poor [#34066](https://github.com/pingcap/tidb/issues/34066) + - Fix the TiKV panic issue that occurs when replica read is enabled on a poor network [#12046](https://github.com/tikv/tikv/issues/12046) + PD - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) - Fix the issue that when there exists a store with more than a big free disk (2T for example) no balance operator generated even when one or more stores with its disk full [#4805](https://github.com/tikv/pd/issues/4805) - - Fix the issue that in the metrics the label distribution has residual labels [#4825](https://github.com/tikv/pd/issues/4825) + - Fix the issue that the label distribution has residual labels in the metrics [#4825](https://github.com/tikv/pd/issues/4825) + TiFlash From 3ef54baa00a824c26024d58e56e8b609e96d55d1 Mon Sep 17 00:00:00 2001 From: Aolin Date: Wed, 11 May 2022 14:26:10 +0800 Subject: [PATCH 31/45] Apply suggestions from code review --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 3e014c3e68e1..33a6c0c6dd2d 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -109,7 +109,7 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + PD - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) - - Fix the issue that when there exists a store with more than a big free disk (2T for example) no balance operator generated even when one or more stores with its disk full [#4805](https://github.com/tikv/pd/issues/4805) + - Fix the issue that when there exists a Store with large capacity (2T for example), fully allocated small Stores cannot be detected, which results in no balance operator being generated [#4805](https://github.com/tikv/pd/issues/4805) - Fix the issue that the label distribution has residual labels in the metrics [#4825](https://github.com/tikv/pd/issues/4825) + TiFlash From 04420a6bdb2234e118be8d2a29b9743517ed1443 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Thu, 12 May 2022 08:57:37 +0800 Subject: [PATCH 32/45] Apply suggestions from code review Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 33a6c0c6dd2d..517c90df5c6d 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -26,7 +26,7 @@ TiDB version: 5.4.1 + TiDB - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) - - Add more debug information for `Apply` executor [#33887](https://github.com/pingcap/tidb/issues/33887) + - Add more logs and metrics for the `Apply` operator to show whether it is parallel [#33887](https://github.com/pingcap/tidb/issues/33887) - Improve the `TopN` pruning logic for Analyze Version 2 used for collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#32593](https://github.com/pingcap/tidb/issues/32593) From 6e9fca736c6eba87d9e9e55e426c4c7f8e73d0d1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 12 May 2022 09:46:00 +0800 Subject: [PATCH 33/45] Apply suggestions from code review Co-authored-by: Grace Cai --- releases/release-5.4.1.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 517c90df5c6d..03d4219a0fff 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -75,15 +75,15 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) - Fix the issue that granting the `all` privilege might fail in clusters that are upgraded from v4.0 [#33588](https://github.com/pingcap/tidb/issues/33588) - - Fix the issue of session panic that occurs when executing the prepared statement after table schema change with the MySQL binary protocol [#33509](https://github.com/pingcap/tidb/issues/33509) + - Fix the session panic that occurs when executing the prepared statement after table schema change with the MySQL binary protocol [#33509](https://github.com/pingcap/tidb/issues/33509) - Fix the issue that executing SQL statements that have the `compress()` expression with `tidb_enable_vectorized_expression` enabled will fail [#33397](https://github.com/pingcap/tidb/issues/33397) - Fix the issue of high CPU usage by the `reArrangeFallback` function [#30353](https://github.com/pingcap/tidb/issues/30353) - - Fix the issue that the table attributes are not indexed when a new partition is added and the issue that the table range information are not updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) + - Fix the issue that the table attributes are not indexed when a new partition is added and the issue that the table range information is not updated when the partition changes [#33929](https://github.com/pingcap/tidb/issues/33929) - Fix a bug that the `TopN` statistical information of a table during the initialization is not correctly sorted [#34216](https://github.com/pingcap/tidb/issues/34216) - - Fix the error reporting that occurs when reading from the `INFORMATION_SCHEMA.ATTRIBUTES` table by skipping the unidentifiable table attributes [#33665](https://github.com/pingcap/tidb/issues/33665) + - Fix the error that occurs when reading from the `INFORMATION_SCHEMA.ATTRIBUTES` table by skipping the unidentifiable table attributes [#33665](https://github.com/pingcap/tidb/issues/33665) - Fix a bug that even if `@@tidb_enable_parallel_apply` is set, the `Apply` operator is not paralleled when an `order` property exists [#34237](https://github.com/pingcap/tidb/issues/34237) - - Fix a bug that `'0000-00-00 00:00:00'` can be inserted into a `datetime` column despite of the `NO_ZERO_DATE` sql_mode restriction [#34099](https://github.com/pingcap/tidb/issues/34099) - - Fix the issue that the TiDB server might run out of memory when querying the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table. This issue can be triggered when you check slow queries on the Grafana dashboard. [#33893](https://github.com/pingcap/tidb/issues/33893) + - Fix a bug that `'0000-00-00 00:00:00'` can be inserted into a `datetime` column when `sql_mode` is set to `NO_ZERO_DATE` [#34099](https://github.com/pingcap/tidb/issues/34099) + - Fix the issue that the TiDB server might run out of memory when the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table is queried. This issue can be triggered when you check slow queries on the Grafana dashboard. [#33893](https://github.com/pingcap/tidb/issues/33893) - Fix a bug that in the `NOWAIT` statement, a transaction being executed does not return immediately when encountering a lock [#32754](https://github.com/pingcap/tidb/issues/32754) - Fix a bug that causes a failure when creating a table with the `GBK` charset and `gbk_bin` collation [#31308](https://github.com/pingcap/tidb/issues/31308) - Fix a bug that when `enable-new-charset` is `on`, creating a `GBK` charset table with collation fails with the "Unknown character set" error [#31297](https://github.com/pingcap/tidb/issues/31297) From 0472e57774a161df711808a5de6c2a9de297ac5c Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 12 May 2022 12:08:38 +0800 Subject: [PATCH 34/45] remove repeated #3902 and #4098 --- releases/release-5.4.1.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 03d4219a0fff..8d9bafd23ed4 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -117,13 +117,11 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix possible metadata corruption caused by Region merge on a lagging Region peer [#4437](https://github.com/pingcap/tiflash/issues/4437) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that a query containing `JOIN` might be hung if an error occurs [#4195](https://github.com/pingcap/tiflash/issues/4195) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix a bug that MPP tasks might leak threads forever [#4238](https://github.com/pingcap/tiflash/issues/4238) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the overflow that occurs when casting `FLOAT` to `DECIMAL` [#3998](https://github.com/pingcap/tiflash/issues/3998) - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue that expired data is recycled slowly [#4146](https://github.com/pingcap/tiflash/issues/4146) - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix a bug that canceled MPP queries might cause tasks to hang forever when the local tunnel is enabled [#4229](https://github.com/pingcap/tiflash/issues/4229) - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue of memory leak that occurs when a query is canceled [#4098](https://github.com/pingcap/tiflash/issues/4098) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue of memory leak that occurs when a query is canceled [#4098](https://github.com/pingcap/tiflash/issues/4098) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the wrong result that occurs when casting `DATETIME` to `DECIMAL` [#4151](https://github.com/pingcap/tiflash/issues/4151) - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the potential issue of TiFlash panic when `Snapshot` is applied simultaneously with multiple DDL operations [#4072](https://github.com/pingcap/tiflash/issues/4072) - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the bug that invalid storage directory configurations lead to unexpected behaviors [#4093](https://github.com/pingcap/tiflash/issues/4093) From c4859634d31024f359b433f8560223089e9b69f9 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 12 May 2022 12:11:49 +0800 Subject: [PATCH 35/45] fix grammar --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 8d9bafd23ed4..7bcba4d72b42 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -164,7 +164,7 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Fix the issue that in rare cases replication can be stuck if the owner is changed and the new scheduler is enabled (disabled by default) [#4963](https://github.com/pingcap/tiflow/issues/4963) - Fix the issue that the error ErrProcessorDuplicateOperations is reported when the new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) - Fix the issue that TiCDC fails to start when the first PD set in `--pd` is not available after TLS is enabled [#4777](https://github.com/pingcap/tiflow/issues/4777) - - Fix the issue that the checkpoint metrics is missing when tables are being scheduled [#4714](https://github.com/pingcap/tiflow/issues/4714) + - Fix the issue that the checkpoint metrics are missing when tables are being scheduled [#4714](https://github.com/pingcap/tiflow/issues/4714) + TiDB Lightning From e60ea09f13a4b53f1ec12e93181637bb19840c7a Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 12 May 2022 12:13:38 +0800 Subject: [PATCH 36/45] fix jenkins --- releases/release-5.4.1.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 7bcba4d72b42..0c66f015c4b1 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -1,8 +1,6 @@ --- title: TiDB 5.4.1 Release Notes --- - - # TiDB 5.4.1 Release Notes Release Date: May xx, 2022 From 5f94f0cf8c81141792bb9bc7be7655fa85500e68 Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 12 May 2022 14:26:56 +0800 Subject: [PATCH 37/45] move #32232 to compatibility changes --- releases/release-5.4.1.md | 11 ++--------- releases/release-timeline.md | 2 +- 2 files changed, 3 insertions(+), 10 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 0c66f015c4b1..7e4f212d2c21 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -3,7 +3,7 @@ title: TiDB 5.4.1 Release Notes --- # TiDB 5.4.1 Release Notes -Release Date: May xx, 2022 +Release Date: May 13, 2022 TiDB version: 5.4.1 @@ -11,13 +11,7 @@ TiDB version: 5.4.1 + TiDB - - note 1 - - note 2 - -+ TiKV - - - note 1 - - note 2 + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) ## Improvements @@ -64,7 +58,6 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) - (dup: release-5.3.1.md > Bug fixes> TiDB)- Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) diff --git a/releases/release-timeline.md b/releases/release-timeline.md index 749c79f27ca3..452bac6cde0c 100644 --- a/releases/release-timeline.md +++ b/releases/release-timeline.md @@ -9,7 +9,7 @@ This document shows all the released TiDB versions in reverse chronological orde | Version | Release Date | | :--- | :--- | -| [5.4.1](/releases/release-5.4.1.md) | 2022-05-xx | +| [5.4.1](/releases/release-5.4.1.md) | 2022-05-13 | | [5.2.4](/releases/release-5.2.4.md) | 2022-04-26 | | [6.0.0-DMR](/releases/release-6.0.0-dmr.md) | 2022-04-07 | | [5.3.1](/releases/release-5.3.1.md) | 2022-03-03 | From 6180201366227e7f0f76627e8614082ecb572207 Mon Sep 17 00:00:00 2001 From: shichun-0415 <89768198+shichun-0415@users.noreply.github.com> Date: Thu, 12 May 2022 18:53:22 +0800 Subject: [PATCH 38/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 1 + 1 file changed, 1 insertion(+) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 7e4f212d2c21..fe58e88f692d 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -1,6 +1,7 @@ --- title: TiDB 5.4.1 Release Notes --- + # TiDB 5.4.1 Release Notes Release Date: May 13, 2022 From 4d611df4a0ad19a33f0fac72c0dc278ff171f286 Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 12 May 2022 23:13:01 +0800 Subject: [PATCH 39/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 8 +++----- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index fe58e88f692d..22bbc376a51a 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -10,9 +10,7 @@ TiDB version: 5.4.1 ## Compatibility changes -+ TiDB - - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) +TiDB v5.4.1 does not introduce any compatibility changes in product design. But note that bug fixes in this release might result in compatibility changes too. For more information, see [Bug Fixes](#bug-fixes). ## Improvements @@ -20,8 +18,7 @@ TiDB version: 5.4.1 - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) - Add more logs and metrics for the `Apply` operator to show whether it is parallel [#33887](https://github.com/pingcap/tidb/issues/33887) - - Improve the `TopN` pruning logic for Analyze Version 2 used for -collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + - Improve the `TopN` pruning logic for Analyze Version 2 used for collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#32593](https://github.com/pingcap/tidb/issues/32593) + TiKV @@ -51,6 +48,7 @@ collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) + TiDB + - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) From ecb10437b902b31c7980071a1316ffd7b3a309f8 Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 12 May 2022 23:14:12 +0800 Subject: [PATCH 40/45] remove the dup indicators --- releases/release-5.4.1.md | 128 +++++++++++++++++++------------------- 1 file changed, 64 insertions(+), 64 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 22bbc376a51a..48e1afc08563 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -16,7 +16,7 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + TiDB - - (dup: release-6.0.0-dmr.md > Improvements> TiDB)- Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) + - Support using the PointGet plan for queries that read the `_tidb_rowid` column [#31543](https://github.com/pingcap/tidb/issues/31543) - Add more logs and metrics for the `Apply` operator to show whether it is parallel [#33887](https://github.com/pingcap/tidb/issues/33887) - Improve the `TopN` pruning logic for Analyze Version 2 used for collecting statistics [#34256](https://github.com/pingcap/tidb/issues/34256) - Support displaying multiple Kubernetes clusters in the Grafana dashboard [#32593](https://github.com/pingcap/tidb/issues/32593) @@ -37,33 +37,33 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + TiCDC - - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Support multiple Kubernetes clusters in Grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) - - (dup: release-5.2.4.md > Improvements> Tools> TiCDC)- Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) + - Support multiple Kubernetes clusters in Grafana dashboards [#4665](https://github.com/pingcap/tiflow/issues/4665) + - Expose configuration parameters of the Kafka producer to make them configurable in TiCDC [#4385](https://github.com/pingcap/tiflow/issues/4385) + TiDB Data Migration (DM) - - (dup: release-6.0.0-dmr.md > Improvements> Tools> TiDB Data Migration (DM))- Support Syncer using the working directory of the DM-worker rather than `/tmp` to write internal files, and cleaning the directory after the task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) + - Support Syncer using the working directory of the DM-worker rather than `/tmp` to write internal files, and cleaning the directory after the task is stopped [#4107](https://github.com/pingcap/tiflow/issues/4107) ## Bug Fixes + TiDB - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that TiDB gets the wrong result when using TiFlash to scan tables with empty range although TiFlash does not support reading tables with empty range yet [#33083](https://github.com/pingcap/tidb/issues/33083) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix the issue that the `MAX` or `MIN` function on the `ENUM` or `SET` column returns a wrong result when the new collation is enabled in TiDB [#31638](https://github.com/pingcap/tidb/issues/31638) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) - - (dup: release-5.3.1.md > Bug fixes> TiDB)- Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix load data panic if the data is broken at an escape character [#31589](https://github.com/pingcap/tidb/issues/31589) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiDB)- Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) - - (dup: release-5.2.4.md > Bug fixes> TiDB)- Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) + - Fix the issue that `date_format` in TiDB handles `'\n'` in a MySQL-incompatible way [#32232](https://github.com/pingcap/tidb/issues/32232) + - Fix the issue that TiDB writes wrong data due to the wrong encoding of the `ENUM` or `SET` column [#32302](https://github.com/pingcap/tidb/issues/32302) + - Fix the issue that the Merge Join operator gets wrong results in certain cases [#33042](https://github.com/pingcap/tidb/issues/33042) + - Fix the issue that TiDB gets a wrong result when a correlated subquery returns a constant [#32089](https://github.com/pingcap/tidb/issues/32089) + - Fix the issue that TiDB gets the wrong result when using TiFlash to scan tables with empty range although TiFlash does not support reading tables with empty range yet [#33083](https://github.com/pingcap/tidb/issues/33083) + - Fix the issue that the `MAX` or `MIN` function on the `ENUM` or `SET` column returns a wrong result when the new collation is enabled in TiDB [#31638](https://github.com/pingcap/tidb/issues/31638) + - Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) + - Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) + - Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) + - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) + - Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) + - Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) + - Fix load data panic if the data is broken at an escape character [#31589](https://github.com/pingcap/tidb/issues/31589) + - Fix the `invalid transaction` error when executing a query using index lookup join [#30468](https://github.com/pingcap/tidb/issues/30468) + - Fix wrong results of deleting data of multiple tables using `left join` [#31321](https://github.com/pingcap/tidb/issues/31321) + - Fix a bug that TiDB may dispatch duplicate tasks to TiFlash [#32814](https://github.com/pingcap/tidb/issues/32814) - Fix the issue that granting the `all` privilege might fail in clusters that are upgraded from v4.0 [#33588](https://github.com/pingcap/tidb/issues/33588) - Fix the session panic that occurs when executing the prepared statement after table schema change with the MySQL binary protocol [#33509](https://github.com/pingcap/tidb/issues/33509) - Fix the issue that executing SQL statements that have the `compress()` expression with `tidb_enable_vectorized_expression` enabled will fail [#33397](https://github.com/pingcap/tidb/issues/33397) @@ -80,16 +80,16 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + TiKV - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that TiKV panics and destroys peers unexpectedly because the target Region to be merged is invalid [#12232](https://github.com/tikv/tikv/issues/12232) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that stale messages cause TiKV to panic [#12023](https://github.com/tikv/tikv/issues/12023) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue of intermittent packet loss and out of memory (OOM) caused by the overflow of memory metrics [#12160](https://github.com/tikv/tikv/issues/12160) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the potential panic issue that occurs when TiKV performs profiling on Ubuntu 18.04 [#9765](https://github.com/tikv/tikv/issues/9765) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that replica reads might violate the linearizability [#12109](https://github.com/tikv/tikv/issues/12109) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the TiKV panic issue that occurs when the target peer is replaced with the peer that is destroyed without being initialized when merging a Region [#12048](https://github.com/tikv/tikv/issues/12048) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix a bug that TiKV might panic if it has been running for 2 years or more [#11940](https://github.com/tikv/tikv/issues/11940) - - (dup: release-5.2.4.md > Improvements> TiKV)- Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) - - (dup: release-5.2.4.md > Bug fixes> TiKV)- Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) + - Fix the issue that TiKV panics and destroys peers unexpectedly because the target Region to be merged is invalid [#12232](https://github.com/tikv/tikv/issues/12232) + - Fix a bug that stale messages cause TiKV to panic [#12023](https://github.com/tikv/tikv/issues/12023) + - Fix the issue of intermittent packet loss and out of memory (OOM) caused by the overflow of memory metrics [#12160](https://github.com/tikv/tikv/issues/12160) + - Fix the potential panic issue that occurs when TiKV performs profiling on Ubuntu 18.04 [#9765](https://github.com/tikv/tikv/issues/9765) + - Fix a bug that replica reads might violate the linearizability [#12109](https://github.com/tikv/tikv/issues/12109) + - Fix the TiKV panic issue that occurs when the target peer is replaced with the peer that is destroyed without being initialized when merging a Region [#12048](https://github.com/tikv/tikv/issues/12048) + - Fix a bug that TiKV might panic if it has been running for 2 years or more [#11940](https://github.com/tikv/tikv/issues/11940) + - Reduce the TiCDC recovery time by reducing the number of the Regions that require the Resolve Locks step [#11993](https://github.com/tikv/tikv/issues/11993) + - Fix the panic issue caused by deleting snapshot files when the peer status is `Applying` [#11746](https://github.com/tikv/tikv/issues/11746) + - Fix the issue that destroying a peer might cause high latency [#10210](https://github.com/tikv/tikv/issues/10210) - Fix the panic issue caused by invalid assertion in resource metering [#12234](https://github.com/tikv/tikv/issues/12234) - Fix the issue that slow score calculation is inaccurate in some corner cases [#12254](https://github.com/tikv/tikv/issues/12254) - Fix the OOM issue caused by the `resolved_ts` module and add more metrics [#12159](https://github.com/tikv/tikv/issues/12159) @@ -98,29 +98,29 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + PD - - (dup: release-6.0.0-dmr.md > Bug fixes> PD)- Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) + - Fix the issue that `Duration` fields of `dr-autosync` cannot be dynamically configured [#4651](https://github.com/tikv/pd/issues/4651) - Fix the issue that when there exists a Store with large capacity (2T for example), fully allocated small Stores cannot be detected, which results in no balance operator being generated [#4805](https://github.com/tikv/pd/issues/4805) - Fix the issue that the label distribution has residual labels in the metrics [#4825](https://github.com/tikv/pd/issues/4825) + TiFlash - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix possible metadata corruption caused by Region merge on a lagging Region peer [#4437](https://github.com/pingcap/tiflash/issues/4437) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that a query containing `JOIN` might be hung if an error occurs [#4195](https://github.com/pingcap/tiflash/issues/4195) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix a bug that MPP tasks might leak threads forever [#4238](https://github.com/pingcap/tiflash/issues/4238) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the overflow that occurs when casting `FLOAT` to `DECIMAL` [#3998](https://github.com/pingcap/tiflash/issues/3998) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue that expired data is recycled slowly [#4146](https://github.com/pingcap/tiflash/issues/4146) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix a bug that canceled MPP queries might cause tasks to hang forever when the local tunnel is enabled [#4229](https://github.com/pingcap/tiflash/issues/4229) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the issue of memory leak that occurs when a query is canceled [#4098](https://github.com/pingcap/tiflash/issues/4098) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the wrong result that occurs when casting `DATETIME` to `DECIMAL` [#4151](https://github.com/pingcap/tiflash/issues/4151) - - (dup: release-6.0.0-dmr.md > Bug fixes> TiFlash)- Fix the potential issue of TiFlash panic when `Snapshot` is applied simultaneously with multiple DDL operations [#4072](https://github.com/pingcap/tiflash/issues/4072) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the bug that invalid storage directory configurations lead to unexpected behaviors [#4093](https://github.com/pingcap/tiflash/issues/4093) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the bug that some exceptions are not handled properly [#4101](https://github.com/pingcap/tiflash/issues/4101) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that casting `INT` to `DECIMAL` might cause overflow [#3920](https://github.com/pingcap/tiflash/issues/3920) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the result of `IN` is incorrect in multi-value expressions [#4016](https://github.com/pingcap/tiflash/issues/4016) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the issue that the date format identifies `'\n'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) - - (dup: release-5.2.4.md > Bug fixes> TiFlash)- Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) + - Fix the panic issue that occurs when TLS is enabled [#4196](https://github.com/pingcap/tiflash/issues/4196) + - Fix possible metadata corruption caused by Region merge on a lagging Region peer [#4437](https://github.com/pingcap/tiflash/issues/4437) + - Fix the issue that a query containing `JOIN` might be hung if an error occurs [#4195](https://github.com/pingcap/tiflash/issues/4195) + - Fix a bug that MPP tasks might leak threads forever [#4238](https://github.com/pingcap/tiflash/issues/4238) + - Fix the overflow that occurs when casting `FLOAT` to `DECIMAL` [#3998](https://github.com/pingcap/tiflash/issues/3998) + - Fix the issue that expired data is recycled slowly [#4146](https://github.com/pingcap/tiflash/issues/4146) + - Fix a bug that canceled MPP queries might cause tasks to hang forever when the local tunnel is enabled [#4229](https://github.com/pingcap/tiflash/issues/4229) + - Fix the issue of memory leak that occurs when a query is canceled [#4098](https://github.com/pingcap/tiflash/issues/4098) + - Fix the wrong result that occurs when casting `DATETIME` to `DECIMAL` [#4151](https://github.com/pingcap/tiflash/issues/4151) + - Fix the potential issue of TiFlash panic when `Snapshot` is applied simultaneously with multiple DDL operations [#4072](https://github.com/pingcap/tiflash/issues/4072) + - Fix the bug that invalid storage directory configurations lead to unexpected behaviors [#4093](https://github.com/pingcap/tiflash/issues/4093) + - Fix the bug that some exceptions are not handled properly [#4101](https://github.com/pingcap/tiflash/issues/4101) + - Fix the issue that casting `INT` to `DECIMAL` might cause overflow [#3920](https://github.com/pingcap/tiflash/issues/3920) + - Fix the issue that the result of `IN` is incorrect in multi-value expressions [#4016](https://github.com/pingcap/tiflash/issues/4016) + - Fix the issue that the date format identifies `'\n'` as an invalid separator [#4036](https://github.com/pingcap/tiflash/issues/4036) + - Fix the potential query error after adding columns under heavy read workload [#3967](https://github.com/pingcap/tiflash/issues/3967) + - Fix the panic issue that occurs when the memory limit is enabled [#3902](https://github.com/pingcap/tiflash/issues/3902) - Fix potential data corruption in DTFiles [#4778](https://github.com/pingcap/tiflash/issues/4778) - Fix potential errors when querying on a table with many delete operations [#4747](https://github.com/pingcap/tiflash/issues/4747) - Fix a bug that TiFlash reports many "Keepalive watchdog fired" errors randomly [#4192](https://github.com/pingcap/tiflash/issues/4192) @@ -131,8 +131,8 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + Backup & Restore (BR) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> Backup & Restore (BR))- Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) - - (dup: release-5.2.4.md > Bug fixes> Tools> Backup & Restore (BR))- Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) + - Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) + - Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) - Fix duplicate primary keys when inserting a record into a table after incremental restoration [#33596](https://github.com/pingcap/tidb/issues/33596) - Fix a bug that BR incremental restore returns errors mistakenly due to DDL jobs with empty query [#33322](https://github.com/pingcap/tidb/issues/33322) - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) @@ -142,14 +142,14 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + TiCDC - - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) - - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiCDC)- Fix the TiCDC panic issue that might occur because `Canal-JSON` does not support nil [#4736](https://github.com/pingcap/tiflow/issues/4736) - - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a stability problem in workerpool used by Unified Sorter [#4447](https://github.com/pingcap/tiflow/issues/4447) - - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that sequence is incorrectly replicated in some cases [#4563](https://github.com/pingcap/tiflow/issues/4552) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiCDC)- Fix the TiCDC panic issue that might occur when `Canal-JSON` incorrectly handles `string` [#4635](https://github.com/pingcap/tiflow/issues/4635) - - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) - - (dup: release-5.2.4.md > Bug fixes> Tools> TiCDC)- Fix a bug that MySQL sink generates duplicated `replace` SQL statements when `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) + - Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) + - Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) + - Fix the TiCDC panic issue that might occur because `Canal-JSON` does not support nil [#4736](https://github.com/pingcap/tiflow/issues/4736) + - Fix a stability problem in workerpool used by Unified Sorter [#4447](https://github.com/pingcap/tiflow/issues/4447) + - Fix a bug that sequence is incorrectly replicated in some cases [#4563](https://github.com/pingcap/tiflow/issues/4552) + - Fix the TiCDC panic issue that might occur when `Canal-JSON` incorrectly handles `string` [#4635](https://github.com/pingcap/tiflow/issues/4635) + - Fix a bug that a TiCDC node exits abnormally when a PD leader is killed [#4248](https://github.com/pingcap/tiflow/issues/4248) + - Fix a bug that MySQL sink generates duplicated `replace` SQL statements when `batch-replace-enable` is disabled [#4501](https://github.com/pingcap/tiflow/issues/4501) - Fix the DML construct error caused by the `rename tables` DDL [#5059](https://github.com/pingcap/tiflow/issues/5059) - Fix the issue that in rare cases replication can be stuck if the owner is changed and the new scheduler is enabled (disabled by default) [#4963](https://github.com/pingcap/tiflow/issues/4963) - Fix the issue that the error ErrProcessorDuplicateOperations is reported when the new scheduler is enabled (disabled by default) [#4769](https://github.com/pingcap/tiflow/issues/4769) @@ -158,16 +158,16 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + TiDB Lightning - - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix the checksum error “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Lightning)- Fix the issue that TiDB Lightning gets stuck when it fails to check empty tables [#31797](https://github.com/pingcap/tidb/issues/31797) - - (dup: release-5.2.4.md > Bug fixes> Tools> TiDB Lightning)- Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) + - Fix the checksum error “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733) + - Fix the issue that TiDB Lightning gets stuck when it fails to check empty tables [#31797](https://github.com/pingcap/tidb/issues/31797) + - Fix a bug that TiDB Lightning may not delete the metadata schema when some import tasks do not contain source files [#28144](https://github.com/pingcap/tidb/issues/28144) - Fix the issue that the precheck does not check local disk resources and cluster availability [#34213](https://github.com/pingcap/tidb/issues/34213) + TiDB Data Migration (DM) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) - - (dup: release-6.0.0-dmr.md > Bug fixes> Tools> TiDB Data Migration (DM))- Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) + - Fix the issue that hundreds of "checkpoint has no change, skip sync flush checkpoint" print in the log and the replication is very slow [#4619](https://github.com/pingcap/tiflow/issues/4619) + - Fix a bug that long varchars report an error `Column length too big` [#4637](https://github.com/pingcap/tiflow/issues/4637) + - Fix the issue that execution errors of the update statement in safemode may cause the DM-worker panic [#4317](https://github.com/pingcap/tiflow/issues/4317) - Fix the issue that in some cases manually executing the filtered DDL in the downstream might cause task resumption failure [#5272](https://github.com/pingcap/tiflow/issues/5272) - Fix a bug that no data is returned for the `query-status` command when binlog is not enabled in the upstream [#5121](https://github.com/pingcap/tiflow/issues/5121) - Fix the DM worker panic issue that occurs when the primary key is not first in the index returned by the `SHOW CREATE TABLE` statement [#5159](https://github.com/pingcap/tiflow/issues/5159) From 865e6d8176e16606d0ae6100198cfc3eb46e7b9f Mon Sep 17 00:00:00 2001 From: qiancai Date: Thu, 12 May 2022 23:16:07 +0800 Subject: [PATCH 41/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 48e1afc08563..bae9fd72dba1 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -130,7 +130,7 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + Tools + Backup & Restore (BR) - + - Fix a bug that causes the restore operation to fail when the encryption information is lost during backup retry [#32423](https://github.com/pingcap/tidb/issues/32423) - Fix the issue that BR fails to back up RawKV [#32607](https://github.com/pingcap/tidb/issues/32607) - Fix duplicate primary keys when inserting a record into a table after incremental restoration [#33596](https://github.com/pingcap/tidb/issues/33596) From e94a088a3e89940c42bb16c8bd7af7560b9a21c8 Mon Sep 17 00:00:00 2001 From: xixirangrang Date: Fri, 13 May 2022 11:07:02 +0800 Subject: [PATCH 42/45] Update releases/release-5.4.1.md --- releases/release-5.4.1.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index bae9fd72dba1..1582aaf5d72f 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -142,7 +142,6 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But + TiCDC - - Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) - Fix incorrect metrics caused by owner changes [#4774](https://github.com/pingcap/tiflow/issues/4774) - Fix the TiCDC panic issue that might occur because `Canal-JSON` does not support nil [#4736](https://github.com/pingcap/tiflow/issues/4736) - Fix a stability problem in workerpool used by Unified Sorter [#4447](https://github.com/pingcap/tiflow/issues/4447) From bee1c86540fcb7fc4f65497833ee7971cab11230 Mon Sep 17 00:00:00 2001 From: Grace Cai Date: Fri, 13 May 2022 11:11:28 +0800 Subject: [PATCH 43/45] Update releases/release-5.4.1.md Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 1582aaf5d72f..898ea25b0da7 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -10,7 +10,7 @@ TiDB version: 5.4.1 ## Compatibility changes -TiDB v5.4.1 does not introduce any compatibility changes in product design. But note that bug fixes in this release might result in compatibility changes too. For more information, see [Bug Fixes](#bug-fixes). +TiDB v5.4.1 does not introduce any compatibility changes in product design. But note that bug fixes in this release might result in compatibility changes, too. For more information, see [Bug Fixes](#bug-fixes). ## Improvements From de908385ed822121cd085ae82b9bc2f5aee7590c Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 13 May 2022 11:18:38 +0800 Subject: [PATCH 44/45] remove the duplicated 31034 from the TiDB bug fixes --- releases/release-5.4.1.md | 1 - scripts/internal-deduplicate.py | 4 ++-- 2 files changed, 2 insertions(+), 3 deletions(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 898ea25b0da7..087cdca58039 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -57,7 +57,6 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But - Fix a bug that CTE might be blocked when a query reports errors [#31302](https://github.com/pingcap/tidb/issues/31302) - Fix wrong range calculation results for Nulleq function on Enum values [#32428](https://github.com/pingcap/tidb/issues/32428) - Fix TiDB OOM when exporting data using ChunkRPC [#31981](https://github.com/pingcap/tidb/issues/31981) [#30880](https://github.com/pingcap/tidb/issues/30880) - - Fix the potential issue that Regions might be unevenly distributed after a restore operation is finished [#31034](https://github.com/pingcap/tidb/issues/31034) - Fix a bug that `tidb_super_read_only` is not automatically enabled when `tidb_restricted_read_only` is enabled [#31745](https://github.com/pingcap/tidb/issues/31745) - Fix the issue that the `greatest` or `least` function with collation gets a wrong result [#31789](https://github.com/pingcap/tidb/issues/31789) - Fix load data panic if the data is broken at an escape character [#31589](https://github.com/pingcap/tidb/issues/31589) diff --git a/scripts/internal-deduplicate.py b/scripts/internal-deduplicate.py index 3e07239e492b..c980a4591cc4 100644 --- a/scripts/internal-deduplicate.py +++ b/scripts/internal-deduplicate.py @@ -15,7 +15,7 @@ def get_note_info(path): if __name__ == "__main__": - path = r'D:\GitHub\upstream\docs1\releases\release-5.1.4.md' + path = r'/Users/grcai/Documents/GitHub/qiancai/docs/releases/release-5.4.1.md' exst_note = get_note_info(path) mylist = exst_note myset = set(mylist) @@ -23,4 +23,4 @@ def get_note_info(path): if mylist.count(item) > 1: print("the %s has found %d" % (item, mylist.count(item))) else: - continue \ No newline at end of file + continue From 6336b273c6f74db04def40d385b889c4f3c65b1c Mon Sep 17 00:00:00 2001 From: qiancai Date: Fri, 13 May 2022 13:58:33 +0800 Subject: [PATCH 45/45] Update release-5.4.1.md --- releases/release-5.4.1.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.4.1.md b/releases/release-5.4.1.md index 087cdca58039..07fd4b5ff547 100644 --- a/releases/release-5.4.1.md +++ b/releases/release-5.4.1.md @@ -72,7 +72,7 @@ TiDB v5.4.1 does not introduce any compatibility changes in product design. But - Fix the error that occurs when reading from the `INFORMATION_SCHEMA.ATTRIBUTES` table by skipping the unidentifiable table attributes [#33665](https://github.com/pingcap/tidb/issues/33665) - Fix a bug that even if `@@tidb_enable_parallel_apply` is set, the `Apply` operator is not paralleled when an `order` property exists [#34237](https://github.com/pingcap/tidb/issues/34237) - Fix a bug that `'0000-00-00 00:00:00'` can be inserted into a `datetime` column when `sql_mode` is set to `NO_ZERO_DATE` [#34099](https://github.com/pingcap/tidb/issues/34099) - - Fix the issue that the TiDB server might run out of memory when the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table is queried. This issue can be triggered when you check slow queries on the Grafana dashboard. [#33893](https://github.com/pingcap/tidb/issues/33893) + - Fix the issue that the TiDB server might run out of memory when the `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` table is queried. This issue can be triggered when you check slow queries on the Grafana dashboard [#33893](https://github.com/pingcap/tidb/issues/33893) - Fix a bug that in the `NOWAIT` statement, a transaction being executed does not return immediately when encountering a lock [#32754](https://github.com/pingcap/tidb/issues/32754) - Fix a bug that causes a failure when creating a table with the `GBK` charset and `gbk_bin` collation [#31308](https://github.com/pingcap/tidb/issues/31308) - Fix a bug that when `enable-new-charset` is `on`, creating a `GBK` charset table with collation fails with the "Unknown character set" error [#31297](https://github.com/pingcap/tidb/issues/31297)