add two HTAP documents #6206

en-jin19 · 2021-08-22T23:03:28Z

What is changed, added or deleted? (Required)

Add two docs about HTAP.

Which TiDB version(s) do your changes apply to? (Required)

Tips for choosing the affected version(s):

By default, CHOOSE MASTER ONLY so your changes will be applied to the next TiDB major or minor releases. If your PR involves a product feature behavior change or a compatibility change, CHOOSE THE AFFECTED RELEASE BRANCH(ES) AND MASTER.

For details, see tips for choosing the affected versions.

What is the related PR or file link(s)?

This PR is translated from: Add two docs for getting started with HTAP and exploring HTAP docs-cn#6613
Other reference link(s):

Do your changes match any of the following descriptions?

Delete files
Change aliases
Need modification after applied to another branch
Might cause conflicts after applied to another branch

ti-chi-bot · 2021-08-22T23:03:30Z

[REVIEW NOTIFICATION]

This pull request has been approved by:

qiancai

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

en-jin19 · 2021-08-22T23:04:45Z

Hi @superlzs0476 @l3031875 @moyun, could you please help tech review this PR? thanks!

dveeden · 2021-08-23T08:33:47Z

explore-htap.md

+
+- Hybrid load
+
+    When using TiDB for real-time Online Analytical Processing (OLAP) that is in hybrid load scenarios, you only need to provide an entry point. Then TiDB automatically selects different processing engines based on the specific business.


This is not clear. I assume an entry point means a TiFlash configuration?

And based on the specific business? Isn't that based on the specific query type?

@dveeden @moyun PTAL the updates

Suggested change

When using TiDB for real-time Online Analytical Processing (OLAP) that is in hybrid load scenarios, you only need to provide an entry point. Then TiDB automatically selects different processing engines based on the specific business.

When using TiDB for real-time Online Analytical Processing (OLAP) in hybrid load scenarios, you only need to provide an entry point of your existing database to TiDB and does not require any additional work of users. Then TiDB automatically selects different processing engines based on specific query types of your business.

explore-htap.md

dveeden · 2021-08-23T08:41:52Z

explore-htap.md

+
+## Prerequisites for environment
+
+Before exploring the features of TiDB HTAP, you need to configure TiDB and the corresponding storage engine according to the data volume. If the data volume is huge (for example, 100 T), it is recommended to use TiFlash Massively Parallel Processing (MPP) as the primary solution and TiSpark as the supplementary solution.


I would avoid using "huge" here. Maybe "For larger data volumes ..."?

explore-htap.md

quick-start-with-htap.md

dveeden · 2021-08-23T08:47:18Z

quick-start-with-htap.md

+    {{< copyable "shell-regular" >}}
+
+    ```shell
+    tiup playground v5.1.0 --db 2 --pd 3 --kv 3 --tiflash 1 --monitor


--monitor is the default isn't it?

Shouldn't we use >1 TiFlash to show the MPP benefits?

mpp's benefit need more tiflash node

@LiSong0214 Do we need to update the node number to a large number? If so, we might need a test on that too.

quick-start-with-htap.md

…art-with-HTAP-and-exploring-HTAP-

…ttps://github.com/en-jin19/docs into add-docs-quick-start-with-HTAP-and-exploring-HTAP-

moyun

fixed some wording

explore-htap.md

moyun · 2021-08-24T11:09:05Z

explore-htap.md

+
+- Hybrid load
+
+    When using TiDB for real-time Online Analytical Processing (OLAP) that is in hybrid load scenarios, you only need to provide an entry point. Then TiDB automatically selects different processing engines based on the specific business.


you only need to provide an entry point -> It's mostly user-transparent and don't require additional work of users

explore-htap.md

ti-chi-bot · 2021-08-24T11:23:12Z

@moyun: Request changes is only allowed for the reviewers in list.

In response to this:

fixed some wording

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

explore-htap.md

qiancai · 2021-08-24T10:37:01Z

explore-htap.md

+
+- Hybrid load
+
+    When using TiDB for real-time Online Analytical Processing (OLAP) that is in hybrid load scenarios, you only need to provide an entry point. Then TiDB automatically selects different processing engines based on the specific business.


@dveeden @moyun PTAL the updates

Suggested change

When using TiDB for real-time Online Analytical Processing (OLAP) that is in hybrid load scenarios, you only need to provide an entry point. Then TiDB automatically selects different processing engines based on the specific business.

When using TiDB for real-time Online Analytical Processing (OLAP) in hybrid load scenarios, you only need to provide an entry point of your existing database to TiDB and does not require any additional work of users. Then TiDB automatically selects different processing engines based on specific query types of your business.

explore-htap.md

qiancai · 2021-08-24T10:53:32Z

quick-start-with-htap.md

+    {{< copyable "shell-regular" >}}
+
+    ```shell
+    tiup playground v5.1.0 --db 2 --pd 3 --kv 3 --tiflash 1 --monitor


@LiSong0214 Do we need to update the node number to a large number? If so, we might need a test on that too.

explore-htap.md

quick-start-with-htap.md

explore-htap.md

quick-start-with-htap.md

qiancai · 2021-08-25T16:10:49Z

quick-start-with-htap.md

+
+In the result of above statement:
+
+- `AVAILABLE` indicates whether the TiFlash replicas of this table is available or not. `1` means available and `0` means unavailable. Once the replicas become available, this status does not change. If you use DDL statements to modify the number of replicas, the replication status will be recalculated.


Suggested change

- `AVAILABLE` indicates whether the TiFlash replicas of this table is available or not. `1` means available and `0` means unavailable. Once the replicas become available, this status does not change. If you use DDL statements to modify the number of replicas, the replication status will be recalculated.

- `AVAILABLE` indicates whether the TiFlash replica of a specific table is available or not. `1` means available and `0` means unavailable. Once the replicas become available, this status does not change. If you use DDL statements to modify the number of replicas, the replication status will be recalculated.

quick-start-with-htap.md

explore-htap.md

Co-authored-by: Grace Cai <[email protected]>

Co-authored-by: Enwei <[email protected]>

explore-htap.md

Co-authored-by: Grace Cai <[email protected]>

Co-authored-by: Enwei <[email protected]>

ti-chi-bot · 2021-08-27T10:55:46Z

@LiSong0214: Thanks for your review. The bot only counts approvals from reviewers and higher roles in list, but you're still welcome to leave your comments.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

qiancai

LGTM

moyun

LGTM

ti-chi-bot · 2021-08-27T11:27:36Z

@moyun: Thanks for your review. The bot only counts approvals from reviewers and higher roles in list, but you're still welcome to leave your comments.

In response to this:

LGTM

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

qiancai · 2021-08-27T12:02:24Z

/merge

ti-chi-bot · 2021-08-27T12:02:25Z

@qiancai: /merge in this pull request requires 2 approval(s).

In response to this:

/merge

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

qiancai · 2021-08-27T12:07:46Z

/remove-status LGT1
/status LGT2

qiancai · 2021-08-27T12:07:51Z

/merge

ti-chi-bot · 2021-08-27T12:07:53Z

This pull request has been accepted and is ready to merge.

Commit hash: fbd5243

ti-chi-bot · 2021-08-27T12:08:42Z

In response to a cherrypick label: new pull request created: #6321.

* Dumping default consistency description (#5985) * update max-replicas description (#5984) * Remove the swappiness parameter (#5987) * system-variables: update for consistency (#5826) * Change tidb_memory_usage_alarm_ratio scope to instance (#5988) * Punctuation fix: Replace 。with . (#6002) * index page: updated the phase of TiDB Cloud from Beta to Public Preview (#6014) * Migration FAQs: added the FAQ links of the migration related tools (#6010) * TiUP cluster: update data_dir (#6009) * Add kafka downstream example (#6005) * TiKV configuration: Update description for pin-l0-filter-and-index-blocks (#6008) * Update the default value of tidb_stmt_summary_max_stmt_count (#6021) (#6023) * update docs related to partition table dynamic mode (#5997) * partitioning: Corrected partition management (#5498) * TiDB binlog: update descriptions about commit ts and passoword (#5986) * releases: add tidb 4.0.14 release notes (#5996) * fix a typo for sync_diff_inspector (#6041) * Update dashboard FAQ (#5895) * update stale read doc for ga (#6047) * configure-time-zone: mention `system_time_zone` (#6032) * Update Security Compatibility with MySQL (#5921) * correct document of using br backup and restore system tables (#6057) * Add description about telemetry of builtin functions usage (#6028) * Add TiDB Dashboard session docs (#6058) * update br faq (#6060) * releases: add TiDB 5.1.1 release notes (#6030) * grafana-overview-dashboard: update the monitoring item for CPS (#6066) * deploy-tidb-binlog: make the expression on deployment clearer (#6073) * Add documentation on how to modify gcttl by tiup (#6071) * remove useless variable (#6076) * ticdc: add mysql sink user privilege (#6072) * deleted roadmap.md (#6079) * TiDB Monitoring Metrics: remove a line (#6081) * TiDB configuration: add a security option `require-secure-transport` (#6080) * chore: lock plugin versions (#6089) * cdc: add compatibility notes for sort-dir (#6086) * Add gc ttl (#6102) (#6103) * 5.1.0 release notes: Fix link to telemetry docs (#6106) * sql-statement-select: Add '...FOR UPDATE NOWAIT' (#6085) * TiCDC: update a golang demo link (#6055) * br/use-br-command-line-tool: supplement br note (#6000) * pr_template: Provides tips for cherry-pick (#6042) * pr_template: Provides tips for cherry-pick * Update CONTRIBUTING.md * Update CONTRIBUTING.md * TiDB monitoring: add table storage info status api (#6110) * update doc for Oracle translate function (#6053) * ticdc: add explicit_defaults_for_timestamp compatibility troubleshoot (#6115) * Add print the bad sst files and related information for tikv-ctl (#6109) * add a missing note (#6129) * Add docs for auto-tls setting (#6125) * TiFlash: remove outdated tune advise (#6133) * TiDB lightning: remove default backend setting (#6132) * tidb-scheduling: fix typo (#6140) * Suggest Log Redaction when using TDE (#6147) * Add infoschema.referential_constraints (#6139) * Add steps to get lightning goroutine (#6001) * tiup: fix dead links (#6153) * Deleted description about not supporting some features. (#6157) * high-concurrency-best-practices: fix the support info of follower read (#6161) * Update function list pushed down to tiflash (#6165) * The `log_dir` should be the log directory (#6168) * Make IP address of Monitoring & Grafana for Minimal Topology consistent (#6178) * tikv: add storage flow control doc (#6173) * TiDB configuration: update the default value of `stmt_max_count` (#6172) * ticdc-open-api: add ticdc open api doc (#6186) * System variables: update `broadcast_join_threshold_count` and `broadc… (#6181) * Update tikv-configuration-file.md (#6180) * TiFlash configuration: update `io_rate_limit` (#6176) * Add information of hashAgg for memory control (#6171) * Update description on rule based index selection (#6160) * add dr auto sync (#6182) * update doc for SPM (#6146) * docs: update rereject leader docs (#6183) * SQL statement, system variables: update expression indexes (#6185) * Updated sql-plan-management.md (#6184) * Introduced 2 new variables (#6159) * Fix broken link in error codes doc and support doc (#6196) * docs: fix format for TiKV and PD configuration file template invalid. (#6197) * docs: separate query statement and result in two text boxes. (#6204) (#6205) * adopters: add zhihu case study (#6207) * Added descriptions about slow node detection (#6174) * pd-control: add new config of balance-hot-region-scheduler (#6148) * add notice about scaling in pd node (#6099) * add example for expression index (#6215) * adopters: remove 404 links (#6214) * ticdc: fix wording (#6231) * Revert "System variables: update `broadcast_join_threshold_count` and `broadc…" (#6232) * Update documents of lock view for sprint 4 (#6179) * ticdc-open-api: correct some error (#6239) * best practices: add timeout options for Java best practices (#6136) * update PR template for v5.2 (#6166) * chore: stop building temporary (#6252) * fix typo for sql-plan-management.md (#6248) * alert rules: update some descriptions (#6250) * Quick start: update version and TiUP playground supports M1 silicon (#6149) * fix typo: relaod -> reload (#6235) * tiny fix on index selection (#6265) * add commands to check tikv user (#5999) * br: add restore to systables (#6004) * br: add restore to systables * Apply suggestions from code review Co-authored-by: TomShawn <[email protected]> Co-authored-by: TomShawn <[email protected]> * statement summary: update statement summary doc (#6084) * Require process privilege for dumpling (#6187) * tiflash: Remove the description about expr_blacklist in use_tiflash.md (#6188) * Add description about table name/alias specifying for read_from_storage hint (#6164) * complex tidb binlog.yaml: add checkpoint info (#6216) * TiKV configuration: remove redundant instructions (#6218) * alert rules: remove some descriptions (#6223) * Revert "add dr auto sync" (#6294) * TiFlash Config: Add annotation (v5.2.0) (#6296) * sql: improve kill's description (#6233) * Add v5.2 TPCH report (#6170) * docs: fix expression index's document again (#6295) * system variables.md: add a warning message (#6298) * sql-statement: Add ADMIN SHOW TELEMETRY (#6138) * tiup: add notice about importing cluster (#6108) * Bump version for v5.2.0 (#6191) * add TiDB 5.2.0 release note (#6237) * add two HTAP documents (#6206) * benchmark: add v5.2 benchmark results (#6319) * Fix title typo (#6324) * release note: update feature description (#6325) * adopters: add xiaomi (#6303) * chore: migrate scripts to docs (#6338) * credits: update links to the full list of code and docs contributors (#6111) * TiUP: add instructions for offline mirror (#6137) * tune tikv memory performance: remove description for sync-log (#6234) * dashboard statement list: add a note to explain the blue bar and yellow line (#6189) * release 5.1.0: add compatibility change for `tidb_enable_noop_functions` (#6222) * modify configuration online: remove unsupported parameters (#6300) * modify configuration online: change a name for consistency (#6301) * Migrate from Aurora: update Aurora MySQL dumpling command (#6335) * PD configuration file: add log level (#6302) * TiDB Binlog config: update "syncer.to.checkpoint" info (#6340) * update doc on wal-recovery-mode and use-direct-io-for-flush-and-compaction (#6163) * Fix TOC display error (#6369) * sql: fix the correctness problem about kill (#6377) * change expressions related to statement summary tables (#6299) * Update grafana-pd-dashboard.md (#6388) * system variables: update description about `tidb_opt_prefer_range_scan` (#6389) * Update alert rule for low space (#6376) * chore: add dispatch back (#6404) * Add description for TiKV Ready handled panel (#6375) * TiKV config: fix wrong description about `compaction-readahead-size` (#6371) * update transaction doc (#6158) * BR FAQ: add a warning about multi br importing (#6263) * Configuration Options: remove two TiDB's command options (#6370) * system-variables: improve noop functions warning (#6374) * add doc links to overview.md (#6422) * chore: fix byte encode (#6428) * performance_schema -> information_schema (#6418) * chore: update ci scripts (#6429) * Enhance TiDB login descriptions - EN (#6427) * release-notes: add 5.2.1 release notes (#6438) * basic features: add feature matrix (#6130) * release note: add a check item for feedback-probability (#6405) * Update system variables for correctness (#6224) * encryption-at-rest: Update (#6152) * basic-features: collapse charset and collations (#6452) * system-variables: update from generated source (#6451) * fix-enable-compaction-filter-in-tikv-configuration-file (#6403) * Update the related variable description for CREATE INDEX (#6434) * TiKV config: add 7 log-related congifurations (#6372) * Configure placement rules: fix placement doc (#6450) * adopters: add Pinterest (#6443) * release-5.2.0: Add info about caching_sha2 (#6344) * faq: add info for schema is changed error (#6453) * Update enable-tls-between-clients-and-servers.md (#6493) * adopters: remove Pinterest (#6501) * Fix wrong wording in mysql-compatibility.md (#6511) * adopters: add Huya Live (#6516) * tidb-configuration-file: correct the default value of committer-concurrency (#6526) * Tune TiKV: change the default value of `grpc-concurrency` (#6531) * releases: add tidb 4.0.15 release notes (#6475) * releases: add tidb 5.0.4 release notes (#6449) * releases: add tidb 5.1.2 release notes (#6500) * releases: add TiDB 5.1.2-10-06-33 release notes * releases: add TiDB 5.1.2-10-06-33 release notes * Update releases/release-5.1.2-10-06-33.md * toc * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md * add notes from comments * add more tidb notes * Update releases/release-5.1.2.md Co-authored-by: Yuanjia Zhang <[email protected]> * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Enwei <[email protected]> Co-authored-by: xixirangrang <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: shichun-0415 <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: Yuanjia Zhang <[email protected]> * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: shichun-0415 <[email protected]> * replace pr numbers with issue numbers * Update releases/release-5.1.2.md Co-authored-by: Liuxiaozhen12 <[email protected]> * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Enwei <[email protected]> * fix * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md * Apply suggestions from code review * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md Co-authored-by: Enwei <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: Grace Cai <[email protected]> * Update releases/release-5.1.2.md * Apply suggestions from code review * Apply suggestions from code review * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md Co-authored-by: Enwei <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: shichun-0415 <[email protected]> * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md * Apply suggestions from code review * move notes Co-authored-by: TomShawn <[email protected]> Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Grace Cai <[email protected]> Co-authored-by: Yuanjia Zhang <[email protected]> Co-authored-by: Enwei <[email protected]> Co-authored-by: xixirangrang <[email protected]> Co-authored-by: shichun-0415 <[email protected]> * remove a note about `raftstore.sync-log` (#6563) * Add desc of "Storage Write Stall" row in the TiFlash grafana (#6524) * system variables: update tidb_enable_noop_functions behavior (#6525) * system variables: document last_insert_id (#6502) * docs: update pd-configuration about upgrade (#6510) * fix example for expression index (#6499) * tidb: fix default value of performance.committer-concurrency (#6498) * chore: remove circleci config (#6577) * Document missing sysvars (#6485) * system-variables: add skip-name-resolve (#6491) * Document a few more system variables (#6492) * add dr auto sync (#6592) * Update from master Co-authored-by: Enwei <[email protected]> Co-authored-by: disksing <[email protected]> Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Morgan Tocker <[email protected]> Co-authored-by: Daniël van Eeden <[email protected]> Co-authored-by: Grace Cai <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> Co-authored-by: Mattias Jonsson <[email protected]> Co-authored-by: ti-srebot <[email protected]> Co-authored-by: glorv <[email protected]> Co-authored-by: Suhaha <[email protected]> Co-authored-by: Ian <[email protected]> Co-authored-by: Yu Lei <[email protected]> Co-authored-by: Wenxuan <[email protected]> Co-authored-by: zhouqiang <[email protected]> Co-authored-by: xixirangrang <[email protected]> Co-authored-by: Yini Xu <[email protected]> Co-authored-by: WangZhengru <[email protected]> Co-authored-by: Xintao <[email protected]> Co-authored-by: Daniël van Eeden <[email protected]> Co-authored-by: Allen Zhong <[email protected]> Co-authored-by: ruoxi <[email protected]> Co-authored-by: Yasuo Honda <[email protected]> Co-authored-by: Yasuo Honda <[email protected]> Co-authored-by: Defined2014 <[email protected]> Co-authored-by: Ran <[email protected]> Co-authored-by: Chengpeng Yan <[email protected]> Co-authored-by: Yifan Xu <[email protected]> Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: Ziqian Qin <[email protected]> Co-authored-by: shichun-0415 <[email protected]> Co-authored-by: you06 <[email protected]> Co-authored-by: Fendy <[email protected]> Co-authored-by: Kolbe Kegel <[email protected]> Co-authored-by: jirongq <[email protected]> Co-authored-by: Caitin <[email protected]> Co-authored-by: Yuanjia Zhang <[email protected]> Co-authored-by: JaySon <[email protected]> Co-authored-by: unconsolable <[email protected]>

* Dumping default consistency description (#5985) * update max-replicas description (#5984) * Remove the swappiness parameter (#5987) * system-variables: update for consistency (#5826) * Change tidb_memory_usage_alarm_ratio scope to instance (#5988) * Punctuation fix: Replace 。with . (#6002) * index page: updated the phase of TiDB Cloud from Beta to Public Preview (#6014) * Migration FAQs: added the FAQ links of the migration related tools (#6010) * TiUP cluster: update data_dir (#6009) * Add kafka downstream example (#6005) * TiKV configuration: Update description for pin-l0-filter-and-index-blocks (#6008) * Update the default value of tidb_stmt_summary_max_stmt_count (#6021) (#6023) * update docs related to partition table dynamic mode (#5997) * partitioning: Corrected partition management (#5498) * TiDB binlog: update descriptions about commit ts and passoword (#5986) * releases: add tidb 4.0.14 release notes (#5996) * fix a typo for sync_diff_inspector (#6041) * Update dashboard FAQ (#5895) * update stale read doc for ga (#6047) * configure-time-zone: mention `system_time_zone` (#6032) * Update Security Compatibility with MySQL (#5921) * correct document of using br backup and restore system tables (#6057) * Add description about telemetry of builtin functions usage (#6028) * Add TiDB Dashboard session docs (#6058) * update br faq (#6060) * releases: add TiDB 5.1.1 release notes (#6030) * grafana-overview-dashboard: update the monitoring item for CPS (#6066) * deploy-tidb-binlog: make the expression on deployment clearer (#6073) * Add documentation on how to modify gcttl by tiup (#6071) * remove useless variable (#6076) * ticdc: add mysql sink user privilege (#6072) * deleted roadmap.md (#6079) * TiDB Monitoring Metrics: remove a line (#6081) * TiDB configuration: add a security option `require-secure-transport` (#6080) * chore: lock plugin versions (#6089) * cdc: add compatibility notes for sort-dir (#6086) * Add gc ttl (#6102) (#6103) * 5.1.0 release notes: Fix link to telemetry docs (#6106) * sql-statement-select: Add '...FOR UPDATE NOWAIT' (#6085) * TiCDC: update a golang demo link (#6055) * br/use-br-command-line-tool: supplement br note (#6000) * pr_template: Provides tips for cherry-pick (#6042) * pr_template: Provides tips for cherry-pick * Update CONTRIBUTING.md * Update CONTRIBUTING.md * TiDB monitoring: add table storage info status api (#6110) * update doc for Oracle translate function (#6053) * ticdc: add explicit_defaults_for_timestamp compatibility troubleshoot (#6115) * Add print the bad sst files and related information for tikv-ctl (#6109) * add a missing note (#6129) * Add docs for auto-tls setting (#6125) * TiFlash: remove outdated tune advise (#6133) * TiDB lightning: remove default backend setting (#6132) * tidb-scheduling: fix typo (#6140) * Suggest Log Redaction when using TDE (#6147) * Add infoschema.referential_constraints (#6139) * Add steps to get lightning goroutine (#6001) * tiup: fix dead links (#6153) * Deleted description about not supporting some features. (#6157) * high-concurrency-best-practices: fix the support info of follower read (#6161) * Update function list pushed down to tiflash (#6165) * The `log_dir` should be the log directory (#6168) * Make IP address of Monitoring & Grafana for Minimal Topology consistent (#6178) * tikv: add storage flow control doc (#6173) * TiDB configuration: update the default value of `stmt_max_count` (#6172) * ticdc-open-api: add ticdc open api doc (#6186) * System variables: update `broadcast_join_threshold_count` and `broadc… (#6181) * Update tikv-configuration-file.md (#6180) * TiFlash configuration: update `io_rate_limit` (#6176) * Add information of hashAgg for memory control (#6171) * Update description on rule based index selection (#6160) * add dr auto sync (#6182) * update doc for SPM (#6146) * docs: update rereject leader docs (#6183) * SQL statement, system variables: update expression indexes (#6185) * Updated sql-plan-management.md (#6184) * Introduced 2 new variables (#6159) * Fix broken link in error codes doc and support doc (#6196) * docs: fix format for TiKV and PD configuration file template invalid. (#6197) * docs: separate query statement and result in two text boxes. (#6204) (#6205) * adopters: add zhihu case study (#6207) * Added descriptions about slow node detection (#6174) * pd-control: add new config of balance-hot-region-scheduler (#6148) * add notice about scaling in pd node (#6099) * add example for expression index (#6215) * adopters: remove 404 links (#6214) * ticdc: fix wording (#6231) * Revert "System variables: update `broadcast_join_threshold_count` and `broadc…" (#6232) * Update documents of lock view for sprint 4 (#6179) * ticdc-open-api: correct some error (#6239) * best practices: add timeout options for Java best practices (#6136) * update PR template for v5.2 (#6166) * chore: stop building temporary (#6252) * fix typo for sql-plan-management.md (#6248) * alert rules: update some descriptions (#6250) * Quick start: update version and TiUP playground supports M1 silicon (#6149) * fix typo: relaod -> reload (#6235) * tiny fix on index selection (#6265) * add commands to check tikv user (#5999) * br: add restore to systables (#6004) * br: add restore to systables * Apply suggestions from code review Co-authored-by: TomShawn <[email protected]> Co-authored-by: TomShawn <[email protected]> * statement summary: update statement summary doc (#6084) * Require process privilege for dumpling (#6187) * tiflash: Remove the description about expr_blacklist in use_tiflash.md (#6188) * Add description about table name/alias specifying for read_from_storage hint (#6164) * complex tidb binlog.yaml: add checkpoint info (#6216) * TiKV configuration: remove redundant instructions (#6218) * alert rules: remove some descriptions (#6223) * Revert "add dr auto sync" (#6294) * TiFlash Config: Add annotation (v5.2.0) (#6296) * sql: improve kill's description (#6233) * Add v5.2 TPCH report (#6170) * docs: fix expression index's document again (#6295) * system variables.md: add a warning message (#6298) * sql-statement: Add ADMIN SHOW TELEMETRY (#6138) * tiup: add notice about importing cluster (#6108) * Bump version for v5.2.0 (#6191) * add TiDB 5.2.0 release note (#6237) * add two HTAP documents (#6206) * benchmark: add v5.2 benchmark results (#6319) * Fix title typo (#6324) * release note: update feature description (#6325) * adopters: add xiaomi (#6303) * chore: migrate scripts to docs (#6338) * credits: update links to the full list of code and docs contributors (#6111) * TiUP: add instructions for offline mirror (#6137) * tune tikv memory performance: remove description for sync-log (#6234) * dashboard statement list: add a note to explain the blue bar and yellow line (#6189) * release 5.1.0: add compatibility change for `tidb_enable_noop_functions` (#6222) * modify configuration online: remove unsupported parameters (#6300) * modify configuration online: change a name for consistency (#6301) * Migrate from Aurora: update Aurora MySQL dumpling command (#6335) * PD configuration file: add log level (#6302) * TiDB Binlog config: update "syncer.to.checkpoint" info (#6340) * update doc on wal-recovery-mode and use-direct-io-for-flush-and-compaction (#6163) * Fix TOC display error (#6369) * sql: fix the correctness problem about kill (#6377) * change expressions related to statement summary tables (#6299) * Update grafana-pd-dashboard.md (#6388) * system variables: update description about `tidb_opt_prefer_range_scan` (#6389) * Update alert rule for low space (#6376) * chore: add dispatch back (#6404) * Add description for TiKV Ready handled panel (#6375) * TiKV config: fix wrong description about `compaction-readahead-size` (#6371) * update transaction doc (#6158) * BR FAQ: add a warning about multi br importing (#6263) * Configuration Options: remove two TiDB's command options (#6370) * system-variables: improve noop functions warning (#6374) * add doc links to overview.md (#6422) * chore: fix byte encode (#6428) * performance_schema -> information_schema (#6418) * chore: update ci scripts (#6429) * Enhance TiDB login descriptions - EN (#6427) * release-notes: add 5.2.1 release notes (#6438) * basic features: add feature matrix (#6130) * release note: add a check item for feedback-probability (#6405) * Update system variables for correctness (#6224) * encryption-at-rest: Update (#6152) * basic-features: collapse charset and collations (#6452) * system-variables: update from generated source (#6451) * fix-enable-compaction-filter-in-tikv-configuration-file (#6403) * Update the related variable description for CREATE INDEX (#6434) * TiKV config: add 7 log-related congifurations (#6372) * Configure placement rules: fix placement doc (#6450) * adopters: add Pinterest (#6443) * release-5.2.0: Add info about caching_sha2 (#6344) * faq: add info for schema is changed error (#6453) * Update enable-tls-between-clients-and-servers.md (#6493) * adopters: remove Pinterest (#6501) * Fix wrong wording in mysql-compatibility.md (#6511) * adopters: add Huya Live (#6516) * tidb-configuration-file: correct the default value of committer-concurrency (#6526) * Tune TiKV: change the default value of `grpc-concurrency` (#6531) * releases: add tidb 4.0.15 release notes (#6475) * releases: add tidb 5.0.4 release notes (#6449) * releases: add tidb 5.1.2 release notes (#6500) * releases: add TiDB 5.1.2-10-06-33 release notes * releases: add TiDB 5.1.2-10-06-33 release notes * Update releases/release-5.1.2-10-06-33.md * toc * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md * add notes from comments * add more tidb notes * Update releases/release-5.1.2.md Co-authored-by: Yuanjia Zhang <[email protected]> * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Enwei <[email protected]> Co-authored-by: xixirangrang <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: shichun-0415 <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: Yuanjia Zhang <[email protected]> * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: shichun-0415 <[email protected]> * replace pr numbers with issue numbers * Update releases/release-5.1.2.md Co-authored-by: Liuxiaozhen12 <[email protected]> * Apply suggestions from code review Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Enwei <[email protected]> * fix * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md * Apply suggestions from code review * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md Co-authored-by: Enwei <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: Grace Cai <[email protected]> * Update releases/release-5.1.2.md * Apply suggestions from code review * Apply suggestions from code review * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md Co-authored-by: Enwei <[email protected]> * Update releases/release-5.1.2.md Co-authored-by: shichun-0415 <[email protected]> * Update releases/release-5.1.2.md * Update releases/release-5.1.2.md * Apply suggestions from code review * move notes Co-authored-by: TomShawn <[email protected]> Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Grace Cai <[email protected]> Co-authored-by: Yuanjia Zhang <[email protected]> Co-authored-by: Enwei <[email protected]> Co-authored-by: xixirangrang <[email protected]> Co-authored-by: shichun-0415 <[email protected]> * remove a note about `raftstore.sync-log` (#6563) * Add desc of "Storage Write Stall" row in the TiFlash grafana (#6524) * system variables: update tidb_enable_noop_functions behavior (#6525) * system variables: document last_insert_id (#6502) * docs: update pd-configuration about upgrade (#6510) * fix example for expression index (#6499) * tidb: fix default value of performance.committer-concurrency (#6498) * chore: remove circleci config (#6577) * Document missing sysvars (#6485) * system-variables: add skip-name-resolve (#6491) * Document a few more system variables (#6492) * add dr auto sync (#6592) * tiflash, metric: add alert for TiFlash down (#6590) Co-authored-by: Enwei <[email protected]> Co-authored-by: disksing <[email protected]> Co-authored-by: Liuxiaozhen12 <[email protected]> Co-authored-by: Morgan Tocker <[email protected]> Co-authored-by: Daniël van Eeden <[email protected]> Co-authored-by: Grace Cai <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> Co-authored-by: Mattias Jonsson <[email protected]> Co-authored-by: ti-srebot <[email protected]> Co-authored-by: glorv <[email protected]> Co-authored-by: Suhaha <[email protected]> Co-authored-by: Ian <[email protected]> Co-authored-by: Yu Lei <[email protected]> Co-authored-by: Wenxuan <[email protected]> Co-authored-by: zhouqiang <[email protected]> Co-authored-by: xixirangrang <[email protected]> Co-authored-by: Yini Xu <[email protected]> Co-authored-by: WangZhengru <[email protected]> Co-authored-by: Xintao <[email protected]> Co-authored-by: Daniël van Eeden <[email protected]> Co-authored-by: Allen Zhong <[email protected]> Co-authored-by: ruoxi <[email protected]> Co-authored-by: Yasuo Honda <[email protected]> Co-authored-by: Yasuo Honda <[email protected]> Co-authored-by: Defined2014 <[email protected]> Co-authored-by: Ran <[email protected]> Co-authored-by: Chengpeng Yan <[email protected]> Co-authored-by: Yifan Xu <[email protected]> Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: Ziqian Qin <[email protected]> Co-authored-by: shichun-0415 <[email protected]> Co-authored-by: you06 <[email protected]> Co-authored-by: Fendy <[email protected]> Co-authored-by: Kolbe Kegel <[email protected]> Co-authored-by: jirongq <[email protected]> Co-authored-by: Caitin <[email protected]> Co-authored-by: Yuanjia Zhang <[email protected]> Co-authored-by: JaySon <[email protected]> Co-authored-by: unconsolable <[email protected]>

add two HTAP documents

15a4db0

en-jin19 added translation/from-docs-cn This PR is translated from a PR in pingcap/docs-cn. v5.2 This PR/issue applies to TiDB v5.2. labels Aug 22, 2021

en-jin19 requested a review from qiancai August 22, 2021 23:03

ti-chi-bot added the size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. label Aug 22, 2021

en-jin19 added 4 commits August 23, 2021 01:07

fix CI error

a8bc1f3

fix CI error

23eb99f

fix CI error

06dbf5b

fix CI errors

064b1d6

en-jin19 requested review from morgo and dveeden August 23, 2021 08:29

dveeden reviewed Aug 23, 2021

View reviewed changes

en-jin19 added 6 commits August 23, 2021 21:58

Update explore-htap.md

eb109b7

Update quick-start-with-htap.md

1180a0e

Merge remote-tracking branch 'upstream/master' into add-docs-quick-st…

fd43b47

…art-with-HTAP-and-exploring-HTAP-

Merge branch 'add-docs-quick-start-with-HTAP-and-exploring-HTAP-' of h…

b2d380d

…ttps://github.com/en-jin19/docs into add-docs-quick-start-with-HTAP-and-exploring-HTAP-

Update quick-start-with-htap.md

c266e60

Update quick-start-with-htap.md

f1900e5

moyun suggested changes Aug 24, 2021

View reviewed changes

TomShawn added the needs-cherry-pick-release-5.2 label Aug 25, 2021

en-jin19 commented Aug 25, 2021

View reviewed changes

explore-htap.md Outdated Show resolved Hide resolved

qiancai reviewed Aug 25, 2021

View reviewed changes

qiancai reviewed Aug 26, 2021

View reviewed changes

Apply suggestions from code review

0aa4719

Co-authored-by: Grace Cai <[email protected]>

pingcap deleted a comment from qiancai Aug 26, 2021

Apply suggestions from code review

22eb9ec

Co-authored-by: Grace Cai <[email protected]>

Apply suggestions from code review

b1ff5a9

Co-authored-by: Enwei <[email protected]>

qiancai reviewed Aug 26, 2021

View reviewed changes

explore-htap.md Outdated Show resolved Hide resolved

qiancai reviewed Aug 26, 2021

View reviewed changes

explore-htap.md Outdated Show resolved Hide resolved

explore-htap.md Outdated Show resolved Hide resolved

explore-htap.md Outdated Show resolved Hide resolved

explore-htap.md Outdated Show resolved Hide resolved

en-jin19 and others added 4 commits August 27, 2021 07:31

Apply suggestions from code review

97b5d1d

Co-authored-by: Grace Cai <[email protected]>

Apply suggestions from code review

86a3654

Co-authored-by: Grace Cai <[email protected]>

Update quick-start-with-htap.md

c82a730

Update explore-htap.md

fbd5243

Co-authored-by: Enwei <[email protected]>

LiSong0214 approved these changes Aug 27, 2021

View reviewed changes

qiancai approved these changes Aug 27, 2021

View reviewed changes

ti-chi-bot added the status/LGT1 Indicates that a PR has LGTM 1. label Aug 27, 2021

qiancai mentioned this pull request Aug 27, 2021

quick-start-with-htap：update the tiup command pingcap/docs-cn#7001

Merged

13 tasks

moyun approved these changes Aug 27, 2021

View reviewed changes

ti-chi-bot mentioned this pull request Aug 27, 2021

quick-start-with-htap：update the tiup command (#7001) pingcap/docs-cn#7005

Merged

13 tasks

ti-chi-bot added status/LGT2 Indicates that a PR has LGTM 2. and removed status/LGT1 Indicates that a PR has LGTM 1. labels Aug 27, 2021

ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Aug 27, 2021

ti-chi-bot merged commit b589312 into pingcap:master Aug 27, 2021

ti-chi-bot mentioned this pull request Aug 27, 2021

add two HTAP documents (#6206) #6321

Merged

11 tasks

ti-chi-bot added a commit that referenced this pull request Aug 27, 2021

add two HTAP documents (#6206) (#6321)

6991754

hfxsd mentioned this pull request Aug 29, 2022

releases: add TiDB 6.1.1 release notes #10139

Merged

12 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add two HTAP documents #6206

add two HTAP documents #6206

en-jin19 commented Aug 22, 2021

ti-chi-bot commented Aug 22, 2021 •

edited

Loading

en-jin19 commented Aug 22, 2021 •

edited

Loading

dveeden Aug 23, 2021

qiancai Aug 24, 2021

dveeden Aug 23, 2021

dveeden Aug 23, 2021

LiSong0214 Aug 23, 2021

qiancai Aug 24, 2021

moyun left a comment

moyun Aug 24, 2021

ti-chi-bot commented Aug 24, 2021

qiancai Aug 24, 2021

qiancai Aug 24, 2021

qiancai Aug 25, 2021

ti-chi-bot commented Aug 27, 2021

qiancai left a comment

moyun left a comment

ti-chi-bot commented Aug 27, 2021

qiancai commented Aug 27, 2021

ti-chi-bot commented Aug 27, 2021

qiancai commented Aug 27, 2021

qiancai commented Aug 27, 2021

ti-chi-bot commented Aug 27, 2021

ti-chi-bot commented Aug 27, 2021


		- Hybrid load

		When using TiDB for real-time Online Analytical Processing (OLAP) that is in hybrid load scenarios, you only need to provide an entry point. Then TiDB automatically selects different processing engines based on the specific business.


		## Prerequisites for environment

		Before exploring the features of TiDB HTAP, you need to configure TiDB and the corresponding storage engine according to the data volume. If the data volume is huge (for example, 100 T), it is recommended to use TiFlash Massively Parallel Processing (MPP) as the primary solution and TiSpark as the supplementary solution.


		In the result of above statement:

		- `AVAILABLE` indicates whether the TiFlash replicas of this table is available or not. `1` means available and `0` means unavailable. Once the replicas become available, this status does not change. If you use DDL statements to modify the number of replicas, the replication status will be recalculated.

add two HTAP documents #6206

add two HTAP documents #6206

Conversation

en-jin19 commented Aug 22, 2021

What is changed, added or deleted? (Required)

Which TiDB version(s) do your changes apply to? (Required)

What is the related PR or file link(s)?

Do your changes match any of the following descriptions?

ti-chi-bot commented Aug 22, 2021 • edited Loading

en-jin19 commented Aug 22, 2021 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

moyun left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

ti-chi-bot commented Aug 24, 2021

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

ti-chi-bot commented Aug 27, 2021

qiancai left a comment

Choose a reason for hiding this comment

moyun left a comment

Choose a reason for hiding this comment

ti-chi-bot commented Aug 27, 2021

qiancai commented Aug 27, 2021

ti-chi-bot commented Aug 27, 2021

qiancai commented Aug 27, 2021

qiancai commented Aug 27, 2021

ti-chi-bot commented Aug 27, 2021

ti-chi-bot commented Aug 27, 2021

ti-chi-bot commented Aug 22, 2021 •

edited

Loading

en-jin19 commented Aug 22, 2021 •

edited

Loading