util/stmtsummary: discard the plan if it is too long and enlarge the tidb_stmt_summary_max_stmt_count value to 3000 (#25843)

[ti-srebot]

cherry-pick #25843 to release-5.0
You can switch your code base to this Pull Request by using git-extras:

# In tidb repo:
git pr https://github.com/pingcap/tidb/pull/25873

After apply modifications, you can push your change to this PR via:

git push [email protected]:ti-srebot/tidb.git pr/25873:release-5.0-c4424c2920b5

---

Signed-off-by: crazycs [email protected]

What problem does this PR solve?

1. Currently statements_summary doesn't restrict the plan size, in some extreme scenarios, TIDB might OOM. This PR discards the statements_summary plan if it is too long (encode plan size more than 1MB) to avoid occupies too much memory.

2. Enlarge tidb_stmt_summary_max_stmt_count default value from 200 to 3000. Since 200 is too small when troubleshooting.

What is changed and how it works?

About Enlarge tidb_stmt_summary_max_stmt_count default value, this doc record the test process. The final conclusion is:
Enlarge the tidb_stmt_summary_max_stmt_count default value to 3000:

• If the SQL size is 1024, cache 3000 statements only consume 55MB, memory.
• If the SQL size is 10240, cache 3000 statements only consume 200MB memory.

Related changes

• PR to update pingcap/docs/pingcap/docs-cn:

Check List

Tests

• Unit test
• Manual test

Side effects

• Performance regression
  • Consumes more MEM
• Breaking backward compatibility

Release note

• Enlarge the variable tidb_stmt_summary_max_stmt_count default value from 200 to 3000

[ti-srebot]

/run-all-tests

[ti-srebot]

@crazycs520 you're already a collaborator in bot's repo.

[crazycs520]

@djshow832 PTAL

[ti-chi-bot]

[REVIEW NOTIFICATION]

This pull request has been approved by:

• breeswish
• djshow832

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

[crazycs520]

/merge

[ti-chi-bot]

This pull request has been accepted and is ready to merge.

Commit hash: 7c0cac7

[ti-chi-bot]

@ti-srebot: Your PR was out of date, I have automatically updated it for you.

At the same time I will also trigger all tests for you:

/run-all-tests

If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.