*: use pprof profile to collect CPU time group by SQL and plan digest

[crazycs520]

Track issue: #24875

What problem does this PR solve?

This PR uses pprof profile labels to collect CPU time group by SQL and plan digest.

What is changed and how it works?

The implementation is:

1: Use SQL digest and plan digest as the pprof labels.

// After parse and calculated SQL digest, set the sql digest label
ctx = pprof.WithLabels(ctx, pprof.Labels("sql_digest", sql_digest))
pprof.SetGoroutineLabels(ctx)

...

// After the optimizer generated plan, set the plan digest label.
ctx = pprof.WithLabels(ctx, pprof.Labels("plan_digest", plan_digest))
pprof.SetGoroutineLabels(ctx)

There is a special case, for execute stmt SQL, should use the prepare SQL digest as the sql_digest pprof label.

2. Start 2 background worker to fetch profile and analyze the profile data.

Using a buffer channel to avoid parse and output take too much time that infect the fetching profile work.

Other problem

Because the profile worker keep calling pprof.StartCPUProfile to fetch profile data, other place (such pprof profile HTTP API handler) call pprof.StartCPUProfile will be failed.

In order to solve this problem, other place should fetch profile data from profile worker instead of pprof.StartCPUProfile.

Check List

Tests

• Unit test

Side effects

• Performance regression
  • Consumes more CPU
  • Consumes more MEM

Release note

• No release note

[crazycs520]

/run-all-tests

[crazycs520]

/run-all-tests

[crazycs520]

/run-all-tests

[breezewish]

/run-all-tests

[crazycs520]

/run-common-test
/run-integration-common-test
/run-unit-test

[crazycs520]

/run-common-test
/run-integration-common-test

[crazycs520]

/run-common-test
/run-integration-common-test

[crazycs520]

/run-common-test

[crazycs520]

/run-common-test tidb-test=master

[ti-srebot]

No release note, Please follow https://github.com/pingcap/community/blob/master/contributors/release-note-checker.md

[crazycs520]

/run-all-tests

[crazycs520]

/build

[ti-srebot]

No release note, Please follow https://github.com/pingcap/community/blob/master/contributors/release-note-checker.md

[crazycs520]

/run-check_release_note

[crazycs520]

/merge

[ti-chi-bot]

This pull request has been accepted and is ready to merge.

Commit hash: 75e8d94

[crazycs520]

/merge

[Linda-wang00]

Hi Thank you for your excellent services!