Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: physical plan wrapper #1837

Merged
merged 35 commits into from
Jun 27, 2023
Merged

Conversation

shuiyisong
Copy link
Contributor

@shuiyisong shuiyisong commented Jun 27, 2023

I hereby agree to the terms of the GreptimeDB CLA

What's changed and what's your intention?

This pr mainly does

  1. introduce PhysicalPlanWrapper for plan execution hook
    • e.g: metrics retrieval
  2. pass Plugins to DatafusionQueryEngine to get PhysicalPlanWrapper in exec_query_plan
  3. fix a bug in src/common/query/src/physical_plan.rs to get correct row count

Checklist

  • I have written the necessary rustdoc comments.
  • I have added the necessary unit tests and integration tests.

Refer to a related PR or issue link (optional)

@codecov
Copy link

codecov bot commented Jun 27, 2023

Codecov Report

Merging #1837 (5c2b9b1) into develop (dcfce49) will decrease coverage by 0.27%.
The diff coverage is 76.59%.

@@             Coverage Diff             @@
##           develop    #1837      +/-   ##
===========================================
- Coverage    86.51%   86.24%   -0.27%     
===========================================
  Files          587      587              
  Lines        95642    95670      +28     
===========================================
- Hits         82745    82511     -234     
- Misses       12897    13159     +262     

@sunng87 sunng87 merged commit 03057ca into GreptimeTeam:develop Jun 27, 2023
13 checks passed
@shuiyisong shuiyisong deleted the feat/read_meter branch June 27, 2023 06:12
paomian pushed a commit to paomian/greptimedb that referenced this pull request Oct 19, 2023
* test: add physical plan wrapper trait

* test: add plugins to datanode initialization

* test: add plugins to datanode initialization

* chore: add metrics method

* chore: update meter-core version

* chore: remove unused code

* chore: impl metrics method on df execution plan adapter

* chore: minor comment fix

* chore: add retry in create table

* chore: shrink keep lease handler buffer

* chore: add etcd batch size warn

* chore: try shrink

* Revert "chore: try shrink"

This reverts commit 0361b51.

* chore: add create table backup time

* add metrics in some interfaces

Signed-off-by: Ruihang Xia <[email protected]>

* calc elapsed time and rows

Signed-off-by: Ruihang Xia <[email protected]>

* chore: remove timer in scan batch

* chore: add back stream metrics wrapper

* chore: add timer to ready poll

* chore: minor update

* chore: try using df_plan.metrics()

* chore: remove table scan timer

* chore: remove scan timer

* chore: add debug log

* Revert "chore: add debug log"

This reverts commit 672a013.

* chore: use batch size as row count

* chore: use batch size as row count

* chore: tune code for pr

* chore: rename to physical plan wrapper

---------

Signed-off-by: Ruihang Xia <[email protected]>
Co-authored-by: Ruihang Xia <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants