Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve EXPLAIN ANALYZE output for parquet exec #4144

Closed
alamb opened this issue Nov 8, 2022 · 1 comment · Fixed by #4157
Closed

Improve EXPLAIN ANALYZE output for parquet exec #4144

alamb opened this issue Nov 8, 2022 · 1 comment · Fixed by #4157
Assignees
@alamb
Labels
enhancement New feature or request

Comments

@alamb
Copy link
Contributor

alamb commented Nov 8, 2022

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

I have been using EXPLIN ANALYZE to do some adhoc analysis on our query output

At the moment, explain analyze shows all statistics for all parquet files scanned -- this is often overwhelming for manual analysis

Describe the solution you'd like
What I would like is a summarized version of all the statistics (like we do for partitions) for all the parquet files. I would like per-file breakdowns only reported with EXPLAIN ANALYZE VERBOSE so I can understand at a high level what happened

Something like:

|                   |             ParquetExec: limit=None, metrics=[output_rows=47870000, elapsed_compute=4ns, spill_count=0, spilled_bytes=0, mem_used=0, bytes_scanned=35328432, row_groups_pruned=0, predicate_evaluation_errors=0, pushdown_rows_filtered=4, num_predicate_creation_errors=0, pushdown_eval_time=1.23756ms, time_elapsed_opening=27.569443574s, time_elapsed_processing=2.772865879s, time_elapsed_scanning=646.659086ms,

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context

For example

Here is an example output:

|                   |             ParquetExec: limit=None, partitions=[52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet, 52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet, 52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet, 52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet, 52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet, 52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet, 52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet, 52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet, 52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet, 52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet, 52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet, 52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet, 52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet, 52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet, 52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet, 52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet, 52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet, 52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet, 52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet, 52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet, 52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet, 52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet, 52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet, 52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet, 52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet, 52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet, 52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet, 52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet, 52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet, 52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet, 52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet], predicate=time_max@0 > 1664641920000000000, projection=[time, x], metrics=[output_rows=47870000, elapsed_compute=4ns, spill_count=0, spilled_bytes=0, mem_used=0, bytes_scanned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=35328432, row_groups_pruned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=22064691, predicate_evaluation_errors{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=35054700, row_groups_pruned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=6427709, predicate_evaluation_errors{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=5105961, bytes_scanned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=2080000, pushdown_rows_filtered{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0, num_predicate_creation_errors=0, row_groups_pruned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=35398092, predicate_evaluation_errors{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=17659207, row_groups_pruned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=24862359, row_groups_pruned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0, bytes_scanned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=419938, bytes_scanned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=276307, bytes_scanned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=2707990, predicate_evaluation_errors{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=35302018, row_groups_pruned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=34756477, row_groups_pruned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=4354720, bytes_scanned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=35304985, predicate_evaluation_errors{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=35192963, pushdown_rows_filtered{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=26685271, row_groups_pruned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0, row_groups_pruned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=4350265, bytes_scanned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=3453404, bytes_scanned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=24713929, pushdown_rows_filtered{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0, row_groups_pruned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=14827386, row_groups_pruned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=17173777, bytes_scanned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=4274407, row_groups_pruned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0, bytes_scanned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=4261736, bytes_scanned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=4312620, predicate_evaluation_errors{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=4262967, bytes_scanned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=14892804, pushdown_rows_filtered{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=32735628, row_groups_pruned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=4282740, pushdown_rows_filtered{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0, pushdown_rows_filtered{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0, predicate_evaluation_errors{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0, row_groups_pruned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0, bytes_scanned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=34123728, pushdown_eval_time{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=1.23756ms, pushdown_eval_time{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=434.51µs, pushdown_eval_time{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=141.954µs, pushdown_eval_time{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=339.863µs, pushdown_eval_time{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=2.74232ms, pushdown_eval_time{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=3.336337ms, pushdown_eval_time{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=23.314µs, pushdown_eval_time{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=65.823µs, pushdown_eval_time{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=2.132315ms, pushdown_eval_time{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=3.237548ms, pushdown_eval_time{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=289.686µs, pushdown_eval_time{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=371.591µs, pushdown_eval_time{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=2.942928ms, pushdown_eval_time{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=2.826285ms, pushdown_eval_time{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=334.903µs, pushdown_eval_time{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=357.115µs, time_elapsed_opening=27.569443574s, pushdown_eval_time{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=1.278413ms, pushdown_eval_time{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=357.38µs, pushdown_eval_time{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=2.112358ms, pushdown_eval_time{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=563.716µs, time_elapsed_processing=2.772865879s, pushdown_eval_time{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=1.573234ms, pushdown_eval_time{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=3.431636ms, time_elapsed_scanning=646.659086ms, pushdown_eval_time{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=3.008817ms, pushdown_eval_time{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=356.773µs, pushdown_eval_time{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=3.838249ms, pushdown_eval_time{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=2.992907ms, pushdown_eval_time{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=3.943949ms, pushdown_eval_time{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=2.777043ms, pushdown_eval_time{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=198.13µs, pushdown_eval_time{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=1.497264ms, pushdown_eval_time{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=408.168µs] |

It is slightly more understandable if one adds newlines to it;

|                   |             ParquetExec: limit=None,
partitions=[52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet,
            52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet,
            52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet,
            52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet,
            52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet,
            52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet,
            52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet,
            52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet,
            52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet,
            52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet,
            52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet,
            52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet,
            52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet,
            52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet,
            52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet,
            52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet,
            52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet,
            52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet,
            52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet,
            52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet,
            52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet,
            52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet,
            52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet,
            52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet,
            52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet,
            52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet,
            52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet,
            52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet,
            52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet,
            52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet,
            52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet],
            predicate=time_max@0 > 1664641920000000000,
            projection=[time,
            x],
            metrics=[output_rows=47870000,
            elapsed_compute=4ns,
            spill_count=0,
            spilled_bytes=0,
            mem_used=0,
            bytes_scanned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=35328432,
            row_groups_pruned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=22064691,
            predicate_evaluation_errors{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=35054700,
            row_groups_pruned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=6427709,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=5105961,
            bytes_scanned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=2080000,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0,
            num_predicate_creation_errors=0,
            row_groups_pruned{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=35398092,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=17659207,
            row_groups_pruned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=24862359,
            row_groups_pruned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=419938,
            bytes_scanned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=276307,
            bytes_scanned{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=2707990,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=35302018,
            row_groups_pruned{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=34756477,
            row_groups_pruned{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=4354720,
            bytes_scanned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=35304985,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=35192963,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=26685271,
            row_groups_pruned{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=4350265,
            bytes_scanned{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=3453404,
            bytes_scanned{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=24713929,
            pushdown_rows_filtered{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=14827386,
            row_groups_pruned{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=17173777,
            bytes_scanned{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=4274407,
            row_groups_pruned{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=4261736,
            bytes_scanned{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=4312620,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=4262967,
            bytes_scanned{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=14892804,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=32735628,
            row_groups_pruned{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=4282740,
            pushdown_rows_filtered{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0,
            pushdown_rows_filtered{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=0,
            predicate_evaluation_errors{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=0,
            row_groups_pruned{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=0,
            bytes_scanned{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=34123728,
            pushdown_eval_time{filename=52175/298744/168/9947233/9f5310c3-7d5b-4526-9f54-41a448ba9b23.parquet}=1.23756ms,
            pushdown_eval_time{filename=52175/298744/168/9964586/132264f8-890d-4f94-9af0-9b43051ae9df.parquet}=434.51µs,
            pushdown_eval_time{filename=52175/298744/168/9211369/c74b2a8a-9aed-41de-8aeb-4ea91e9ee379.parquet}=141.954µs,
            pushdown_eval_time{filename=52175/298744/168/9947233/976e3674-c685-4055-a99d-52d0d01896cd.parquet}=339.863µs,
            pushdown_eval_time{filename=52175/298744/168/9964586/c92a8807-2d24-4917-8379-f4d386b75dd5.parquet}=2.74232ms,
            pushdown_eval_time{filename=52175/298744/168/9964586/a369f13a-c82e-40d0-94ec-9d0bcaf51cf0.parquet}=3.336337ms,
            pushdown_eval_time{filename=52175/298744/168/9964586/a623d8da-82d6-4882-a797-4471a7a478eb.parquet}=23.314µs,
            pushdown_eval_time{filename=52175/298744/168/9371389/a531e235-74f2-4dbe-95d6-6c4f987c49c0.parquet}=65.823µs,
            pushdown_eval_time{filename=52175/298744/168/9947233/2f1c512f-6110-4a68-a09e-48e548e67445.parquet}=2.132315ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/46658bf5-e3f1-46a6-9f83-a3dff0abc0b0.parquet}=3.237548ms,
            pushdown_eval_time{filename=52175/298744/168/9371389/56f24644-627b-49d8-a0c2-35d069b69729.parquet}=289.686µs,
            pushdown_eval_time{filename=52175/298744/168/9947233/189d0852-a773-4938-bdff-6424d2c76451.parquet}=371.591µs,
            pushdown_eval_time{filename=52175/298744/168/9947233/f3182c49-a7ca-4b3d-99c1-55b70f261a47.parquet}=2.942928ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/dbda66b3-c531-4c4d-a779-4d4f7ebb5d0f.parquet}=2.826285ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/7c1b1f84-fe54-4162-97c2-a168a25d8a23.parquet}=334.903µs,
            pushdown_eval_time{filename=52175/298744/168/9964586/f05aac85-a867-4f8d-9a26-dacfdce843e0.parquet}=357.115µs,
            time_elapsed_opening=27.569443574s,
            pushdown_eval_time{filename=52175/298744/168/9964586/81c46be9-7a9f-4366-9cff-c401bf94dc84.parquet}=1.278413ms,
            pushdown_eval_time{filename=52175/298744/168/9964586/b1b8107c-4441-4b18-9ee9-8e3a1464e63c.parquet}=357.38µs,
            pushdown_eval_time{filename=52175/298744/168/9964586/7ec07e22-52c9-4946-8602-de83fa501202.parquet}=2.112358ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/56ad7294-3954-458f-9196-c95851a9dd4a.parquet}=563.716µs,
            time_elapsed_processing=2.772865879s,
            pushdown_eval_time{filename=52175/298744/168/9947233/4ada5177-5956-4805-9c13-6fa9e4005783.parquet}=1.573234ms,
            pushdown_eval_time{filename=52175/298744/168/9964586/a5cd8e17-d743-4c6b-af2f-a3a167dfb1c5.parquet}=3.431636ms,
            time_elapsed_scanning=646.659086ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/6477881b-3679-4c0b-b47f-162c7b43ba77.parquet}=3.008817ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/ff400bf3-d810-46cc-b1a9-9564bd04e0ca.parquet}=356.773µs,
            pushdown_eval_time{filename=52175/298744/168/9947233/9e555a9c-5d08-4860-a55c-e9193d669fdd.parquet}=3.838249ms,
            pushdown_eval_time{filename=52175/298744/168/9964586/8ec63274-53db-45f2-86df-079642167892.parquet}=2.992907ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/052faff4-5958-4710-b9fd-80e78c489fb9.parquet}=3.943949ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/2045f628-1280-4b60-93eb-b5a12e1ddfd3.parquet}=2.777043ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/fad34179-5b25-40c2-a088-04c49e46b526.parquet}=198.13µs,
            pushdown_eval_time{filename=52175/298744/168/9947233/a0ec500f-5fac-4373-a7a0-62ae86817f05.parquet}=1.497264ms,
            pushdown_eval_time{filename=52175/298744/168/9947233/ba8d0d6f-edd8-4563-97b8-ad5b1e076b7e.parquet}=408.168µs] |
@alamb alamb added the enhancement New feature or request label Nov 8, 2022
@alamb
Copy link
Contributor Author

alamb commented Nov 8, 2022

cc @Ted-Jiang I plan to work on this at some point soon

@alamb alamb mentioned this issue Nov 9, 2022
Merged
@alamb alamb self-assigned this Nov 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alamb alamb

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Collapse statistics in normal explain plan alamb/datafusion
1 participant
@alamb