Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CHORE] Add TPC-H questions 11-22 to benchmarks (currently skipped) #2299

Merged
merged 7 commits into from
Jul 20, 2024

Conversation

kevinzwang
Copy link
Member

No description provided.

@kevinzwang kevinzwang requested a review from jaychia May 24, 2024 03:31
@github-actions github-actions bot added the chore label May 24, 2024
@kevinzwang kevinzwang changed the title [CHORE] Add TPCH questions 11-22 to benchmarks [CHORE] Add TPC-H questions 11-22 to benchmarks May 24, 2024
Copy link
Contributor

@jaychia jaychia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome! Really the only downside is our CI takes 14m now which is dangerously close to timing out...

@kevinzwang
Copy link
Member Author

Awesome! Really the only downside is our CI takes 14m now which is dangerously close to timing out...

Is it possible to cache the build and run each question in its own action?

@kevinzwang
Copy link
Member Author

Update from discussion: will look into questions 17, 20, 22 to see if there is a simple way to improve their speeds first before merging

res_1.where(col("C_ACCTBAL") > 0).agg(col("C_ACCTBAL").mean().alias("avg_acctbal")).with_column("lit", lit(1))
)

res_3 = orders.select("O_CUSTKEY").distinct()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

discussed offline but we can likely remove these distinct since we are doing a not exists and dont care about the dup values.

Copy link

codecov bot commented Jun 4, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 79.05%. Comparing base (00eb8e1) to head (41c720d).

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #2299      +/-   ##
==========================================
+ Coverage   78.47%   79.05%   +0.58%     
==========================================
  Files         473      473              
  Lines       56045    55150     -895     
==========================================
- Hits        43981    43600     -381     
+ Misses      12064    11550     -514     

see 11 files with indirect coverage changes

@kevinzwang kevinzwang changed the title [CHORE] Add TPC-H questions 11-22 to benchmarks [CHORE] Add TPC-H questions 11-22 to benchmarks (currently skipped) Jul 19, 2024
@kevinzwang kevinzwang enabled auto-merge (squash) July 20, 2024 00:17
@kevinzwang kevinzwang merged commit fd67dac into main Jul 20, 2024
44 checks passed
@kevinzwang kevinzwang deleted the kevin/all-tpch branch July 20, 2024 00:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants