Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Respect orderable constraint in ArgumentTypeFuzzer #6950

Closed
wants to merge 1 commit into from

Conversation

duanmeng
Copy link
Collaborator

@duanmeng duanmeng commented Oct 7, 2023

PR #6906 added support to restricting arguments as orderable.

This PR changes ArgumentTypeFuzzer to respect this constraint.

Part of #6718

@netlify
Copy link

netlify bot commented Oct 7, 2023

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 97da0e8
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/652777b220ab8c000846f5a6

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 7, 2023
Copy link
Contributor

@mbasmanova mbasmanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@duanmeng Looks good. Some comments below.

velox/vector/fuzzer/VectorFuzzer.h Outdated Show resolved Hide resolved
velox/vector/fuzzer/VectorFuzzer.h Outdated Show resolved Hide resolved
velox/expression/tests/ArgumentTypeFuzzer.h Outdated Show resolved Hide resolved
velox/exec/tests/utils/AggregationFuzzer.cpp Outdated Show resolved Hide resolved
velox/vector/fuzzer/VectorFuzzer.h Outdated Show resolved Hide resolved
@duanmeng
Copy link
Collaborator Author

@mbasmanova Hi Masha, I've resolved all the comments and kept this focus on having fuzzer respect 'orderable' property in function. Could you please help to take a look? Thanks a lot.

Copy link
Contributor

@mbasmanova mbasmanova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks.

@facebook-github-bot
Copy link
Contributor

@mbasmanova has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@mbasmanova merged this pull request in 30e1854.

@conbench-facebook
Copy link

Conbench analyzed the 1 benchmark run on commit 30e1854d.

There was 1 benchmark result indicating a performance regression:

The full Conbench report has more details.

@mbasmanova
Copy link
Contributor

CC: @assignUser Looks like false positive from Conbench.

@mbasmanova
Copy link
Contributor

CC: @kgpai @pedroerp

ericyuliu pushed a commit to ericyuliu/velox that referenced this pull request Oct 12, 2023
…#6950)

Summary:
PR facebookincubator#6906 added support to restricting arguments as orderable.

This PR changes ArgumentTypeFuzzer to respect this constraint.

Part of facebookincubator#6718

Pull Request resolved: facebookincubator#6950

Reviewed By: Yuhta

Differential Revision: D50212902

Pulled By: mbasmanova

fbshipit-source-id: 318b5e443baba7b6800539fafcf34946e6f0e91d
@austin3dickey
Copy link
Collaborator

Looks like false positive from Conbench.

Yeah, I agree this is post-merge check is probably a false positive, since the pre-merge check passed.

Some background: When we run benchmarks on PR HEAD commits in this repo, we make sure to retry any slower benchmarks 5 times to reduce the chance of a false positive (so PRs aren't blocked). But we don't do retries on merge-commits, for a few reasons:

  • benchmarks were already run on the PR HEAD before merging, and they (probably) passed
  • cost

Instead, merge-commits run each microbenchmark just once. So they might be slightly more likely to have a false positive.

Why run benchmarks and alert on merge-commits at all? We've seen in the past that sometimes the facebook-github-bot misses PR signals and will merge a PR anyway. If that happened on a PR that actually introduced a regression, we'd rather be notified about it on the PR sooner. So it's probably worth the occasional false positive comment for confirmation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants