-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Respect orderable constraint in ArgumentTypeFuzzer #6950
Conversation
✅ Deploy Preview for meta-velox canceled.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@duanmeng Looks good. Some comments below.
5a93a62
to
304e4f9
Compare
@mbasmanova Hi Masha, I've resolved all the comments and kept this focus on having fuzzer respect 'orderable' property in function. Could you please help to take a look? Thanks a lot. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks.
@mbasmanova has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
@mbasmanova merged this pull request in 30e1854. |
Conbench analyzed the 1 benchmark run on commit There was 1 benchmark result indicating a performance regression:
The full Conbench report has more details. |
CC: @assignUser Looks like false positive from Conbench. |
…#6950) Summary: PR facebookincubator#6906 added support to restricting arguments as orderable. This PR changes ArgumentTypeFuzzer to respect this constraint. Part of facebookincubator#6718 Pull Request resolved: facebookincubator#6950 Reviewed By: Yuhta Differential Revision: D50212902 Pulled By: mbasmanova fbshipit-source-id: 318b5e443baba7b6800539fafcf34946e6f0e91d
Yeah, I agree this is post-merge check is probably a false positive, since the pre-merge check passed. Some background: When we run benchmarks on PR HEAD commits in this repo, we make sure to retry any slower benchmarks 5 times to reduce the chance of a false positive (so PRs aren't blocked). But we don't do retries on merge-commits, for a few reasons:
Instead, merge-commits run each microbenchmark just once. So they might be slightly more likely to have a false positive. Why run benchmarks and alert on merge-commits at all? We've seen in the past that sometimes the facebook-github-bot misses PR signals and will merge a PR anyway. If that happened on a PR that actually introduced a regression, we'd rather be notified about it on the PR sooner. So it's probably worth the occasional false positive comment for confirmation. |
PR #6906 added support to restricting arguments as orderable.
This PR changes ArgumentTypeFuzzer to respect this constraint.
Part of #6718