Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move benchmark/metrics/benchmark.py to benchmark_metric.py #2712

Closed
wants to merge 4 commits into from

Conversation

esantorella
Copy link
Contributor

Summary: After a refactor that deleted many metric subclasses, metrics/benchmark.py has only one file in its folder, so there is no need for a folder. This PR gets rid of the folder, moving ax/benchmark/metrics/benchmark.py to ax/benchmark/benchmark_metric.py

Differential Revision: D61736027

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 26, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61736027

esantorella and others added 4 commits August 27, 2024 06:56
…#2704)

Summary:
Pull Request resolved: facebook#2704

This currently doesn't change behavior, but enables more flexibility by redefining `Problem.get_ground_truth_opt_trace` or `BenchmarkRunner.get_Y_true`. This is currently duplicative with the tracking metrics setup, which will be reaped in D61432000; these should be combined. This diff has both ways of computing the optimization trace running, along with an assertion that they give the same results.

Differential Revision: D61404056

Reviewed By: saitcakmak
Summary:
Pull Request resolved: facebook#2706

No longer needed after the changes in the previous diff.

Differential Revision: D61415525

Reviewed By: Balandat
Summary:
There is no need to have multiple files here anymore now that a lot of BenchmarkMetric functionality has disappeared.

In a future diff I may move `benchmark/metrics/benchmark.py` to `benchmark/benchmark_metric.py`, but there are a lot of usages to update.

Differential Revision: D61432000
…2712)

Summary:
Pull Request resolved: facebook#2712

After a refactor that deleted many metric subclasses, metrics/benchmark.py has only one file in its folder, so there is no need for a folder. This PR gets rid of the folder, moving ax/benchmark/metrics/benchmark.py to ax/benchmark/benchmark_metric.py

Reviewed By: saitcakmak, Balandat

Differential Revision: D61736027
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61736027

@codecov-commenter
Copy link

Codecov Report

Attention: Patch coverage is 96.66667% with 3 lines in your changes missing coverage. Please review.

Project coverage is 95.39%. Comparing base (f1d2f88) to head (80c10d5).

Files Patch % Lines
ax/benchmark/benchmark_metric.py 90.62% 3 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2712      +/-   ##
==========================================
- Coverage   95.39%   95.39%   -0.01%     
==========================================
  Files         492      490       -2     
  Lines       47920    47738     -182     
==========================================
- Hits        45715    45541     -174     
+ Misses       2205     2197       -8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in c51dd58.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants