Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AuxiliaryExperiment #2632

Closed
wants to merge 2 commits into from
Closed

Conversation

ItsMrLin
Copy link
Contributor

@ItsMrLin ItsMrLin commented Aug 2, 2024

Summary:
Adding AuxiliaryExperiment

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Differential Revision: D60192602

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 2, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D60192602

@codecov-commenter
Copy link

codecov-commenter commented Aug 2, 2024

Codecov Report

Attention: Patch coverage is 87.30159% with 8 lines in your changes missing coverage. Please review.

Project coverage is 95.25%. Comparing base (a61c362) to head (0b26186).

Files Patch % Lines
ax/utils/testing/preference_stubs.py 76.92% 6 Missing ⚠️
ax/core/auxiliary.py 83.33% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2632      +/-   ##
==========================================
- Coverage   95.26%   95.25%   -0.02%     
==========================================
  Files         493      495       +2     
  Lines       47753    47807      +54     
==========================================
+ Hits        45493    45539      +46     
- Misses       2260     2268       +8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Summary: Expanding get_pbo_experiment to be able to generate preference exploration experiments with only preferential feedback and nearly unbounded (technically really large) search space.

Differential Revision: D60192601
ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 14, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Differential Revision: D60192602

Reviewed By: mgarrard
ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 14, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Differential Revision: D60192602

Reviewed By: mgarrard
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D60192602

ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 14, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment to allow for experiments and models to use other experiments as auxiliary information during optimization

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Reviewed By: saitcakmak, mgarrard, lena-kashtelyan

Differential Revision: D60192602
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D60192602

ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 14, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment to allow for experiments and models to use other experiments as auxiliary information during optimization

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Reviewed By: saitcakmak, mgarrard, lena-kashtelyan

Differential Revision: D60192602
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment to allow for experiments and models to use other experiments as auxiliary information during optimization

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Reviewed By: saitcakmak, mgarrard, lena-kashtelyan

Differential Revision: D60192602
ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 14, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Differential Revision: D60192602

Reviewed By: mgarrard
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D60192602

ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 15, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Differential Revision: D60192602

Reviewed By: mgarrard
ItsMrLin added a commit to ItsMrLin/Ax that referenced this pull request Aug 15, 2024
Summary:
Pull Request resolved: facebook#2632

Adding AuxiliaryExperiment

Meta: Design doc https://docs.google.com/document/d/1MYq4WHPDLoWp-RUyk7jXiqswKARtyoSeM68PRayPGUk/edit?usp=sharing

Differential Revision: D60192602

Reviewed By: mgarrard
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 3f82b1d.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants