Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change time limit for unit tests to 60 seconds and introduce a decorator for long running tests #2661

Closed
wants to merge 1 commit into from

Conversation

paschai
Copy link
Contributor

@paschai paschai commented Aug 15, 2024

Summary:
This diff is to change the time limit for unit tests to 60 seconds and introduce a decorator for long running tests.

We'll use the ax_long_text decorator to identify all long running tests, which we can fix over time by creating backlog tasks for test-owners to update these long-running tests with a descriptive message.

This change also introduces this decorator to all tests running over 60 seconds. For now, the provided reason for these long running tests are placeholders.

Differential Revision: D61212556

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 15, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61212556

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61212556

paschai added a commit to paschai/Ax that referenced this pull request Aug 15, 2024
…tor for long running tests (facebook#2661)

Summary:
Pull Request resolved: facebook#2661

This diff is to change the time limit for unit tests to 60 seconds and introduce a decorator for long running tests.

We'll use the `ax_long_text` decorator to identify all long running tests, which we can fix over time by creating backlog tasks for test-owners to update these long-running tests with a descriptive message.

This change also introduces this decorator to all tests running over 60 seconds. For now, the provided reason for these long running tests are placeholders.

Differential Revision: D61212556
…tor for long running tests (facebook#2661)

Summary:
Pull Request resolved: facebook#2661

This diff is to change the time limit for unit tests to 60 seconds and introduce a decorator for long running tests.

We'll use the `ax_long_text` decorator to identify all long running tests, which we can fix over time by creating backlog tasks for test-owners to update these long-running tests with a descriptive message.

This change also introduces this decorator to all tests running over 60 seconds. For now, the provided reason for these long running tests are placeholders.

Reviewed By: mpolson64

Differential Revision: D61212556
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61212556

@codecov-commenter
Copy link

Codecov Report

Attention: Patch coverage is 76.19048% with 5 lines in your changes missing coverage. Please review.

Project coverage is 95.28%. Comparing base (788704e) to head (e1e5a13).

Files Patch % Lines
ax/utils/common/testutils.py 61.53% 5 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2661      +/-   ##
==========================================
- Coverage   95.29%   95.28%   -0.01%     
==========================================
  Files         492      492              
  Lines       47815    47834      +19     
==========================================
+ Hits        45566    45581      +15     
- Misses       2249     2253       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in c8da4ba.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants