Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Try to reduce space usage in dist CI #129797

Merged
merged 4 commits into from
Aug 31, 2024

Conversation

workingjubilee
Copy link
Member

@workingjubilee workingjubilee commented Aug 31, 2024

We have had recurrent CI problems as a result of GitHub adding a new version of Xcode to its runners1, which has consumed ~40GB of space which served as padding. Try to reduce the number of Xcodes on our systems, because we only use Xcode 14 in actual practice. Also, try to move files instead of pointlessly copy them when we're at the end of the job.

I could not resist addressing a few shellcheck lints while I was at it.

Footnotes

  1. https://github.com/actions/runner-images/issues/10511

@rustbot rustbot added A-testsuite Area: The testsuite used to check the correctness of rustc S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. labels Aug 31, 2024
@rust-log-analyzer

This comment has been minimized.

@workingjubilee
Copy link
Member Author

@bors try

@workingjubilee
Copy link
Member Author

huh.

@bors
Copy link
Contributor

bors commented Aug 31, 2024

⌛ Trying commit da4cb91 with merge 9a97493...

bors added a commit to rust-lang-ci/rust that referenced this pull request Aug 31, 2024
…try>

Hunt down The Fruit Company's latest release

I expect this to be... tedious.

r? `@ghost`

try-job: dist-aarch64-apple
try-job: dist-x86_64-linux
try-job: dist-x86_64-msvc
@workingjubilee
Copy link
Member Author

Oh there we go.

@rust-log-analyzer

This comment has been minimized.

@bors
Copy link
Contributor

bors commented Aug 31, 2024

💔 Test failed - checks-actions

@bors bors added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Aug 31, 2024
@workingjubilee
Copy link
Member Author

Neat.

@bors try

bors added a commit to rust-lang-ci/rust that referenced this pull request Aug 31, 2024
…try>

Hunt down The Fruit Company's latest release

I expect this to be... tedious.

r? `@ghost`

try-job: dist-aarch64-apple
try-job: dist-x86_64-linux
try-job: dist-x86_64-msvc
@bors
Copy link
Contributor

bors commented Aug 31, 2024

⌛ Trying commit 005f3fc with merge 450ed18...

@rust-log-analyzer

This comment has been minimized.

@bors
Copy link
Contributor

bors commented Aug 31, 2024

💔 Test failed - checks-actions

@workingjubilee
Copy link
Member Author

@bors try

bors added a commit to rust-lang-ci/rust that referenced this pull request Aug 31, 2024
…try>

Hunt down The Fruit Company's latest release

I expect this to be... tedious.

r? `@ghost`

try-job: dist-aarch64-apple
try-job: dist-x86_64-linux
try-job: dist-x86_64-msvc
@bors
Copy link
Contributor

bors commented Aug 31, 2024

⌛ Trying commit 0b61e33 with merge 8916429...

@rust-log-analyzer

This comment has been minimized.

@bors
Copy link
Contributor

bors commented Aug 31, 2024

💔 Test failed - checks-actions

@workingjubilee
Copy link
Member Author

@bors try

bors added a commit to rust-lang-ci/rust that referenced this pull request Aug 31, 2024
…try>

Hunt down The Fruit Company's latest release

I expect this to be... tedious.

r? `@ghost`

try-job: dist-aarch64-apple
try-job: dist-x86_64-linux
try-job: dist-x86_64-msvc
@bors
Copy link
Contributor

bors commented Aug 31, 2024

⌛ Trying commit 0fbd6bb with merge 7c567d6...

@rust-log-analyzer

This comment has been minimized.

@bors
Copy link
Contributor

bors commented Aug 31, 2024

💔 Test failed - checks-actions

@bors
Copy link
Contributor

bors commented Aug 31, 2024

⌛ Testing commit 10752a0 with merge ca05929...

bors added a commit to rust-lang-ci/rust that referenced this pull request Aug 31, 2024
…orkingjubilee

Try to reduce space usage in dist CI

We have had recurrent CI problems as a result of GitHub adding a new version of Xcode to its runners[^0], which has consumed ~40GB of space which served as padding. Try to reduce the number of Xcodes on our systems, because we only use Xcode 14 in actual practice. Also, try to move files instead of pointlessly copy them when we're at the end of the job.

I could not resist addressing a few shellcheck lints while I was at it.

[^0]: actions/runner-images#10511
@bors
Copy link
Contributor

bors commented Aug 31, 2024

💔 Test failed - checks-actions

@bors bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Aug 31, 2024
@rust-log-analyzer

This comment has been minimized.

@workingjubilee
Copy link
Member Author

@bors r+

@bors
Copy link
Contributor

bors commented Aug 31, 2024

📌 Commit 8da1c00 has been approved by workingjubilee

It is now in the queue for this repository.

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Aug 31, 2024
@bors
Copy link
Contributor

bors commented Aug 31, 2024

⌛ Testing commit 8da1c00 with merge fa72f07...

@workingjubilee
Copy link
Member Author

dist-aarch64-apple has gone green!

@bors
Copy link
Contributor

bors commented Aug 31, 2024

☀️ Test successful - checks-actions
Approved by: workingjubilee
Pushing fa72f07 to master...

@bors bors added the merged-by-bors This PR was explicitly merged by bors. label Aug 31, 2024
@bors bors merged commit fa72f07 into rust-lang:master Aug 31, 2024
7 checks passed
echo "xcode-select.sh's brutal hack may not be necessary?"
exit 1
elif [[ $SELECT_XCODE =~ "16" ]]; then
echo "Using Xcode 16? Please fix xcode-select.sh"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
echo "Using Xcode 16? Please fix xcode-select.sh"
echo "Using Xcode 16? Please fix select-xcode.sh"

@rustbot rustbot added this to the 1.82.0 milestone Aug 31, 2024
@workingjubilee workingjubilee deleted the cleanup-apple-ci branch August 31, 2024 06:20
@rust-timer
Copy link
Collaborator

Finished benchmarking commit (fa72f07): comparison URL.

Overall result: ❌✅ regressions and improvements - ACTION NEEDED

Next Steps: If you can justify the regressions found in this perf run, please indicate this with @rustbot label: +perf-regression-triaged along with sufficient written justification. If you cannot justify the regressions please open an issue or create a new PR that fixes the regressions, add a comment linking to the newly created issue or PR, and then add the perf-regression-triaged label to this PR.

@rustbot label: +perf-regression
cc @rust-lang/wg-compiler-performance

Instruction count

This is a highly reliable metric that was used to determine the overall result at the top of this comment.

mean range count
Regressions ❌
(primary)
1.0% [0.6%, 2.8%] 5
Regressions ❌
(secondary)
0.4% [0.3%, 0.6%] 6
Improvements ✅
(primary)
-0.6% [-0.6%, -0.6%] 1
Improvements ✅
(secondary)
-0.3% [-0.3%, -0.3%] 1
All ❌✅ (primary) 0.8% [-0.6%, 2.8%] 6

Max RSS (memory usage)

Results (primary 0.0%, secondary -0.5%)

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean range count
Regressions ❌
(primary)
0.9% [0.4%, 2.4%] 24
Regressions ❌
(secondary)
0.6% [0.4%, 1.4%] 20
Improvements ✅
(primary)
-0.8% [-1.7%, -0.4%] 27
Improvements ✅
(secondary)
-0.8% [-2.0%, -0.4%] 66
All ❌✅ (primary) 0.0% [-1.7%, 2.4%] 51

Cycles

Results (primary 0.7%, secondary 0.3%)

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean range count
Regressions ❌
(primary)
1.4% [0.4%, 6.2%] 18
Regressions ❌
(secondary)
1.1% [0.4%, 4.0%] 66
Improvements ✅
(primary)
-0.7% [-1.9%, -0.4%] 9
Improvements ✅
(secondary)
-1.0% [-5.0%, -0.4%] 45
All ❌✅ (primary) 0.7% [-1.9%, 6.2%] 27

Binary size

Results (primary 0.4%)

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean range count
Regressions ❌
(primary)
0.4% [0.4%, 0.4%] 1
Regressions ❌
(secondary)
- - 0
Improvements ✅
(primary)
- - 0
Improvements ✅
(secondary)
- - 0
All ❌✅ (primary) 0.4% [0.4%, 0.4%] 1

Bootstrap: 788.226s -> 789.792s (0.20%)
Artifact size: 338.74 MiB -> 338.69 MiB (-0.01%)

@rustbot rustbot added the perf-regression Performance regression. label Aug 31, 2024
@workingjubilee
Copy link
Member Author

...fascinating.

@RalfJung
Copy link
Member

Given that self-approved PRs are not really a thing we do outside of tool updates (to my knowledge), would be good to link to some context here. I think that context is this.

@Kobzol
Copy link
Contributor

Kobzol commented Aug 31, 2024

...fascinating.

The tree being closed coincided with the collector borking measurement of the previous master commit. I believe that this perf. result is an artifact of that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-testsuite Area: The testsuite used to check the correctness of rustc merged-by-bors This PR was explicitly merged by bors. perf-regression Performance regression. S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants