Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revert perf-regression 101620 #102064

Merged
merged 2 commits into from Sep 24, 2022
Merged

Revert perf-regression 101620 #102064

merged 2 commits into from Sep 24, 2022

Conversation

cjgillot
Copy link
Contributor

@cjgillot cjgillot commented Sep 20, 2022

@rustbot rustbot added A-query-system Area: The rustc query system (https://rustc-dev-guide.rust-lang.org/query.html) T-compiler Relevant to the compiler team, which will review and decide on the PR/issue. labels Sep 20, 2022
@rust-highfive rust-highfive added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Sep 20, 2022
@cjgillot cjgillot marked this pull request as ready for review Sep 20, 2022
@cjgillot
Copy link
Contributor Author

cjgillot commented Sep 20, 2022

@bors try @rust-timer queue

@rust-timer
Copy link
Collaborator

rust-timer commented Sep 20, 2022

Awaiting bors try build completion.

@rustbot label: +S-waiting-on-perf

@rustbot rustbot added the S-waiting-on-perf Status: Waiting on a perf run to be completed. label Sep 20, 2022
@bors
Copy link
Contributor

bors commented Sep 20, 2022

Trying commit a4708ad with merge 4ed50b7...

bors added a commit to rust-lang-ci/rust that referenced this issue Sep 20, 2022
Revert pref-regression 101620

Reverts rust-lang#101862 rust-lang#101620

r? `@Mark-Simulacrum`
@bors
Copy link
Contributor

bors commented Sep 20, 2022

☀️ Try build successful - checks-actions
Build commit: 4ed50b7 (4ed50b77a11b5371d2119b3a7fb491f7006f95b1)

@rust-timer
Copy link
Collaborator

rust-timer commented Sep 20, 2022

Queued 4ed50b7 with parent cd8cc91, future comparison URL.

@cjgillot cjgillot changed the title Revert pref-regression 101620 Revert perf-regression 101620 Sep 20, 2022
@rust-timer
Copy link
Collaborator

rust-timer commented Sep 20, 2022

Finished benchmarking commit (4ed50b7): comparison URL.

Overall result: regressions and improvements - ACTION NEEDED

Benchmarking this pull request likely means that it is perf-sensitive, so we're automatically marking it as not fit for rolling up. While you can manually mark this PR as fit for rollup, we strongly recommend not doing so since this PR may lead to changes in compiler perf.

Next Steps: If you can justify the regressions found in this try perf run, please indicate this with @rustbot label: +perf-regression-triaged along with sufficient written justification. If you cannot justify the regressions please fix the regressions and do another perf run. If the next run shows neutral or positive results, the label will be automatically removed.

@bors rollup=never
@rustbot label: +S-waiting-on-review -S-waiting-on-perf +perf-regression

Instruction count

This is a highly reliable metric that was used to determine the overall result at the top of this comment.

mean1 range count2
Regressions
(primary)
5.5% [0.3%, 33.5%] 34
Regressions
(secondary)
1.2% [0.3%, 1.8%] 13
Improvements
(primary)
-3.7% [-12.5%, -0.3%] 126
Improvements
(secondary)
-4.1% [-19.1%, -0.1%] 122
All (primary) -1.8% [-12.5%, 33.5%] 160

Max RSS (memory usage)

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean1 range count2
Regressions
(primary)
4.3% [0.8%, 10.9%] 13
Regressions
(secondary)
3.0% [3.0%, 3.0%] 2
Improvements
(primary)
-4.2% [-12.9%, -1.1%] 105
Improvements
(secondary)
-7.6% [-22.2%, -1.2%] 66
All (primary) -3.3% [-12.9%, 10.9%] 118

Cycles

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean1 range count2
Regressions
(primary)
14.3% [2.7%, 45.0%] 19
Regressions
(secondary)
3.8% [2.5%, 5.6%] 5
Improvements
(primary)
-4.8% [-13.7%, -1.2%] 82
Improvements
(secondary)
-8.7% [-24.1%, -2.0%] 60
All (primary) -1.2% [-13.7%, 45.0%] 101

Footnotes

  1. the arithmetic mean of the percent change 2 3

  2. number of relevant changes 2 3

@rustbot rustbot added perf-regression Performance regressions and removed S-waiting-on-perf Status: Waiting on a perf run to be completed. labels Sep 20, 2022
@Mark-Simulacrum
Copy link
Member

Mark-Simulacrum commented Sep 22, 2022

r=me, I guess needs a rebase.

Regressions are expected (we're reverting a PR that did improve performance on a subset of benchmarks) but overall the regressions there and the improvements here outweigh each other -- we see a 1.8% improvement in the primary benchmarks overall.

@Mark-Simulacrum Mark-Simulacrum added S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. perf-regression-triaged The performance regression has been triaged. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 22, 2022
@cjgillot
Copy link
Contributor Author

cjgillot commented Sep 22, 2022

@bors r=Mark-Simulacrum

@bors
Copy link
Contributor

bors commented Sep 22, 2022

📌 Commit 3916434 has been approved by Mark-Simulacrum

It is now in the queue for this repository.

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Sep 22, 2022
cjgillot added 2 commits Sep 22, 2022
…oli-obk"

This reverts commit bc7b17c, reversing
changes made to 5253b0a.
…_by_def, r=oli-obk"

This reverts commit 2cb9a65, reversing
changes made to 750bd1a.
@cjgillot
Copy link
Contributor Author

cjgillot commented Sep 22, 2022

@bors r=Mark-Simulacrum

@bors
Copy link
Contributor

bors commented Sep 22, 2022

📌 Commit fc43df0 has been approved by Mark-Simulacrum

It is now in the queue for this repository.

@bors
Copy link
Contributor

bors commented Sep 23, 2022

Testing commit fc43df0 with merge ce292b9...

bors added a commit to rust-lang-ci/rust that referenced this issue Sep 23, 2022
Revert perf-regression 101620

Reverts rust-lang#101862 rust-lang#101620

r? `@Mark-Simulacrum`
@bors
Copy link
Contributor

bors commented Sep 23, 2022

💔 Test failed - checks-actions

@bors bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Sep 23, 2022
@lqd
Copy link
Member

lqd commented Sep 23, 2022

@bors retry "GitHub Actions has encountered an internal error when running your job" on dist-mips64el-linux_ubuntu-20_04-xl

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 23, 2022
@bors
Copy link
Contributor

bors commented Sep 23, 2022

Testing commit fc43df0 with merge 6e86aa4...

bors added a commit to rust-lang-ci/rust that referenced this issue Sep 23, 2022
Revert perf-regression 101620

Reverts rust-lang#101862 rust-lang#101620

r? `@Mark-Simulacrum`
@bors
Copy link
Contributor

bors commented Sep 23, 2022

Testing commit fc43df0 with merge 8ec69a5...

bors added a commit to rust-lang-ci/rust that referenced this issue Sep 23, 2022
Revert perf-regression 101620

Reverts rust-lang#101862 rust-lang#101620

r? `@Mark-Simulacrum`
@bors
Copy link
Contributor

bors commented Sep 24, 2022

💥 Test timed out

@bors bors added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. labels Sep 24, 2022
@rust-log-analyzer
Copy link
Collaborator

rust-log-analyzer commented Sep 24, 2022

A job failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot)

@cjgillot
Copy link
Contributor Author

cjgillot commented Sep 24, 2022

@bors retry

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Sep 24, 2022
@bors
Copy link
Contributor

bors commented Sep 24, 2022

Testing commit fc43df0 with merge bb5a01617589b5e3ece5a36435fc285bfd13c9a4...

@rust-log-analyzer
Copy link
Collaborator

rust-log-analyzer commented Sep 24, 2022

A job failed! Check out the build log: (web) (plain)

Click to see the possible cause of the failure (guessed by this bot)

@bors
Copy link
Contributor

bors commented Sep 24, 2022

☀️ Test successful - checks-actions
Approved by: Mark-Simulacrum
Pushing bb5a016 to master...

@bors bors added the merged-by-bors This PR was explicitly merged by bors label Sep 24, 2022
@bors bors merged commit bb5a016 into rust-lang:master Sep 24, 2022
11 checks passed
@rustbot rustbot added this to the 1.66.0 milestone Sep 24, 2022
@cjgillot cjgillot deleted the revert branch Sep 24, 2022
@rust-timer
Copy link
Collaborator

rust-timer commented Sep 24, 2022

Finished benchmarking commit (bb5a016): comparison URL.

Overall result: regressions and improvements - ACTION NEEDED

Next Steps: If you can justify the regressions found in this perf run, please indicate this with @rustbot label: +perf-regression-triaged along with sufficient written justification. If you cannot justify the regressions please open an issue or create a new PR that fixes the regressions, add a comment linking to the newly created issue or PR, and then add the perf-regression-triaged label to this PR.

@rustbot label: +perf-regression
cc @rust-lang/wg-compiler-performance

Instruction count

This is a highly reliable metric that was used to determine the overall result at the top of this comment.

mean1 range count2
Regressions
(primary)
5.6% [0.3%, 33.5%] 33
Regressions
(secondary)
1.1% [0.3%, 1.5%] 11
Improvements
(primary)
-3.7% [-12.3%, -0.3%] 129
Improvements
(secondary)
-4.1% [-19.0%, -0.2%] 121
All (primary) -1.8% [-12.3%, 33.5%] 162

Max RSS (memory usage)

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean1 range count2
Regressions
(primary)
3.6% [1.1%, 10.2%] 17
Regressions
(secondary)
2.5% [2.1%, 3.1%] 3
Improvements
(primary)
-4.2% [-13.0%, -0.9%] 100
Improvements
(secondary)
-8.0% [-22.1%, -1.5%] 60
All (primary) -3.0% [-13.0%, 10.2%] 117

Cycles

Results

This is a less reliable metric that may be of interest but was not used to determine the overall result at the top of this comment.

mean1 range count2
Regressions
(primary)
15.4% [2.6%, 42.8%] 17
Regressions
(secondary)
2.9% [2.9%, 2.9%] 1
Improvements
(primary)
-4.8% [-13.4%, -1.4%] 89
Improvements
(secondary)
-9.4% [-24.6%, -2.3%] 56
All (primary) -1.6% [-13.4%, 42.8%] 106

Footnotes

  1. the arithmetic mean of the percent change 2 3

  2. number of relevant changes 2 3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-query-system Area: The rustc query system (https://rustc-dev-guide.rust-lang.org/query.html) merged-by-bors This PR was explicitly merged by bors perf-regression Performance regressions perf-regression-triaged The performance regression has been triaged. S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. T-compiler Relevant to the compiler team, which will review and decide on the PR/issue.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants