Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Perf] Linux/x64: 298 Regressions on 7/15/2024 10:11:33 PM #38866

Open
performanceautofiler bot opened this issue Jul 23, 2024 · 12 comments
Open

[Perf] Linux/x64: 298 Regressions on 7/15/2024 10:11:33 PM #38866

performanceautofiler bot opened this issue Jul 23, 2024 · 12 comments
Labels
arch-wasm arch-x64 branch-refs/heads/main kind-micro os-linux perf-regression untriaged

Comments

@performanceautofiler
Copy link

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
23.35 ns 25.77 ns 1.10 0.31 False
14.21 ns 16.90 ns 1.19 0.15 False
25.02 ns 26.89 ns 1.07 0.22 False
12.97 ns 14.64 ns 1.13 0.25 False
13.31 ns 15.34 ns 1.15 0.19 False
13.52 ns 16.29 ns 1.20 0.14 False
13.57 ns 15.71 ns 1.16 0.16 False
25.71 ns 32.46 ns 1.26 0.27 False
13.67 ns 14.70 ns 1.08 0.20 False
25.79 ns 29.86 ns 1.16 0.29 False
25.54 ns 28.18 ns 1.10 0.26 False
13.95 ns 15.30 ns 1.10 0.19 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int64&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.EqualsStaticBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ZeroBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int64>.BitwiseAndOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.93 ns 15.34 ns 1.10 0.19 False
12.94 ns 14.62 ns 1.13 0.20 False
13.61 ns 17.64 ns 1.30 0.22 False
24.78 ns 30.60 ns 1.23 0.37 False
13.90 ns 15.22 ns 1.09 0.19 False
13.34 ns 18.94 ns 1.42 0.16 False
29.04 ns 31.68 ns 1.09 0.27 False
28.25 ns 32.04 ns 1.13 0.24 False
37.14 ns 42.53 ns 1.15 0.29 False
28.68 ns 33.80 ns 1.18 0.21 False
27.22 ns 30.60 ns 1.12 0.28 False
28.63 ns 32.48 ns 1.13 0.28 False
13.35 ns 14.73 ns 1.10 0.16 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Double&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AndNotBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseAndBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Double>.BitwiseOrBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTime

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
15.43 ns 20.35 ns 1.32 0.35 False
2.76 μs 3.02 μs 1.09 0.08 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'

System.Tests.Perf_DateTime.op_Subtraction

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_DateTime.GetNow

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.03 ns 14.38 ns 1.10 0.22 False
13.87 ns 16.51 ns 1.19 0.17 False
13.25 ns 14.62 ns 1.10 0.20 False
13.62 ns 15.12 ns 1.11 0.21 False
13.56 ns 14.88 ns 1.10 0.20 False
13.05 ns 17.00 ns 1.30 0.14 False
13.76 ns 14.85 ns 1.08 0.21 False
13.58 ns 14.85 ns 1.09 0.20 False
13.55 ns 14.71 ns 1.09 0.16 False
33.64 ns 35.95 ns 1.07 0.26 False
13.32 ns 15.66 ns 1.18 0.25 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.OnesComplementOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseOrBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.ZeroBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Utf8JsonReaderCommentsTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.62 μs 10.67 μs 1.11 0.12 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Utf8JsonReaderCommentsTests*'

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: LongSingleLine)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
323.45 ns 367.97 ns 1.14 0.17 False
1.10 μs 1.34 μs 1.22 0.05 False
205.08 ns 232.62 ns 1.13 0.16 False
68.84 ns 82.18 ns 1.19 0.25 False
320.82 ns 361.04 ns 1.13 0.13 False
175.46 ns 198.10 ns 1.13 0.12 False
453.94 ns 514.64 ns 1.13 0.12 False
187.88 ns 227.56 ns 1.21 0.13 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Byte&gt;*'

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachSingleSegment

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateForEachMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetSingleSegment

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
310.88 ns 343.31 ns 1.10 0.16 False
179.02 ns 201.79 ns 1.13 0.16 False
191.53 ns 228.01 ns 1.19 0.17 False
1.52 μs 1.86 μs 1.22 0.17 False
337.11 ns 372.25 ns 1.10 0.14 False
68.68 ns 77.08 ns 1.12 0.26 False
323.30 ns 364.70 ns 1.13 0.11 False
453.85 ns 519.92 ns 1.15 0.12 False
1.12 μs 1.29 μs 1.15 0.08 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Char&gt;*'

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetSingleSegment

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachSingleSegment

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateForEachMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetTenSegments

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.52 ns 14.71 ns 1.09 0.22 False
13.57 ns 15.58 ns 1.15 0.19 False
13.52 ns 14.62 ns 1.08 0.16 False
13.48 ns 15.08 ns 1.12 0.18 False
30.72 ns 34.75 ns 1.13 0.21 False
13.68 ns 15.07 ns 1.10 0.26 False
13.58 ns 14.95 ns 1.10 0.19 False
31.05 ns 33.46 ns 1.08 0.22 False
13.43 ns 14.73 ns 1.10 0.15 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseOrBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsStaticBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Boolean

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
90.63 ns 105.86 ns 1.17 0.15 False
124.96 ns 160.33 ns 1.28 0.13 False
193.89 ns 239.68 ns 1.24 0.15 False
242.33 ns 285.12 ns 1.18 0.13 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Boolean*'

System.Tests.Perf_Boolean.TryParse(value: "true")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.TryParse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.TryParse(value: "Bogus")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.Parse(value: " True ")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.85 ns 15.33 ns 1.11 0.19 False
13.70 ns 15.00 ns 1.09 0.20 False
13.14 ns 17.41 ns 1.32 0.15 False
13.31 ns 15.24 ns 1.14 0.16 False
13.63 ns 14.74 ns 1.08 0.22 False
13.63 ns 20.43 ns 1.50 0.23 False
13.61 ns 15.09 ns 1.11 0.22 False
13.47 ns 14.79 ns 1.10 0.21 False
13.27 ns 14.55 ns 1.10 0.23 False
14.76 ns 18.20 ns 1.23 0.32 False
13.46 ns 14.66 ns 1.09 0.19 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt16&gt;*'

System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.ZeroBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.BitwiseAndOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.AndNotBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt16>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Constructors<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
18.81 ns 23.06 ns 1.23 0.33 False
19.66 ns 23.71 ns 1.21 0.31 False
20.67 ns 24.19 ns 1.17 0.28 False
19.19 ns 25.42 ns 1.32 0.33 False
12.61 ns 18.12 ns 1.44 0.29 False
17.07 ns 20.54 ns 1.20 0.33 False
12.24 ns 14.91 ns 1.22 0.22 False
20.92 ns 24.10 ns 1.15 0.26 False
12.63 ns 14.20 ns 1.12 0.29 False
16.66 ns 19.69 ns 1.18 0.22 False
17.01 ns 24.20 ns 1.42 0.34 False
13.24 ns 15.25 ns 1.15 0.18 False
13.22 ns 18.49 ns 1.40 0.22 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Constructors&lt;String&gt;*'

System.Memory.Constructors<String>.ReadOnlySpanImplicitCastFromArraySegment

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ArrayAsSpanStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.SpanFromMemory

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.SpanFromArrayStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.MemoryMarshalCreateReadOnlySpan

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ArrayAsSpan

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ReadOnlySpanImplicitCastFromSpan

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ReadOnlySpanFromMemory

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.MemoryMarshalCreateSpan

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ReadOnlySpanFromArrayStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.SpanFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ReadOnlySpanImplicitCastFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<String>.ReadOnlySpanFromArray

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.75 ns 14.76 ns 1.07 0.18 False
13.99 ns 17.84 ns 1.28 0.33 False
13.30 ns 15.21 ns 1.14 0.19 False
13.07 ns 17.16 ns 1.31 0.15 False
13.74 ns 14.74 ns 1.07 0.15 False
13.51 ns 14.74 ns 1.09 0.22 False
13.49 ns 16.68 ns 1.24 0.21 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;SByte&gt;*'

System.Numerics.Tests.Perf_VectorOf<SByte>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.ZeroBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.BitwiseAndOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
29.85 ns 32.37 ns 1.08 0.24 False
13.67 ns 14.93 ns 1.09 0.19 False
13.40 ns 15.27 ns 1.14 0.14 False
13.76 ns 15.92 ns 1.16 0.26 False
13.57 ns 14.65 ns 1.08 0.19 False
13.98 ns 15.16 ns 1.08 0.21 False
13.44 ns 14.65 ns 1.09 0.19 False
13.62 ns 14.76 ns 1.08 0.21 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseAndBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.64 ns 15.54 ns 1.14 0.22 False
13.42 ns 15.28 ns 1.14 0.23 False
13.75 ns 15.09 ns 1.10 0.18 False
13.41 ns 14.89 ns 1.11 0.23 False
13.41 ns 14.81 ns 1.10 0.16 False
14.77 ns 18.40 ns 1.25 0.29 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'

System.Numerics.Tests.Perf_VectorOf<UInt32>.BitwiseAndBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.MultiplyBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<UInt32>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
295.55 ns 328.95 ns 1.11 0.09 False
532.61 ns 584.90 ns 1.10 0.13 False
141.11 ns 168.01 ns 1.19 0.14 False
103.49 ns 134.01 ns 1.29 0.14 False
102.57 ns 135.09 ns 1.32 0.12 False
499.61 ns 534.68 ns 1.07 0.14 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16,16,16 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 1024,1024 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: -2147483648)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 16,8 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Remainder(arguments: 16,8 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Add(arguments: 1024,1024 bits)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
40.25 ns 43.02 ns 1.07 0.17 False
12.07 ns 14.45 ns 1.20 0.18 False
13.33 ns 14.66 ns 1.10 0.22 False
13.38 ns 14.89 ns 1.11 0.20 False
13.51 ns 15.00 ns 1.11 0.18 False
13.55 ns 14.88 ns 1.10 0.18 False
13.14 ns 16.69 ns 1.27 0.12 False
13.57 ns 14.65 ns 1.08 0.18 False
12.96 ns 14.23 ns 1.10 0.19 False
13.51 ns 14.97 ns 1.11 0.19 False
13.79 ns 14.93 ns 1.08 0.19 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GreaterThanOrEqualBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.LessThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ZeroBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.BitwiseAndBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Matrix4x4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
53.75 ns 61.62 ns 1.15 0.20 False
43.06 ns 47.34 ns 1.10 0.29 False
42.84 ns 46.73 ns 1.09 0.31 False
32.53 ns 36.04 ns 1.11 0.29 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXWithCenterBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.51 ns 14.99 ns 1.11 0.16 False
13.57 ns 14.76 ns 1.09 0.15 False
13.66 ns 15.10 ns 1.11 0.16 False
30.60 ns 33.82 ns 1.11 0.18 False
39.20 ns 42.62 ns 1.09 0.14 False
30.21 ns 32.81 ns 1.09 0.28 False
35.93 ns 38.76 ns 1.08 0.28 False
13.40 ns 14.89 ns 1.11 0.18 False
13.87 ns 15.14 ns 1.09 0.21 False
13.64 ns 15.21 ns 1.12 0.26 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.XorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GreaterThanBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.20 μs 2.72 μs 1.24 0.16 False
1.39 μs 1.49 μs 1.08 0.13 False
1.84 μs 2.04 μs 1.11 0.09 False
4.20 μs 4.88 μs 1.16 0.10 False
66.78 μs 70.95 μs 1.06 0.07 False
5.04 μs 6.29 μs 1.25 0.09 False
114.09 μs 143.68 μs 1.26 0.09 False
3.07 μs 3.40 μs 1.11 0.09 False
36.03 μs 42.72 μs 1.19 0.14 False
2.30 μs 2.72 μs 1.18 0.07 False
92.70 μs 108.07 μs 1.17 0.10 False
4.14 μs 4.86 μs 1.17 0.09 False
52.31 μs 67.58 μs 1.29 0.08 False
50.49 μs 61.09 μs 1.21 0.10 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives&lt;Double&gt;*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Divide_Scalar(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Abs(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Divide_Vector(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.AddMultiply_ScalarAddend(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.SumOfSquares(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.AddMultiply_Vectors(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.AddMultiply_Vectors(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.SumOfMagnitudes(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Add_Vector(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Negate(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.AddMultiply_ScalarAddend(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.AddMultiply_ScalarMultiplier(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Negate(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.Add_Scalar(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.42 μs 1.56 μs 1.10 0.10 False
8.30 μs 9.56 μs 1.15 0.15 False
3.48 μs 3.94 μs 1.13 0.10 False
27.46 μs 31.66 μs 1.15 0.07 False
68.84 μs 75.19 μs 1.09 0.05 False
3.55 μs 3.85 μs 1.09 0.16 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives&lt;Int32&gt;*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.Divide_Vector(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.MaxMagnitude_Scalar(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.Abs(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.Divide_Vector(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.SumOfMagnitudes(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.SumOfMagnitudes(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.MemoryMarshal<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
20.52 ns 22.10 ns 1.08 0.54 False
19.14 ns 26.19 ns 1.37 0.45 False
97.36 ns 114.80 ns 1.18 0.19 False
26.27 ns 30.09 ns 1.15 0.50 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.MemoryMarshal&lt;Int32&gt;*'

System.Memory.MemoryMarshal<Int32>.CastToInt

ETL Files

Histogram

JIT Disasms

System.Memory.MemoryMarshal<Int32>.AsBytes

ETL Files

Histogram

JIT Disasms

System.Memory.MemoryMarshal<Int32>.TryGetArray

ETL Files

Histogram

JIT Disasms

System.Memory.MemoryMarshal<Int32>.CastToByte

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.61 ns 36.05 ns 1.35 0.20 False
16.15 ns 17.79 ns 1.10 0.35 False
12.58 ns 13.62 ns 1.08 0.21 False
13.20 ns 16.51 ns 1.25 0.13 False
13.46 ns 14.64 ns 1.09 0.18 False
13.38 ns 15.27 ns 1.14 0.18 False
13.23 ns 14.86 ns 1.12 0.20 False
26.44 ns 30.38 ns 1.15 0.29 False
13.43 ns 14.59 ns 1.09 0.19 False
13.47 ns 14.93 ns 1.11 0.19 False
13.46 ns 14.74 ns 1.10 0.16 False
13.31 ns 14.91 ns 1.12 0.22 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*'

System.Numerics.Tests.Perf_VectorOf<Single>.AbsBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.ConditionalSelectBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.UnaryNegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.ZeroBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.SubtractionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.SubtractBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.ExclusiveOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.BitwiseOrOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.AddBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
29.46 ns 34.22 ns 1.16 0.23 False
23.52 ns 26.90 ns 1.14 0.26 False
53.74 ns 63.17 ns 1.18 0.11 False
25.52 ns 29.01 ns 1.14 0.26 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128*'

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertIntToFloatBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertLongToDoubleBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertUIntToFloatBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128.CeilingDoubleBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTimeOffset

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.98 μs 3.29 μs 1.10 0.07 False
176.72 ns 192.75 ns 1.09 0.17 False
21.56 ns 26.41 ns 1.23 0.34 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'

System.Tests.Perf_DateTimeOffset.GetNow

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_DateTimeOffset.GetUtcNow

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_DateTimeOffset.op_Subtraction

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollectionNonGeneric<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
155.29 μs 192.32 μs 1.24 0.09 False
273.87 μs 296.96 μs 1.08 0.09 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollectionNonGeneric&lt;Int32&gt;*'

System.Collections.CtorFromCollectionNonGeneric<Int32>.ArrayList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollectionNonGeneric<Int32>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Constructor

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.12 ns 24.38 ns 1.10 0.53 False
22.29 ns 32.90 ns 1.48 0.54 False
23.40 ns 27.36 ns 1.17 0.49 False
22.58 ns 31.02 ns 1.37 0.52 False
24.66 ns 31.25 ns 1.27 0.55 False
25.36 ns 27.66 ns 1.09 0.53 False
21.90 ns 29.09 ns 1.33 0.52 False
25.38 ns 31.27 ns 1.23 0.49 False
21.92 ns 25.46 ns 1.16 0.54 False
22.83 ns 30.62 ns 1.34 0.52 False
25.56 ns 31.98 ns 1.25 0.54 False
21.75 ns 24.40 ns 1.12 0.57 False
21.96 ns 26.16 ns 1.19 0.48 False
22.86 ns 25.51 ns 1.12 0.48 False
18.53 ns 29.53 ns 1.59 0.52 False
21.41 ns 24.27 ns 1.13 0.49 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Constructor*'

System.Numerics.Tests.Constructor.ConstructorBenchmark_Single

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_Int64

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_UInt16

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_UInt32

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_UInt16

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_Double

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_SByte

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_UInt64

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_UInt32

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_Single

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_Int16

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_Int32

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_UInt64

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_Double

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.SpanCastBenchmark_Byte

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_Byte

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.38 ns 19.35 ns 1.45 0.16 False
13.76 ns 20.80 ns 1.51 0.16 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark*'

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Ctor_Array

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.Performance.StringValuesBenchmark.Ctor_String

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.77 ms 1.91 ms 1.08 0.12 False
1.52 ms 1.69 ms 1.11 0.11 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse&lt;String, String&gt;*'

System.Collections.TryGetValueFalse<String, String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
16.54 ns 19.38 ns 1.17 0.54 False
13.01 ns 16.82 ns 1.29 0.40 False
15.82 ns 19.08 ns 1.21 0.52 False
13.63 ns 15.88 ns 1.17 0.40 False
11.34 ns 12.68 ns 1.12 0.26 False
15.95 ns 19.54 ns 1.23 0.52 False
15.98 ns 20.35 ns 1.27 0.52 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

System.Numerics.Tests.Perf_Vector2.MultiplyFunctionBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector2.NegateBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector2.DivideByVector2OperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector2.NegateOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector2.UnitYBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector2.AddOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Vector2.AddFunctionBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.92 ms 15.02 ms 1.08 0.10 False
366.67 μs 413.68 μs 1.13 0.10 False
6.15 ms 6.82 ms 1.11 0.07 False
41.53 μs 46.93 μs 1.13 0.06 False
5.90 μs 6.92 μs 1.17 0.23 False
882.60 μs 1.03 ms 1.17 0.08 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;String, String&gt;*'

System.Collections.Tests.Perf_PriorityQueue<String, String>.Dequeue_And_Enqueue(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.HeapSort(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.HeapSort(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.Dequeue_And_Enqueue(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.Enumerate(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.Dequeue_And_Enqueue(Size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Get

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.59 μs 15.13 μs 1.11 0.08 False
13.01 μs 15.11 μs 1.16 0.17 False
13.14 μs 14.84 μs 1.13 0.13 False
12.75 μs 14.82 μs 1.16 0.13 False
13.37 μs 14.96 μs 1.12 0.14 False
12.83 μs 14.97 μs 1.17 0.17 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Get*'

System.Text.Json.Tests.Perf_Get.GetSByte

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Get.GetUInt16

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Get.GetInt64

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Get.GetInt32

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Get.GetInt16

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Get.GetByte

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Array

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
35.30 ms 41.07 ms 1.16 0.08 False
24.76 ms 28.95 ms 1.17 0.09 False
35.04 ms 38.55 ms 1.10 0.08 False
23.65 ms 27.72 ms 1.17 0.09 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Array*'

System.Tests.Perf_Array.ArrayRetrieve2D

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Array.ArrayRetrieve1D

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Array.ArrayAssign2D

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Array.ArrayAssign1D

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 916e24591f09c6d72462025c5806385eb530ec1f
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt16

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
132.35 ns 142.01 ns 1.07 0.22 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt16*'

System.Tests.Perf_UInt16.Parse(value: "0")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForEach<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
285.70 μs 311.79 μs 1.09 0.09 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*'

System.Collections.IterateForEach<String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.62 ms 1.86 ms 1.15 0.09 False
1.70 ms 1.93 ms 1.14 0.07 False
1.82 ms 1.96 ms 1.08 0.06 False
110.10 μs 332.57 μs 3.02 0.11 True

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;String&gt;*'

System.Collections.CtorFromCollection<String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<String>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<String>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<String>.ConcurrentBag(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.20 ms 1.34 ms 1.12 0.08 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue&lt;String, String&gt;*'

System.Collections.TryGetValueTrue<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.44 μs 1.53 μs 1.06 0.12 False
5.33 μs 5.88 μs 1.10 0.11 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives&lt;Double&gt;*'

System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives<Double>.Sqrt(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_FloatingPointTensorPrimitives<Double>.Distance(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSet<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.22 ms 1.33 ms 1.09 0.09 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet&lt;String&gt;*'

System.Collections.IndexerSet<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Reflection.Attributes

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.13 μs 1.23 μs 1.08 0.09 False
1.16 μs 1.25 μs 1.08 0.09 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Reflection.Attributes*'

System.Reflection.Attributes.IsDefinedMethodOverrideMiss

ETL Files

Histogram

JIT Disasms

System.Reflection.Attributes.IsDefinedMethodOverrideMissInherit

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Constructors<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.29 ns 15.50 ns 1.17 0.29 False
13.52 ns 17.54 ns 1.30 0.41 False
17.39 ns 23.87 ns 1.37 0.42 False
12.86 ns 14.44 ns 1.12 0.28 False
13.13 ns 16.01 ns 1.22 0.44 False
13.60 ns 19.51 ns 1.43 0.44 False
12.94 ns 15.08 ns 1.17 0.24 False
13.54 ns 16.50 ns 1.22 0.30 False
15.81 ns 21.39 ns 1.35 0.47 False
13.09 ns 15.38 ns 1.18 0.28 False
13.33 ns 16.44 ns 1.23 0.31 False
20.38 ns 29.19 ns 1.43 0.43 False
19.01 ns 22.97 ns 1.21 0.45 False
16.93 ns 21.03 ns 1.24 0.43 False
16.74 ns 19.09 ns 1.14 0.31 False
16.26 ns 19.52 ns 1.20 0.40 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Constructors&lt;Byte&gt;*'

System.Memory.Constructors<Byte>.ReadOnlySpanFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlyMemoryFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlySpanImplicitCastFromArraySegment

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.MemoryMarshalCreateSpan

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.MemoryFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ArrayAsMemory

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlySpanImplicitCastFromSpan

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlySpanImplicitCastFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.SpanFromArrayStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.SpanImplicitCastFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.SpanFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.SpanFromMemory

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.SpanImplicitCastFromArraySegment

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ArrayAsSpanStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.MemoryFromArrayStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlyMemoryFromArrayStartLength

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Half

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
31.50 ns 35.91 ns 1.14 0.29 False
43.22 ns 53.80 ns 1.24 0.26 False
41.06 ns 49.40 ns 1.20 0.25 False
32.72 ns 36.58 ns 1.12 0.26 False
45.90 ns 52.37 ns 1.14 0.17 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Half*'

System.Tests.Perf_Half.HalfToSingle(value: NaN)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Half.SingleToHalf(value: 12345)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Half.SingleToHalf(value: NaN)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Half.HalfToSingle(value: 12344)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Half.SingleToHalf(value: 6.097555E-05)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Guid

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
66.71 ns 78.42 ns 1.18 0.09 False
44.31 ns 51.88 ns 1.17 0.13 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Guid*'

System.Tests.Perf_Guid.ctor_bytes

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Guid.TryWriteBytes

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.ReadOnlySequence

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
52.69 ns 57.97 ns 1.10 0.11 False
68.72 ns 74.79 ns 1.09 0.17 False
51.87 ns 58.77 ns 1.13 0.14 False
215.69 ns 234.62 ns 1.09 0.14 False
68.57 ns 76.64 ns 1.12 0.15 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'

System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Single)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Multiple)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySequence.Slice_StartPosition_And_Length(Segment: Single)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySequence.Slice_Repeat(Segment: Single)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySequence.Slice_Start_And_EndPosition(Segment: Multiple)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Decimal

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
764.42 ns 820.78 ns 1.07 0.12 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Decimal*'

System.Tests.Perf_Decimal.Parse(value: "123456.789")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 916e24591f09c6d72462025c5806385eb530ec1f
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
42.73 ns 48.00 ns 1.12 0.23 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Ctor_String

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
61.46 ns 67.37 ns 1.10 0.25 False
87.68 ns 2.77 μs 31.54 0.18 True

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

System.Numerics.Tests.Perf_Quaternion.CreateFromRotationMatrixBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Quaternion.CreateFromYawPitchRollBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.39 μs 3.69 μs 1.09 0.25 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;Int32, Int32&gt;*'

System.Collections.Tests.Perf_PriorityQueue<Int32, Int32>.Enumerate(Size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.MDBenchI.MDGeneralArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.13 secs 1.28 secs 1.13 0.16 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.MDBenchI.MDGeneralArray*'

Benchstone.MDBenchI.MDGeneralArray.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
131.80 ns 142.76 ns 1.08 0.20 False
149.39 ns 159.95 ns 1.07 0.13 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

System.Tests.Perf_UInt64.Parse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.ParseSpan(value: "12345")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Sort<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.49 ms 1.67 ms 1.12 0.11 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;String&gt;*'

System.Collections.Sort<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollectionNonGeneric<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.66 ms 1.83 ms 1.10 0.09 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollectionNonGeneric&lt;String&gt;*'

System.Collections.CtorFromCollectionNonGeneric<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Hashing.Tests.Crc32_GetCurrentHashPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
76.91 ns 83.35 ns 1.08 0.10 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Hashing.Tests.Crc32_GetCurrentHashPerf*'

System.IO.Hashing.Tests.Crc32_GetCurrentHashPerf.GetCurrentHash

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 916e24591f09c6d72462025c5806385eb530ec1f
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.MemoryMarshal<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
17.92 ns 26.74 ns 1.49 0.52 False
20.38 ns 23.27 ns 1.14 0.45 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.MemoryMarshal&lt;Byte&gt;*'

System.Memory.MemoryMarshal<Byte>.CastToInt

ETL Files

Histogram

JIT Disasms

System.Memory.MemoryMarshal<Byte>.AsBytes

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Enum

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.63 μs 5.15 μs 1.11 0.08 False
4.99 μs 5.42 μs 1.09 0.11 False
5.03 μs 5.44 μs 1.08 0.08 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Enum*'

System.Tests.Perf_Enum.InterpolateIntoSpan_Flags(value: Red)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.InterpolateIntoStringBuilder_NonFlags(value: Saturday)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.InterpolateIntoSpan_NonFlags(value: 42)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
29.87 μs 33.60 μs 1.12 0.15 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

System.Collections.AddGivenSize<Int32>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_TimeSpan

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
31.20 ns 34.57 ns 1.11 0.14 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_TimeSpan*'

System.Tests.Perf_TimeSpan.FromSeconds

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
473.60 ns 585.81 ns 1.24 0.10 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare 2b3088b99e97f0d6d3dd24dcd41ab330757f5aa2
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_SByte

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
149.74 ns 160.44 ns 1.07 0.14 False
145.11 ns 160.28 ns 1.10 0.11 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_SByte*'

System.Tests.Perf_SByte.Parse(value: "-128")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_SByte.Parse(value: "127")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline e1ab2243b27da4aa8a76372e4384bcd2b5894b3b
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.08 μs 1.22 μs 1.13 0.10 False
21.93 μs 23.84 μs 1.09 0.08 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives&lt;Single&gt;*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Single>.SumOfMagnitudes(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Single>.SumOfMagnitudes(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 916e24591f09c6d72462025c5806385eb530ec1f
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.51 ms 1.70 ms 1.13 0.07 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;String, String&gt;*'

System.Collections.ContainsKeyFalse<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler PerformanceAutoFiler
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline af5e7150362294696d3d52aa2302062e4b7c8095
Compare bc9b3b61a4fda49ee9c964c96f2b9ec3730e6b71
Diff Diff
Configs CompilationMode:wasm, RunKind:micro

Regressions in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
66.13 ns 73.31 ns 1.11 0.23 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

System.Net.Primitives.Tests.IPAddressPerformanceTests.Ctor_Span(address: [143, 24, 20, 36])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler performanceautofiler bot mentioned this issue Jul 23, 2024
Closed
@radekdoulik
Copy link
Member

radekdoulik commented Jul 24, 2024 •
edited
Loading

probably emscripten bump dotnet/runtime#100334

range dotnet/runtime@a86987c...3212e3f

This was referenced Jul 24, 2024
Closed
Open
@DrewScoggins DrewScoggins mentioned this issue Sep 11, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-wasm arch-x64 branch-refs/heads/main kind-micro os-linux perf-regression untriaged
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@radekdoulik