[Perf] Linux/x64: 2 Improvements on 9/24/2023 11:15:45 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	05bf3c984c6e19d7ab81438a0feaba4c7d31e084
Compare	2f74c93a0abb69247bce9ad9a40a1604658627dc
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in System.Formats.Cbor.Tests.Perf_CborReader

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SkipValue - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	34.11 ns	30.87 ns	0.91	0.06	True
SkipValue - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	35.57 ns	31.47 ns	0.88	0.02	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Formats.Cbor.Tests.Perf_CborReader*'

Payloads

Baseline
Compare

System.Formats.Cbor.Tests.Perf_CborReader.SkipValue(encoding: (Byte String, Strict))

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 30.87270159150594 < 32.61948932196816.
IsChangePoint: Marked as a change because one of 9/24/2023 8:25:02 PM, 10/2/2023 10:24:51 PM falls between 9/24/2023 12:29:05 AM and 10/2/2023 10:24:51 PM.
IsImprovementStdDev: Marked as improvement because 15.088324608408032 (T) = (0 -31.279902713941826) / Math.Sqrt((0.6315729389643768 / (157)) + (1.4474578429221157 / (36))) is greater than 1.97246198976699 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (157) + (36) - 2, .975) and 0.092102327296488 = (34.45311476655449 - 31.279902713941826) / 34.45311476655449 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

System.Formats.Cbor.Tests.Perf_CborReader.SkipValue(encoding: (Integer, Strict))

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 31.46626288436908 < 33.21779894463199.
IsChangePoint: Marked as a change because one of 9/24/2023 8:25:02 PM, 10/2/2023 10:24:51 PM falls between 9/24/2023 12:29:05 AM and 10/2/2023 10:24:51 PM.
IsImprovementStdDev: Marked as improvement because 40.160372549645565 (T) = (0 -31.749222783015153) / Math.Sqrt((0.10069540316723997 / (159)) + (0.20071198282829628 / (36))) is greater than 1.9723316757956526 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (159) + (36) - 2, .975) and 0.09063596305018488 = (34.91365558012197 - 31.749222783015153) / 34.91365558012197 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[EgorBo]

dotnet/runtime#92717