Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump to v13.1 for release #662

Merged
merged 1 commit into from
Oct 3, 2024
Merged

Bump to v13.1 for release #662

merged 1 commit into from
Oct 3, 2024

Conversation

gleocadie
Copy link
Contributor

What does this PR do?

Bump the version from 13 to 13.1

Motivation

Publish a new release of libdatadog.

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@gleocadie gleocadie requested a review from a team as a code owner October 3, 2024 07:33
Copy link
Member

@ivoanjo ivoanjo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 LGTM

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.94%. Comparing base (488ba28) to head (22185da).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #662      +/-   ##
==========================================
+ Coverage   71.92%   71.94%   +0.01%     
==========================================
  Files         271      271              
  Lines       40629    40647      +18     
==========================================
+ Hits        29223    29244      +21     
+ Misses      11406    11403       -3     
Components Coverage Δ
crashtracker 20.41% <ø> (ø)
crashtracker-ffi 9.07% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.71% <ø> (-0.63%) ⬇️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.73% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 90.90% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.69% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 36.35% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.66% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.36% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Oct 3, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-10-03 07:42:48

Comparing candidate commit 22185da in PR branch gleocadie/bump-to-v13.1 with baseline commit 488ba28 in branch main.

Found 8 performance improvements and 34 performance regressions! Performance is the same for 9 metrics, 2 unstable metrics.

scenario:benching string interning on wordpress profile

  • 🟩 execution_time [-7.886µs; -7.670µs] or [-5.361%; -5.214%]

scenario:credit_card/is_card_number/

  • 🟥 execution_time [+799.276ns; +799.653ns] or [+65.786%; +65.817%]
  • 🟥 throughput [-326721874.451op/s; -326584721.566op/s] or [-39.695%; -39.679%]

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+7.757µs; +7.957µs] or [+6.600%; +6.769%]
  • 🟥 throughput [-539973.088op/s; -526287.239op/s] or [-6.347%; -6.186%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+8.557µs; +8.719µs] or [+7.900%; +8.049%]
  • 🟥 throughput [-687876.928op/s; -675598.603op/s] or [-7.451%; -7.318%]

scenario:credit_card/is_card_number/37828224631

  • 🟥 execution_time [+799.298ns; +799.664ns] or [+65.790%; +65.820%]
  • 🟥 throughput [-326766505.328op/s; -326576074.794op/s] or [-39.700%; -39.677%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+8.293µs; +8.536µs] or [+7.933%; +8.166%]
  • 🟥 throughput [-722252.209op/s; -702558.718op/s] or [-7.550%; -7.344%]

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+8.852µs; +9.034µs] or [+8.473%; +8.647%]
  • 🟥 throughput [-762866.113op/s; -746925.726op/s] or [-7.970%; -7.803%]

scenario:credit_card/is_card_number_no_luhn/

  • 🟥 execution_time [+798.998ns; +799.240ns] or [+65.755%; +65.775%]
  • 🟥 throughput [-326555738.200op/s; -326452353.037op/s] or [-39.680%; -39.667%]

scenario:credit_card/is_card_number_no_luhn/ 3782-8224-6310-005

  • 🟥 execution_time [+2.239µs; +2.393µs] or [+2.331%; +2.491%]
  • 🟥 throughput [-253107.886op/s; -236957.122op/s] or [-2.431%; -2.276%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+3.043µs; +3.290µs] or [+3.477%; +3.759%]
  • 🟥 throughput [-414136.604op/s; -383319.571op/s] or [-3.625%; -3.355%]

scenario:credit_card/is_card_number_no_luhn/37828224631

  • 🟥 execution_time [+799.169ns; +799.510ns] or [+65.771%; +65.799%]
  • 🟥 throughput [-326622242.597op/s; -326517924.653op/s] or [-39.687%; -39.675%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+2.957µs; +3.147µs] or [+3.552%; +3.780%]
  • 🟥 throughput [-437806.304op/s; -411495.701op/s] or [-3.645%; -3.426%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+9.007µs; +9.201µs] or [+8.625%; +8.811%]
  • 🟥 throughput [-776485.720op/s; -759668.755op/s] or [-8.108%; -7.933%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

  • 🟥 execution_time [+90.392µs; +90.772µs] or [+49.932%; +50.142%]
  • 🟥 throughput [-1847770.736op/s; -1837181.557op/s] or [-33.448%; -33.257%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟥 execution_time [+6.475µs; +6.496µs] or [+32.153%; +32.255%]
  • 🟥 throughput [-12117089.742op/s; -12075122.393op/s] or [-24.402%; -24.317%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟥 execution_time [+2.973µs; +2.986µs] or [+22.639%; +22.732%]
  • 🟥 throughput [-14105183.785op/s; -14051019.015op/s] or [-18.526%; -18.455%]

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

  • 🟥 execution_time [+10.295µs; +10.409µs] or [+2.195%; +2.220%]
  • 🟥 throughput [-46315.402op/s; -45801.612op/s] or [-2.172%; -2.148%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

  • 🟩 execution_time [-32.386µs; -32.320µs] or [-15.197%; -15.166%]
  • 🟩 throughput [+838976.997op/s; +840739.295op/s] or [+17.880%; +17.917%]

scenario:normalization/normalize_service/normalize_service/[empty string]

  • 🟩 execution_time [-1.655µs; -1.610µs] or [-3.598%; -3.500%]
  • 🟩 throughput [+788678.950op/s; +810641.564op/s] or [+3.629%; +3.730%]

scenario:normalization/normalize_service/normalize_service/test_ASCII

  • 🟩 execution_time [-4.984µs; -4.952µs] or [-9.207%; -9.147%]
  • 🟩 throughput [+1860381.261op/s; +1872992.358op/s] or [+10.071%; +10.139%]

scenario:normalization/normalize_trace/test_trace

  • 🟥 execution_time [+26.142ns; +31.604ns] or [+9.559%; +11.557%]

scenario:redis/obfuscate_redis_string

  • 🟩 execution_time [-1.430µs; -0.976µs] or [-3.631%; -2.477%]

scenario:sql/obfuscate_sql_string

  • 🟥 execution_time [+1.662µs; +1.710µs] or [+2.258%; +2.323%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.578µs 38.189µs ± 1.072µs 37.681µs ± 0.055µs 37.833µs 40.463µs 40.549µs 42.007µs 11.48% 1.731 1.211 2.80% 0.076µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.041µs; 38.338µs] or [-0.389%; +0.389%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.691µs 22.921µs ± 10.280µs 17.899µs ± 0.086µs 21.710µs 42.589µs 45.461µs 96.217µs 437.54% 3.036 14.251 44.74% 0.727µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [21.496µs; 24.346µs] or [-6.216%; +6.216%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 292.570ns 302.341ns ± 13.256ns 295.646ns ± 2.308ns 304.755ns 337.014ns 339.809ns 340.145ns 15.05% 1.713 1.792 4.37% 0.937ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [300.504ns; 304.178ns] or [-0.608%; +0.608%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.000µs 2.015µs 2.015µs 2.020µs 2.027µs 0.61% 6.280 53.444 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 493426103.404op/s 496420210.753op/s ± 302628.494op/s 496435513.027op/s ± 116495.757op/s 496577031.512op/s 496663345.126op/s 496699195.255op/s 496770044.196op/s 0.07% -6.250 53.042 0.06% 21399.066op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 123.739µs 125.396µs ± 0.478µs 125.421µs ± 0.277µs 125.708µs 126.072µs 126.258µs 126.585µs 0.93% -0.838 1.402 0.38% 0.034µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 7899833.274op/s 7974835.371op/s ± 30523.663op/s 7973117.439op/s ± 17632.151op/s 7988264.277op/s 8030214.938op/s 8074511.332op/s 8081506.845op/s 1.36% 0.869 1.472 0.38% 2158.349op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 115.678µs 116.958µs ± 0.506µs 116.960µs ± 0.387µs 117.349µs 117.753µs 118.064µs 118.195µs 1.06% -0.047 -0.412 0.43% 0.036µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 8460628.074op/s 8550263.531op/s ± 37001.292op/s 8549906.103op/s ± 28261.629op/s 8577802.370op/s 8613788.265op/s 8633906.108op/s 8644709.573op/s 1.11% 0.068 -0.411 0.43% 2616.386op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.000µs 2.015µs 2.015µs 2.017µs 2.022µs 0.38% 4.418 31.881 0.04% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 494537083.409op/s 496423920.477op/s ± 221966.242op/s 496414517.427op/s ± 101644.178op/s 496579303.716op/s 496634806.552op/s 496676258.982op/s 496707077.180op/s 0.06% -4.399 31.674 0.04% 15695.384op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 109.782µs 112.943µs ± 0.791µs 112.993µs ± 0.507µs 113.468µs 114.049µs 114.605µs 115.031µs 1.80% -0.428 0.862 0.70% 0.056µs 1 200
credit_card/is_card_number/378282246310005 throughput 8693318.950op/s 8854434.728op/s ± 62213.491op/s 8850070.121op/s ± 39712.663op/s 8892875.918op/s 8956769.009op/s 9004130.752op/s 9108958.599op/s 2.93% 0.485 0.972 0.70% 4399.158op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 112.114µs 113.419µs ± 0.363µs 113.346µs ± 0.228µs 113.649µs 114.132µs 114.433µs 114.503µs 1.02% 0.623 0.882 0.32% 0.026µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 8733417.913op/s 8816920.077op/s ± 28194.704op/s 8822559.984op/s ± 17717.715op/s 8837063.319op/s 8850048.783op/s 8857766.037op/s 8919494.447op/s 1.10% -0.599 0.886 0.32% 1993.667op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 23.263µs 24.186µs ± 0.413µs 24.166µs ± 0.276µs 24.466µs 24.930µs 25.015µs 25.052µs 3.67% 0.040 -0.565 1.70% 0.029µs 1 200
credit_card/is_card_number/x371413321323331 throughput 39917264.496op/s 41358342.509op/s ± 706579.906op/s 41381264.738op/s ± 471459.895op/s 41804746.181op/s 42544445.318op/s 42805764.499op/s 42987157.923op/s 3.88% 0.033 -0.562 1.70% 49962.744op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.001µs 2.015µs 2.016µs 2.016µs 2.017µs 0.13% 0.838 0.471 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 495850795.659op/s 496468684.430op/s ± 179056.528op/s 496492769.680op/s ± 135791.738op/s 496616971.955op/s 496687736.176op/s 496733273.256op/s 496766762.901op/s 0.06% -0.836 0.465 0.04% 12661.209op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 97.481µs 98.368µs ± 0.434µs 98.337µs ± 0.250µs 98.601µs 99.148µs 99.569µs 99.849µs 1.54% 0.602 0.589 0.44% 0.031µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10015098.252op/s 10166120.147op/s ± 44710.091op/s 10169069.776op/s ± 25848.486op/s 10193746.901op/s 10231436.041op/s 10250201.858op/s 10258451.632op/s 0.88% -0.573 0.530 0.44% 3161.481op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 89.029µs 90.692µs ± 0.706µs 90.689µs ± 0.482µs 91.151µs 91.861µs 92.265µs 92.498µs 2.00% 0.099 -0.330 0.78% 0.050µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 10811008.763op/s 11026975.434op/s ± 85843.775op/s 11026730.218op/s ± 58872.369op/s 11088628.890op/s 11158326.419op/s 11214055.368op/s 11232349.653op/s 1.86% -0.061 -0.342 0.78% 6070.072op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.000µs 2.015µs 2.015µs 2.016µs 2.029µs 0.71% 9.226 110.457 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 492905486.738op/s 496421093.451op/s ± 287753.364op/s 496418711.436op/s ± 122490.664op/s 496569569.401op/s 496643795.763op/s 496682346.496op/s 496693859.613op/s 0.06% -9.179 109.681 0.06% 20347.236op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 84.260µs 86.314µs ± 0.514µs 86.307µs ± 0.304µs 86.586µs 87.188µs 87.548µs 87.869µs 1.81% 0.077 1.209 0.59% 0.036µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11380566.740op/s 11586002.828op/s ± 69034.452op/s 11586483.814op/s ± 40853.207op/s 11634452.231op/s 11687940.748op/s 11747560.981op/s 11868067.603op/s 2.43% -0.019 1.273 0.59% 4881.473op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 112.473µs 113.531µs ± 0.426µs 113.420µs ± 0.262µs 113.836µs 114.272µs 114.613µs 114.653µs 1.09% 0.455 -0.304 0.37% 0.030µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 8721964.641op/s 8808283.847op/s ± 32977.498op/s 8816789.785op/s ± 20432.361op/s 8832168.943op/s 8851238.662op/s 8875573.071op/s 8890999.641op/s 0.84% -0.438 -0.315 0.37% 2331.861op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 23.248µs 23.875µs ± 0.317µs 23.866µs ± 0.232µs 24.106µs 24.344µs 24.556µs 24.846µs 4.10% 0.102 -0.488 1.32% 0.022µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 40248072.006op/s 41891618.524op/s ± 554847.848op/s 41900207.356op/s ± 411917.234op/s 42310429.487op/s 42815008.855op/s 42992052.876op/s 43014064.040op/s 2.66% -0.043 -0.537 1.32% 39233.668op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.014µs; 2.015µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [496378269.355op/s; 496462152.152op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [125.330µs; 125.463µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [7970605.084op/s; 7979065.657op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [116.888µs; 117.028µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/ 378282246310005 throughput [8545135.508op/s; 8555391.554op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631 execution_time [2.014µs; 2.015µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/37828224631 throughput [496393158.090op/s; 496454682.863op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/378282246310005 execution_time [112.834µs; 113.053µs] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/378282246310005 throughput [8845812.536op/s; 8863056.919op/s] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [113.369µs; 113.470µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [8813012.562op/s; 8820827.592op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/x371413321323331 execution_time [24.129µs; 24.243µs] or [-0.237%; +0.237%] None None None
credit_card/is_card_number/x371413321323331 throughput [41260417.329op/s; 41456267.688op/s] or [-0.237%; +0.237%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.014µs; 2.014µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ throughput [496443868.917op/s; 496493499.943op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [98.308µs; 98.428µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10159923.758op/s; 10172316.535op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [90.594µs; 90.790µs] or [-0.108%; +0.108%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11015078.313op/s; 11038872.556op/s] or [-0.108%; +0.108%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.014µs; 2.015µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [496381213.602op/s; 496460973.300op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [86.243µs; 86.385µs] or [-0.083%; +0.083%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11576435.317op/s; 11595570.339op/s] or [-0.083%; +0.083%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [113.472µs; 113.590µs] or [-0.052%; +0.052%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [8803713.483op/s; 8812854.211op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [23.831µs; 23.919µs] or [-0.184%; +0.184%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [41814721.949op/s; 41968515.100op/s] or [-0.184%; +0.184%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 505.992µs 506.838µs ± 0.354µs 506.823µs ± 0.182µs 506.990µs 507.397µs 507.683µs 509.338µs 0.50% 2.257 12.761 0.07% 0.025µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1963331.663op/s 1973018.053op/s ± 1376.168op/s 1973076.329op/s ± 709.574op/s 1973832.152op/s 1974791.049op/s 1975331.730op/s 1976317.210op/s 0.16% -2.237 12.597 0.07% 97.310op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 478.810µs 479.300µs ± 0.221µs 479.279µs ± 0.139µs 479.449µs 479.701µs 479.802µs 480.012µs 0.15% 0.194 0.121 0.05% 0.016µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2083282.165op/s 2086376.762op/s ± 963.033op/s 2086466.923op/s ± 605.634op/s 2087013.583op/s 2088029.133op/s 2088439.965op/s 2088510.641op/s 0.10% -0.191 0.119 0.05% 68.097op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 180.383µs 180.759µs ± 0.168µs 180.746µs ± 0.105µs 180.858µs 181.029µs 181.190µs 181.453µs 0.39% 0.342 0.973 0.09% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5511057.870op/s 5532226.626op/s ± 5137.697op/s 5532638.587op/s ± 3202.872op/s 5535498.936op/s 5541085.626op/s 5543044.116op/s 5543764.164op/s 0.20% -0.334 0.955 0.09% 363.290op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.123µs 44.379µs ± 0.110µs 44.417µs ± 0.055µs 44.456µs 44.496µs 44.558µs 44.657µs 0.54% -0.723 -0.395 0.25% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22392752.710op/s 22533238.555op/s ± 56141.943op/s 22513701.699op/s ± 27694.410op/s 22570220.739op/s 22641428.623op/s 22660569.040op/s 22663870.407op/s 0.67% 0.731 -0.391 0.25% 3969.835op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.977µs 49.165µs ± 0.098µs 49.158µs ± 0.029µs 49.193µs 49.231µs 49.255µs 50.365µs 2.45% 9.110 110.099 0.20% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19855200.181op/s 20339908.273op/s ± 39889.345op/s 20342527.959op/s ± 12108.988op/s 20353028.004op/s 20375199.828op/s 20401251.540op/s 20417839.209op/s 0.37% -8.937 107.378 0.20% 2820.603op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [506.789µs; 506.887µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1972827.329op/s; 1973208.776op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [479.269µs; 479.331µs] or [-0.006%; +0.006%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2086243.295op/s; 2086510.229op/s] or [-0.006%; +0.006%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.736µs; 180.782µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5531514.590op/s; 5532938.661op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [44.364µs; 44.394µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22525457.821op/s; 22541019.288op/s] or [-0.035%; +0.035%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.151µs; 49.178µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20334379.994op/s; 20345436.553op/s] or [-0.027%; +0.027%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 270.386µs 271.611µs ± 0.602µs 271.491µs ± 0.357µs 271.957µs 272.696µs 273.322µs 274.502µs 1.11% 1.207 2.492 0.22% 0.043µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3642954.071op/s 3681760.483op/s ± 8142.257op/s 3683359.964op/s ± 4843.269op/s 3687496.814op/s 3691682.496op/s 3695164.090op/s 3698413.602op/s 0.41% -1.187 2.405 0.22% 575.744op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 26.550µs 26.624µs ± 0.050µs 26.613µs ± 0.031µs 26.653µs 26.724µs 26.763µs 26.782µs 0.63% 0.930 0.309 0.19% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 37339182.217op/s 37560496.176op/s ± 71008.419op/s 37575130.691op/s ± 44317.441op/s 37617305.912op/s 37643168.209op/s 37660897.817op/s 37665085.547op/s 0.24% -0.922 0.289 0.19% 5021.053op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.086µs 16.114µs ± 0.038µs 16.093µs ± 0.003µs 16.131µs 16.186µs 16.238µs 16.270µs 1.10% 1.768 2.661 0.24% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 61462721.336op/s 62059310.210op/s ± 146676.499op/s 62139073.409op/s ± 11458.261op/s 62147451.248op/s 62157110.109op/s 62161619.564op/s 62164229.675op/s 0.04% -1.757 2.601 0.24% 10371.595op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [271.527µs; 271.694µs] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3680632.044op/s; 3682888.921op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [26.617µs; 26.631µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [37550655.092op/s; 37570337.260op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.108µs; 16.119µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good throughput [62038982.258op/s; 62079638.162op/s] or [-0.033%; +0.033%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.429µs 139.330µs ± 0.645µs 139.275µs ± 0.199µs 139.470µs 139.924µs 140.447µs 146.966µs 5.52% 8.422 96.686 0.46% 0.046µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.240µs; 139.419µs] or [-0.064%; +0.064%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.677µs 2.725µs ± 0.019µs 2.721µs ± 0.009µs 2.734µs 2.766µs 2.772µs 2.774µs 1.93% 0.391 0.780 0.70% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.722µs; 2.727µs] or [-0.097%; +0.097%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 75.154µs 75.287µs ± 0.133µs 75.265µs ± 0.038µs 75.312µs 75.402µs 75.557µs 76.850µs 2.11% 8.447 94.727 0.18% 0.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [75.269µs; 75.306µs] or [-0.024%; +0.024%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.936ms 8.975ms ± 0.014ms 8.975ms ± 0.009ms 8.983ms 9.000ms 9.021ms 9.030ms 0.62% 0.604 1.441 0.16% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.973ms; 8.977ms] or [-0.022%; +0.022%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.384µs 3.246µs ± 1.646µs 3.062µs ± 0.026µs 3.085µs 3.184µs 13.934µs 19.039µs 521.71% 7.753 62.311 50.57% 0.116µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.018µs; 3.474µs] or [-7.026%; +7.026%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 22185da 1727940732 gleocadie/bump-to-v13.1
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.137µs 1.204µs ± 0.023µs 1.210µs ± 0.011µs 1.221µs 1.223µs 1.225µs 1.227µs 1.42% -1.518 1.425 1.93% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.200µs; 1.207µs] or [-0.269%; +0.269%] None None None

Baseline

Omitted due to size.

@gleocadie gleocadie merged commit 6e8dbae into main Oct 3, 2024
30 checks passed
@gleocadie gleocadie deleted the gleocadie/bump-to-v13.1 branch October 3, 2024 08:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants