Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Serverless Mini Agent] bump version to 0.6.1 #575

Merged
merged 2 commits into from
Aug 5, 2024

Conversation

apiarian-datadog
Copy link
Contributor

What does this PR do?

Bumps serverless mini agent version up.

Motivation

Releasing this new version

Additional Notes

Here are the changes since v0.6.0

How to test the change?

In addition to unit tests, this code was deployed to a test Azure Function.

@apiarian-datadog apiarian-datadog requested a review from a team as a code owner August 5, 2024 14:35
@apiarian-datadog apiarian-datadog requested a review from a team as a code owner August 5, 2024 14:40
Copy link
Contributor

@duncanpharvey duncanpharvey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.39%. Comparing base (d0832ff) to head (9c9ed6e).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #575      +/-   ##
==========================================
- Coverage   70.39%   70.39%   -0.01%     
==========================================
  Files         214      214              
  Lines       28901    28901              
==========================================
- Hits        20346    20345       -1     
- Misses       8555     8556       +1     
Components Coverage Δ
crashtracker 21.15% <ø> (-0.06%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.07% <ø> (ø)
ddcommon-ffi 70.20% <ø> (ø)
ddtelemetry 58.95% <ø> (ø)
ipc 84.18% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 34.55% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.87% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.16% <ø> (ø)
trace-utils 91.81% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Aug 5, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-05 14:56:02

Comparing candidate commit 9c9ed6e in PR branch aleksandr.pasechnik/sls-v0.6.1-pre-release with baseline commit d0832ff in branch main.

Found 2 performance improvements and 2 performance regressions! Performance is the same for 38 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟥 execution_time [+35.734ns; +36.968ns] or [+2.164%; +2.238%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟩 execution_time [-34.960ns; -34.832ns] or [-35.706%; -35.575%]
  • 🟩 throughput [+5640606.423op/s; +5672292.799op/s] or [+55.229%; +55.539%]

scenario:tags/replace_trace_tags

  • 🟥 execution_time [+53.225ns; +54.975ns] or [+2.332%; +2.409%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.452µs 37.716µs ± 33.180µs 37.954µs ± 3.030µs 40.466µs 51.033µs 65.641µs 476.946µs 1156.64% 11.704 152.218 87.75% 2.346µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [33.118µs; 42.315µs] or [-12.192%; +12.192%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 321.541ns 332.066ns ± 4.079ns 331.939ns ± 1.114ns 333.221ns 339.085ns 342.095ns 351.439ns 5.87% 0.606 2.879 1.23% 0.288ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [331.501ns; 332.632ns] or [-0.170%; +0.170%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 140.345µs 140.711µs ± 0.184µs 140.700µs ± 0.092µs 140.777µs 141.003µs 141.273µs 141.856µs 0.82% 1.789 7.816 0.13% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [140.686µs; 140.737µs] or [-0.018%; +0.018%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 580.937ns 592.255ns ± 4.675ns 591.912ns ± 3.002ns 595.060ns 599.798ns 603.534ns 607.299ns 2.60% 0.307 0.319 0.79% 0.331ns 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 439.081ns 453.556ns ± 3.624ns 454.379ns ± 0.834ns 455.157ns 456.078ns 457.435ns 459.576ns 1.14% -2.959 8.483 0.80% 0.256ns 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 192.965ns 203.351ns ± 4.300ns 203.848ns ± 3.363ns 206.473ns 209.376ns 212.977ns 222.613ns 9.21% 0.280 1.073 2.11% 0.304ns 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.426ns 43.403ns ± 7.069ns 40.485ns ± 2.823ns 46.627ns 58.752ns 59.181ns 59.201ns 46.23% 1.337 0.436 16.25% 0.500ns 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 62.720ns 70.087ns ± 5.959ns 68.187ns ± 3.150ns 69.453ns 80.963ns 82.011ns 83.917ns 23.07% 0.952 -0.628 8.48% 0.421ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [591.607ns; 592.903ns] or [-0.109%; +0.109%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.054ns; 454.058ns] or [-0.111%; +0.111%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [202.755ns; 203.947ns] or [-0.293%; +0.293%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [42.423ns; 44.383ns] or [-2.257%; +2.257%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [69.261ns; 70.913ns] or [-1.178%; +1.178%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.273ns 3.428ns ± 0.014ns 3.429ns ± 0.001ns 3.430ns 3.432ns 3.434ns 3.441ns 0.35% -9.995 102.156 0.40% 0.001ns 1 200
credit_card/is_card_number/ throughput 290640344.744op/s 291761226.707op/s ± 1206128.663op/s 291649298.830op/s ± 76816.030op/s 291730073.611op/s 291875781.896op/s 292128811.454op/s 305525077.132op/s 4.76% 10.047 103.228 0.41% 85286.176op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 85.463ns 87.175ns ± 0.739ns 87.059ns ± 0.401ns 87.555ns 88.431ns 89.519ns 89.715ns 3.05% 0.631 0.999 0.85% 0.052ns 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11146363.384op/s 11472055.569op/s ± 96724.052op/s 11486456.953op/s ± 52868.942op/s 11524466.104op/s 11617099.490op/s 11667687.370op/s 11700935.146op/s 1.87% -0.566 0.883 0.84% 6839.423op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 80.652ns 82.377ns ± 0.708ns 82.314ns ± 0.414ns 82.769ns 83.630ns 83.919ns 84.675ns 2.87% 0.238 0.339 0.86% 0.050ns 1 200
credit_card/is_card_number/ 378282246310005 throughput 11809820.017op/s 12140256.188op/s ± 104112.959op/s 12148660.443op/s ± 61421.261op/s 12198231.607op/s 12311401.376op/s 12377440.964op/s 12399008.409op/s 2.06% -0.180 0.283 0.86% 7361.898op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.266ns 3.428ns ± 0.016ns 3.429ns ± 0.001ns 3.430ns 3.432ns 3.438ns 3.473ns 1.28% -9.019 85.939 0.48% 0.001ns 1 200
credit_card/is_card_number/37828224631 throughput 287972643.527op/s 291763757.247op/s ± 1459632.197op/s 291653974.002op/s ± 78668.781op/s 291722768.048op/s 291852396.393op/s 292358870.600op/s 306196348.535op/s 4.99% 9.110 86.851 0.50% 103211.582op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 77.994ns 80.215ns ± 0.836ns 80.127ns ± 0.365ns 80.521ns 81.607ns 83.186ns 83.986ns 4.82% 0.927 3.547 1.04% 0.059ns 1 200
credit_card/is_card_number/378282246310005 throughput 11906804.223op/s 12467887.465op/s ± 128720.262op/s 12480130.689op/s ± 56805.173op/s 12534248.837op/s 12672107.367op/s 12785288.523op/s 12821516.649op/s 2.74% -0.784 3.161 1.03% 9101.897op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 66.406ns 68.079ns ± 0.682ns 68.033ns ± 0.222ns 68.252ns 68.648ns 70.002ns 75.205ns 10.54% 6.039 59.193 1.00% 0.048ns 1 200
credit_card/is_card_number/37828224631000521389798 throughput 13296951.901op/s 14690233.396op/s ± 139332.580op/s 14698650.817op/s ± 47901.669op/s 14748943.849op/s 14829223.221op/s 14906122.239op/s 15058853.299op/s 2.45% -5.335 49.962 0.95% 9852.301op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.240ns 22.549ns ± 0.456ns 22.532ns ± 0.259ns 22.812ns 23.265ns 23.906ns 24.210ns 7.45% 0.301 1.836 2.02% 0.032ns 1 200
credit_card/is_card_number/x371413321323331 throughput 41304398.834op/s 44365355.093op/s ± 894270.204op/s 44382229.548op/s ± 515592.311op/s 44888253.549op/s 45635457.005op/s 46888628.617op/s 47081756.459op/s 6.08% -0.076 1.693 2.01% 63234.453op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.267ns 3.429ns ± 0.016ns 3.431ns ± 0.001ns 3.432ns 3.433ns 3.434ns 3.436ns 0.15% -9.759 93.888 0.47% 0.001ns 1 200
credit_card/is_card_number_no_luhn/ throughput 291015485.449op/s 291600394.678op/s ± 1438884.452op/s 291462753.257op/s ± 49549.076op/s 291509188.056op/s 291625442.746op/s 291961886.622op/s 306064379.947op/s 5.01% 9.768 94.007 0.49% 101744.495op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 66.385ns 67.930ns ± 0.703ns 67.859ns ± 0.264ns 68.118ns 68.854ns 69.677ns 74.949ns 10.45% 5.239 48.427 1.03% 0.050ns 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13342330.549op/s 14722547.275op/s ± 144990.253op/s 14736399.919op/s ± 57290.656op/s 14793938.214op/s 14870271.365op/s 14953117.586op/s 15063595.847op/s 2.22% -4.577 39.848 0.98% 10252.359op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 61.516ns 63.017ns ± 0.454ns 62.969ns ± 0.235ns 63.246ns 63.863ns 64.194ns 64.908ns 3.08% 0.557 1.834 0.72% 0.032ns 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15406331.467op/s 15869576.730op/s ± 113956.504op/s 15880847.728op/s ± 59614.215op/s 15932203.771op/s 16042430.821op/s 16114590.182op/s 16255923.969op/s 2.36% -0.482 1.732 0.72% 8057.942op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.274ns 3.430ns ± 0.013ns 3.431ns ± 0.000ns 3.431ns 3.432ns 3.433ns 3.437ns 0.18% -10.501 113.395 0.38% 0.001ns 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 290962356.529op/s 291587840.386op/s ± 1154882.143op/s 291473362.296op/s ± 41222.917op/s 291513599.001op/s 291606784.772op/s 291920253.524op/s 305425256.076op/s 4.79% 10.561 114.834 0.40% 81662.500op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 59.853ns 61.207ns ± 0.507ns 61.233ns ± 0.335ns 61.531ns 62.033ns 62.228ns 62.523ns 2.11% -0.147 -0.103 0.83% 0.036ns 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15994043.751op/s 16339146.766op/s ± 135515.524op/s 16330937.496op/s ± 89708.070op/s 16428640.256op/s 16562305.449op/s 16673119.255op/s 16707691.536op/s 2.31% 0.194 -0.076 0.83% 9582.395op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 66.404ns 67.366ns ± 0.373ns 67.354ns ± 0.204ns 67.584ns 67.941ns 68.306ns 69.050ns 2.52% 0.511 2.606 0.55% 0.026ns 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 14482320.148op/s 14844813.307op/s ± 82062.335op/s 14846851.457op/s ± 44935.756op/s 14889483.004op/s 14962392.486op/s 15043311.713op/s 15059228.319op/s 1.43% -0.440 2.430 0.55% 5802.683op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.326ns 22.100ns ± 0.348ns 22.059ns ± 0.215ns 22.302ns 22.655ns 23.317ns 23.501ns 6.54% 0.922 2.214 1.57% 0.025ns 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 42552118.441op/s 45260818.655op/s ± 702397.534op/s 45333969.296op/s ± 441838.601op/s 45690854.468op/s 46282135.740op/s 46639623.107op/s 46890769.157op/s 3.43% -0.769 1.780 1.55% 49667.006op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.426ns; 3.429ns] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/ throughput [291594068.874op/s; 291928384.540op/s] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [87.072ns; 87.277ns] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11458650.546op/s; 11485460.593op/s] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [82.279ns; 82.475ns] or [-0.119%; +0.119%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12125827.133op/s; 12154685.243op/s] or [-0.119%; +0.119%] None None None
credit_card/is_card_number/37828224631 execution_time [3.425ns; 3.430ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/37828224631 throughput [291561466.263op/s; 291966048.231op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.099ns; 80.330ns] or [-0.144%; +0.144%] None None None
credit_card/is_card_number/378282246310005 throughput [12450048.075op/s; 12485726.855op/s] or [-0.143%; +0.143%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [67.984ns; 68.173ns] or [-0.139%; +0.139%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [14670923.240op/s; 14709543.551op/s] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.486ns; 22.612ns] or [-0.280%; +0.280%] None None None
credit_card/is_card_number/x371413321323331 throughput [44241417.843op/s; 44489292.343op/s] or [-0.279%; +0.279%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.427ns; 3.432ns] or [-0.065%; +0.065%] None None None
credit_card/is_card_number_no_luhn/ throughput [291400979.132op/s; 291799810.225op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [67.833ns; 68.027ns] or [-0.143%; +0.143%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14702453.020op/s; 14742641.529op/s] or [-0.136%; +0.136%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [62.954ns; 63.080ns] or [-0.100%; +0.100%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15853783.455op/s; 15885370.006op/s] or [-0.100%; +0.100%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.428ns; 3.431ns] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [291427784.828op/s; 291747895.944op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.137ns; 61.277ns] or [-0.115%; +0.115%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16320365.617op/s; 16357927.914op/s] or [-0.115%; +0.115%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [67.314ns; 67.417ns] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [14833440.257op/s; 14856186.357op/s] or [-0.077%; +0.077%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.051ns; 22.148ns] or [-0.218%; +0.218%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [45163473.112op/s; 45358164.198op/s] or [-0.215%; +0.215%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.686µs 1.688µs ± 0.001µs 1.688µs ± 0.000µs 1.688µs 1.689µs 1.690µs 1.692µs 0.26% 2.013 14.057 0.04% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.688µs; 1.688µs] or [-0.005%; +0.005%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.440µs 2.929µs ± 1.820µs 2.756µs ± 0.016µs 2.773µs 3.033µs 3.641µs 24.135µs 775.63% 10.252 107.747 61.99% 0.129µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.676µs; 3.181µs] or [-8.612%; +8.612%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.323µs 2.336µs ± 0.004µs 2.336µs ± 0.002µs 2.338µs 2.344µs 2.349µs 2.351µs 0.65% 0.693 0.873 0.18% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.336µs; 2.337µs] or [-0.025%; +0.025%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 36.801µs 36.919µs ± 0.132µs 36.899µs ± 0.029µs 36.932µs 37.027µs 37.090µs 38.611µs 4.64% 10.697 134.165 0.36% 0.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [36.901µs; 36.937µs] or [-0.049%; +0.049%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 280.694ns 281.832ns ± 0.323ns 281.834ns ± 0.064ns 281.903ns 282.121ns 282.393ns 285.230ns 1.20% 5.377 61.155 0.11% 0.023ns 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 33.619ns 34.362ns ± 0.560ns 34.337ns ± 0.245ns 34.577ns 34.945ns 35.199ns 40.283ns 17.32% 5.908 60.794 1.62% 0.040ns 1 200
normalization/normalize_name/normalize_name/good execution_time 21.363ns 21.819ns ± 0.138ns 21.801ns ± 0.071ns 21.876ns 22.040ns 22.183ns 22.797ns 4.57% 2.050 12.755 0.63% 0.010ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [281.787ns; 281.876ns] or [-0.016%; +0.016%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [34.285ns; 34.440ns] or [-0.226%; +0.226%] None None None
normalization/normalize_name/normalize_name/good execution_time [21.800ns; 21.838ns] or [-0.087%; +0.087%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 9c9ed6e 1722868846 aleksandr.pasechnik/sls-v0.6.1-pre-release
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 70.688µs 70.914µs ± 0.111µs 70.912µs ± 0.029µs 70.941µs 70.991µs 71.151µs 71.840µs 1.31% 5.723 46.722 0.16% 0.008µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [70.899µs; 70.930µs] or [-0.022%; +0.022%] None None None

Baseline

Omitted due to size.

@apiarian-datadog
Copy link
Contributor Author

confirmed with the test azure funciton that traces and metrics are coming through.

@apiarian-datadog apiarian-datadog merged commit 1d4b6b8 into main Aug 5, 2024
33 checks passed
@apiarian-datadog apiarian-datadog deleted the aleksandr.pasechnik/sls-v0.6.1-pre-release branch August 5, 2024 15:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants