Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use the correct format for capability submission #665

Merged
merged 1 commit into from
Oct 3, 2024

Conversation

bwoebi
Copy link
Contributor

@bwoebi bwoebi commented Oct 3, 2024

These need to be in a big-endian bitset, so we send that.

@bwoebi bwoebi requested review from a team as code owners October 3, 2024 17:11
@pr-commenter
Copy link

pr-commenter bot commented Oct 3, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-10-03 18:30:27

Comparing candidate commit 68c9b4f in PR branch bob/capabilities_bytes with baseline commit 444fe4e in branch main.

Found 0 performance improvements and 3 performance regressions! Performance is the same for 48 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+10.885µs; +11.263µs] or [+12.034%; +12.451%]
  • 🟥 throughput [-1224484.967op/s; -1185329.153op/s] or [-11.076%; -10.722%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

  • 🟥 execution_time [+484.109ns; +607.662ns] or [+2.060%; +2.586%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 19.123µs 25.446µs ± 10.862µs 20.412µs ± 0.520µs 28.742µs 45.528µs 47.108µs 101.613µs 397.80% 3.503 18.400 42.58% 0.768µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.941µs; 26.951µs] or [-5.916%; +5.916%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.331µs 507.276µs ± 0.611µs 507.154µs ± 0.318µs 507.517µs 508.438µs 508.814µs 511.375µs 0.83% 2.118 9.307 0.12% 0.043µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1955512.100op/s 1971315.552op/s ± 2370.273op/s 1971788.005op/s ± 1236.685op/s 1972787.314op/s 1974012.967op/s 1974784.543op/s 1974994.249op/s 0.16% -2.093 9.099 0.12% 167.604op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 468.161µs 468.817µs ± 0.288µs 468.801µs ± 0.195µs 468.995µs 469.364µs 469.592µs 469.659µs 0.18% 0.388 0.156 0.06% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2129206.289op/s 2133031.348op/s ± 1309.410op/s 2133100.893op/s ± 886.429op/s 2133983.622op/s 2135095.409op/s 2135706.066op/s 2136016.830op/s 0.14% -0.384 0.152 0.06% 92.589op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 180.422µs 180.861µs ± 0.180µs 180.859µs ± 0.123µs 180.982µs 181.145µs 181.234µs 181.349µs 0.27% -0.055 -0.303 0.10% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5514225.019op/s 5529103.397op/s ± 5491.149op/s 5529178.453op/s ± 3772.671op/s 5532887.399op/s 5538273.366op/s 5541271.654op/s 5542549.340op/s 0.24% 0.060 -0.303 0.10% 388.283op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.485µs 44.564µs ± 0.042µs 44.559µs ± 0.024µs 44.583µs 44.624µs 44.664µs 44.897µs 0.76% 2.726 18.041 0.09% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22273449.425op/s 22439785.864op/s ± 21209.878op/s 22442375.474op/s ± 12165.777op/s 22454076.702op/s 22464135.654op/s 22473352.666op/s 22479399.124op/s 0.16% -2.691 17.683 0.09% 1499.765op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.128µs 49.222µs ± 0.106µs 49.210µs ± 0.024µs 49.238µs 49.289µs 49.332µs 50.603µs 2.83% 11.110 142.051 0.21% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19761635.157op/s 20316099.215op/s ± 42769.088op/s 20320926.128op/s ± 9830.433op/s 20329142.368op/s 20346421.798op/s 20352224.967op/s 20354898.972op/s 0.17% -10.977 139.732 0.21% 3024.231op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.191µs; 507.361µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1970987.055op/s; 1971644.049op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [468.777µs; 468.856µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2132849.876op/s; 2133212.819op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.836µs; 180.886µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5528342.377op/s; 5529864.418op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [44.558µs; 44.570µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22436846.379op/s; 22442725.349op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.208µs; 49.237µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20310171.831op/s; 20322026.599op/s] or [-0.029%; +0.029%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.752µs 38.349µs ± 1.086µs 37.830µs ± 0.048µs 38.007µs 40.669µs 40.706µs 41.681µs 10.18% 1.701 0.994 2.83% 0.077µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.198µs; 38.499µs] or [-0.393%; +0.393%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 74.320µs 74.416µs ± 0.152µs 74.393µs ± 0.024µs 74.421µs 74.498µs 74.777µs 76.233µs 2.47% 9.456 104.413 0.20% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [74.395µs; 74.437µs] or [-0.028%; +0.028%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.373µs 3.241µs ± 1.576µs 3.089µs ± 0.023µs 3.110µs 3.145µs 14.097µs 18.064µs 484.72% 7.960 64.055 48.49% 0.111µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.023µs; 3.460µs] or [-6.737%; +6.737%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.117µs 1.181µs ± 0.023µs 1.189µs ± 0.012µs 1.200µs 1.203µs 1.206µs 1.207µs 1.45% -1.270 0.834 1.95% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.178µs; 1.185µs] or [-0.271%; +0.271%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.013µs 2.015µs ± 0.001µs 2.014µs ± 0.001µs 2.015µs 2.016µs 2.017µs 2.027µs 0.63% 6.267 63.309 0.06% 0.000µs 1 200
credit_card/is_card_number/ throughput 493304276.238op/s 496396251.248op/s ± 290082.697op/s 496436158.311op/s ± 144717.204op/s 496578372.485op/s 496641937.783op/s 496667260.156op/s 496698480.713op/s 0.05% -6.222 62.647 0.06% 20511.944op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 124.251µs 125.633µs ± 0.455µs 125.627µs ± 0.281µs 125.921µs 126.384µs 126.584µs 126.802µs 0.93% -0.221 0.283 0.36% 0.032µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 7886336.597op/s 7959794.266op/s ± 28843.721op/s 7960053.270op/s ± 17796.527op/s 7977137.725op/s 8010117.823op/s 8030547.271op/s 8048215.248op/s 1.11% 0.245 0.305 0.36% 2039.559op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 115.370µs 117.123µs ± 0.574µs 117.150µs ± 0.382µs 117.531µs 118.049µs 118.332µs 118.526µs 1.17% -0.229 0.053 0.49% 0.041µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 8436959.139op/s 8538237.874op/s ± 41914.660op/s 8536063.604op/s ± 27723.524op/s 8563523.883op/s 8612017.007op/s 8646892.148op/s 8667766.331op/s 1.54% 0.259 0.077 0.49% 2963.814op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.013µs 2.014µs ± 0.001µs 2.015µs ± 0.000µs 2.015µs 2.015µs 2.016µs 2.025µs 0.51% 6.389 67.419 0.05% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 493859045.823op/s 496406374.925op/s ± 235257.285op/s 496376992.927op/s ± 113317.564op/s 496567380.450op/s 496644371.380op/s 496689805.589op/s 496714022.605op/s 0.07% -6.349 66.842 0.05% 16635.202op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 110.208µs 113.147µs ± 0.735µs 113.191µs ± 0.486µs 113.677µs 114.263µs 114.503µs 114.855µs 1.47% -0.636 1.329 0.65% 0.052µs 1 200
credit_card/is_card_number/378282246310005 throughput 8706617.323op/s 8838441.124op/s ± 57661.844op/s 8834605.826op/s ± 37943.202op/s 8872697.822op/s 8930640.273op/s 8984767.123op/s 9073776.429op/s 2.71% 0.694 1.510 0.65% 4077.308op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 112.384µs 113.601µs ± 0.415µs 113.582µs ± 0.294µs 113.877µs 114.313µs 114.699µs 114.748µs 1.03% 0.394 -0.028 0.36% 0.029µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 8714771.028op/s 8802868.728op/s ± 32135.373op/s 8804189.739op/s ± 22784.001op/s 8826674.612op/s 8846905.973op/s 8852997.598op/s 8898051.327op/s 1.07% -0.374 -0.043 0.36% 2272.314op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 23.357µs 24.218µs ± 0.422µs 24.172µs ± 0.305µs 24.526µs 24.878µs 25.117µs 25.175µs 4.15% 0.124 -0.729 1.74% 0.030µs 1 200
credit_card/is_card_number/x371413321323331 throughput 39721961.620op/s 41304647.427op/s ± 719243.004op/s 41370922.888op/s ± 515809.371op/s 41799718.466op/s 42523553.510op/s 42677877.489op/s 42814607.475op/s 3.49% -0.058 -0.735 1.74% 50858.161op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.013µs 2.015µs ± 0.001µs 2.015µs ± 0.001µs 2.015µs 2.015µs 2.016µs 2.016µs 0.09% 0.058 -0.833 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 495911749.483op/s 496397200.069op/s ± 154103.972op/s 496367792.439op/s ± 133339.627op/s 496550846.812op/s 496615701.526op/s 496652963.170op/s 496705337.987op/s 0.07% -0.057 -0.835 0.03% 10896.796op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 97.662µs 98.565µs ± 0.525µs 98.462µs ± 0.352µs 98.891µs 99.411µs 100.303µs 100.615µs 2.19% 0.869 1.119 0.53% 0.037µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 9938850.734op/s 10145920.213op/s ± 53800.828op/s 10156192.284op/s ± 36291.807op/s 10183208.708op/s 10220646.319op/s 10230944.407op/s 10239389.909op/s 0.82% -0.832 0.999 0.53% 3804.293op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 98.192µs 101.531µs ± 1.207µs 101.968µs ± 0.499µs 102.350µs 102.842µs 103.254µs 103.355µs 1.36% -1.027 -0.072 1.19% 0.085µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 9675408.610op/s 9850620.547op/s ± 118580.587op/s 9807018.206op/s ± 47779.606op/s 9897160.326op/s 10089772.748op/s 10136520.795op/s 10184140.577op/s 3.85% 1.058 -0.014 1.20% 8384.914op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.013µs 2.014µs ± 0.001µs 2.014µs ± 0.001µs 2.015µs 2.016µs 2.016µs 2.018µs 0.19% 0.978 1.302 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 495503485.544op/s 496404678.427op/s ± 195334.121op/s 496433881.637op/s ± 132110.069op/s 496560922.984op/s 496644135.358op/s 496693066.294op/s 496732214.505op/s 0.06% -0.976 1.289 0.04% 13812.208op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 85.211µs 86.511µs ± 0.511µs 86.522µs ± 0.393µs 86.871µs 87.277µs 87.550µs 88.195µs 1.93% 0.057 -0.188 0.59% 0.036µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11338507.929op/s 11559570.998op/s ± 68316.103op/s 11557721.855op/s ± 52733.946op/s 11610945.057op/s 11677925.045op/s 11712318.698op/s 11735635.784op/s 1.54% -0.026 -0.211 0.59% 4830.678op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 112.969µs 113.626µs ± 0.386µs 113.592µs ± 0.282µs 113.863µs 114.279µs 114.540µs 114.992µs 1.23% 0.550 0.073 0.34% 0.027µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 8696235.888op/s 8800890.142op/s ± 29837.724op/s 8803408.561op/s ± 21836.656op/s 8825980.037op/s 8840876.901op/s 8849557.250op/s 8852014.997op/s 0.55% -0.533 0.029 0.34% 2109.846op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 23.360µs 24.045µs ± 0.403µs 24.063µs ± 0.326µs 24.304µs 24.740µs 24.875µs 24.944µs 3.66% 0.194 -0.861 1.67% 0.028µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 40090323.983op/s 41600974.795op/s ± 695307.239op/s 41556759.919op/s ± 563118.310op/s 42226702.555op/s 42624944.808op/s 42787245.584op/s 42808841.810op/s 3.01% -0.139 -0.900 1.67% 49165.646op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.014µs; 2.015µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [496356048.576op/s; 496436453.920op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [125.570µs; 125.696µs] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [7955796.803op/s; 7963791.728op/s] or [-0.050%; +0.050%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [117.043µs; 117.203µs] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/ 378282246310005 throughput [8532428.906op/s; 8544046.843op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/37828224631 execution_time [2.014µs; 2.015µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631 throughput [496373770.528op/s; 496438979.322op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/378282246310005 execution_time [113.045µs; 113.249µs] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/378282246310005 throughput [8830449.747op/s; 8846432.501op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [113.543µs; 113.658µs] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [8798415.075op/s; 8807322.382op/s] or [-0.051%; +0.051%] None None None
credit_card/is_card_number/x371413321323331 execution_time [24.159µs; 24.276µs] or [-0.242%; +0.242%] None None None
credit_card/is_card_number/x371413321323331 throughput [41204967.264op/s; 41404327.590op/s] or [-0.241%; +0.241%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.014µs; 2.015µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [496375842.741op/s; 496418557.398op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [98.492µs; 98.637µs] or [-0.074%; +0.074%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10138463.936op/s; 10153376.490op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [101.364µs; 101.698µs] or [-0.165%; +0.165%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [9834186.418op/s; 9867054.676op/s] or [-0.167%; +0.167%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.014µs; 2.015µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [496377606.997op/s; 496431749.858op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [86.441µs; 86.582µs] or [-0.082%; +0.082%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11550103.043op/s; 11569038.953op/s] or [-0.082%; +0.082%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [113.573µs; 113.680µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [8796754.920op/s; 8805025.363op/s] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [23.989µs; 24.100µs] or [-0.232%; +0.232%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [41504611.899op/s; 41697337.692op/s] or [-0.232%; +0.232%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.644µs 2.709µs ± 0.026µs 2.714µs ± 0.022µs 2.733µs 2.743µs 2.752µs 2.755µs 1.53% -0.319 -1.024 0.96% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.705µs; 2.712µs] or [-0.134%; +0.134%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 290.655ns 300.851ns ± 13.380ns 294.719ns ± 2.905ns 303.324ns 335.952ns 338.416ns 339.055ns 15.04% 1.822 2.039 4.44% 0.946ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [298.997ns; 302.706ns] or [-0.616%; +0.616%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.562µs 139.584µs ± 0.364µs 139.575µs ± 0.139µs 139.715µs 140.186µs 140.809µs 141.810µs 1.60% 1.656 8.834 0.26% 0.026µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [139.533µs; 139.634µs] or [-0.036%; +0.036%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 270.272µs 271.619µs ± 0.704µs 271.471µs ± 0.396µs 272.031µs 272.766µs 273.754µs 274.808µs 1.23% 1.192 2.230 0.26% 0.050µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3638907.784op/s 3681657.450op/s ± 9516.726op/s 3683631.326op/s ± 5385.309op/s 3688099.174op/s 3692977.019op/s 3699503.470op/s 3699980.883op/s 0.44% -1.171 2.145 0.26% 672.934op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 26.540µs 26.593µs ± 0.048µs 26.572µs ± 0.017µs 26.610µs 26.695µs 26.732µs 26.753µs 0.68% 1.354 0.885 0.18% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 37378700.924op/s 37604193.727op/s ± 67759.269op/s 37634136.951op/s ± 23441.643op/s 37649969.111op/s 37669081.203op/s 37673298.620op/s 37678791.097op/s 0.12% -1.348 0.865 0.18% 4791.304op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.096µs 16.122µs ± 0.029µs 16.104µs ± 0.007µs 16.141µs 16.150µs 16.193µs 16.351µs 1.53% 2.954 18.945 0.18% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 61158895.359op/s 62025422.304op/s ± 110987.642op/s 62096421.381op/s ± 28024.154op/s 62111362.850op/s 62119878.325op/s 62124726.859op/s 62126247.724op/s 0.05% -2.889 18.280 0.18% 7848.011op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [271.521µs; 271.716µs] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3680338.523op/s; 3682976.377op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [26.586µs; 26.600µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [37594802.944op/s; 37613584.510op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.118µs; 16.126µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/good throughput [62010040.484op/s; 62040804.123op/s] or [-0.025%; +0.025%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 68c9b4f 1727979593 bob/capabilities_bytes
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.920ms 8.952ms ± 0.012ms 8.951ms ± 0.007ms 8.959ms 8.972ms 8.982ms 8.994ms 0.48% 0.345 0.764 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.950ms; 8.953ms] or [-0.019%; +0.019%] None None None

Baseline

Omitted due to size.

@bwoebi bwoebi force-pushed the bob/capabilities_bytes branch 4 times, most recently from 4b0597e to e5fe9db Compare October 3, 2024 17:47
@codecov-commenter
Copy link

codecov-commenter commented Oct 3, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.84%. Comparing base (444fe4e) to head (68c9b4f).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #665      +/-   ##
==========================================
+ Coverage   71.82%   71.84%   +0.02%     
==========================================
  Files         271      271              
  Lines       40912    40931      +19     
==========================================
+ Hits        29383    29405      +22     
+ Misses      11529    11526       -3     
Components Coverage Δ
crashtracker 20.41% <ø> (ø)
crashtracker-ffi 9.07% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.60% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.73% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 89.05% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.69% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 36.07% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.66% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.29% <ø> (ø)

@bwoebi bwoebi merged commit 67d4f7a into main Oct 3, 2024
30 checks passed
@bwoebi bwoebi deleted the bob/capabilities_bytes branch October 3, 2024 18:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants