Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[release/3.x] Cherry pick: Install vegeta and pebble and run corresponding tests in Daily (#5529) #5531

Merged
merged 6 commits into from
Aug 11, 2023
Merged

[release/3.x] Cherry pick: Install vegeta and pebble and run corresponding tests in Daily (#5529) #5531

merged 6 commits into from
Aug 11, 2023

Conversation

achamayou
Copy link
Member

Backports the following commits to release/3.x:

@achamayou
Install vegeta and pebble and run corresponding tests in Daily (micro…
e35f102 
…soft#5529)

(cherry picked from commit 05cc534)

# Conflicts:
#	.azure-pipelines-templates/daily-matrix.yml
#	.azure-pipelines-templates/matrix.yml
#	.daily_canary
#	.multi-thread.yml
#	CMakeLists.txt
#	getting_started/setup_vm/ccf-dev.yml
@achamayou achamayou requested a review from a team as a code owner August 10, 2023 14:30
@achamayou achamayou added the 3.x-backport Highlights PRs targeting the 3.x branch label Aug 10, 2023
@achamayou achamayou enabled auto-merge (squash) August 10, 2023 14:30
@ccf-bot
Copy link
Collaborator

ccf-bot commented Aug 10, 2023 •
edited
Loading

backport/release/3.x/pr-5529@74344 aka 20230810.30 vs release/3.x ewma over 20 builds from 72901 to 74216

Click to see table

release/3.x

build_id build_number Commit latency factor tpcc_virtual_cft^ ls_virtual_cft^ ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ hist_sgx_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
72901 20230712.2 0.791688 17216.4 45760.4 12700.5 4509.52 3800.26 3290.42 46219 6360.25 8.29727e+07 16708.5 1.50774e+07 5828.24 1.4291e+07 1544.2 7.73741e+06 1355.85 7.73741e+06 1262.97 6.95098e+06 835056 1.18271e+06 8.15228e+06 3.18462e+07
73037 20230713.3 0.804487 17139.9 45400.4 12532.5 4574.65 3778.74 3293.78 44058.1 6295.51 8.27106e+07 16867.1 1.53396e+07 5805.91 1.45532e+07 1561.85 7.73741e+06 1355.49 7.21312e+06 1269.64 6.95098e+06 836310 1.17877e+06 8.15092e+06 3.07845e+07
73102 20230714.3 0.790524 17116.9 47616.5 12764.6 4434.63 3781.04 3264.52 46029.5 6318.75 8.24484e+07 16801.5 1.53396e+07 5791.79 1.48153e+07 1553.03 7.73741e+06 1345.88 7.21312e+06 1262.98 6.95098e+06 832716 1.18248e+06 8.04352e+06 3.08308e+07
73184 20230717.4 0.808306 17255.5 47911.2 12357 4360.23 3791.82 3313.72 45243.6 6256.72 8.21863e+07 16556 1.56017e+07 5810.96 1.45532e+07 1547.86 7.47526e+06 1346.34 7.21312e+06 1267.03 6.95098e+06 831724 1.17428e+06 8.15556e+06 3.17072e+07
73207 20230718.3 0.799764 17139.4 47792.3 12588.9 4342.42 3811.36 3434.74 45965.2 6344.61 8.19242e+07 16526.6 1.53396e+07 5493.38 1.4291e+07 1545.31 7.73741e+06 1341.92 7.21312e+06 1261.08 6.95098e+06 829185 1.17076e+06 8.15407e+06 3.08545e+07
73296 20230719.4 0.798651 17311.9 47999.1 12440 4428.7 3813.13 3323.85 43122.3 5655.04 8.21863e+07 16564.1 1.50774e+07 5513.88 1.45532e+07 1546.42 7.73741e+06 1340.71 7.73741e+06 1245.09 6.95098e+06 837452 1.17682e+06 8.15371e+06 3.06964e+07
73338 20230720.4 0.802352 17118.3 45757.4 12336.9 4510.85 3817.94 3338.51 44171.4 6311.89 8.27106e+07 16886.3 1.53396e+07 5507.43 1.45532e+07 1550.94 7.73741e+06 1347.91 7.47526e+06 1264.96 6.95098e+06 830871 1.17723e+06 8.13897e+06 3.09071e+07
73420 20230721.2 0.766952 17134 45531.9 12695.7 4609.53 3827.11 3258.25 48226.6 6325.88 8.27106e+07 16824.2 1.53396e+07 5800.19 1.48153e+07 1547.9 7.73741e+06 1355.9 7.21312e+06 1269.5 6.95098e+06 828375 1.18578e+06 8.15361e+06 3.14748e+07
73485 20230724.4 0.774691 17214.4 45587.7 12407.5 4607.96 3821.48 3230.13 49003.4 7244.25 8.39025e+07 21654.2 1.88908e+07 6727.8 1.67936e+07 1758.41 1.05021e+07 1540.93 1.05021e+07 1444.41 1.05021e+07 841600 1.17968e+06 8.17271e+06 3.10092e+07
73505 20230725.4 0.786718 16953.8 47559.2 12277.4 4549.21 3687.28 3318.02 50437.9 7284.41 8.59996e+07 21167.5 1.88908e+07 6709.68 1.67936e+07 1758.37 1.05021e+07 1525.15 1.05021e+07 1435.27 1.05021e+07 839934 1.1751e+06 8.15202e+06 3.07826e+07
73524 20230726.4 0.80437 17104.5 47739.1 12315.3 4443.67 3813.34 3298.06 46816.2 7280.78 8.59996e+07 21643 1.67936e+07 6724.51 1.67936e+07 1764.93 1.05021e+07 1531.96 1.05021e+07 1437.81 1.05021e+07 833430 1.13733e+06 8.15634e+06 3.07734e+07
73543 20230727.5 0.78807 17422.1 45719.4 12908.1 4458.16 3726.94 3305 46088.2 7341.55 8.39025e+07 21567.3 1.88908e+07 6358.56 1.67936e+07 1763.29 1.05021e+07 1522.17 1.05021e+07 1440.22 1.05021e+07 832237 1.17545e+06 8.15449e+06 3.09787e+07
73565 20230728.5 0.795726 17116.9 45446.9 12761 4434.61 3673.86 3260.1 48938.9 7295.29 8.59996e+07 21330.6 1.88908e+07 6406.84 1.67936e+07 1767.48 1.05021e+07 1544.48 1.05021e+07 1444.21 1.05021e+07 836959 1.18019e+06 8.17428e+06 3.0778e+07
73617 20230731.5 0.803945 17118.9 47806.6 12404.2 4496.52 3821.04 3327.31 51151.5 7296.97 8.39025e+07 21265.1 1.88908e+07 6724.95 1.67936e+07 1766.97 1.05021e+07 1542.61 1.05021e+07 1444.06 1.05021e+07 841259 1.17466e+06 8.17063e+06 3.0875e+07
73709 20230801.5 0.802037 17050.5 47468 12750 4537.51 3807.97 3377.84 50122.9 7318.08 8.59996e+07 21497.5 1.67936e+07 6714.18 1.67936e+07 1772.96 1.05021e+07 1521.92 1.05021e+07 1432.93 1.05021e+07 825341 1.18055e+06 8.15514e+06 3.07226e+07
73782 20230802.5 0.816494 17376.4 47847.5 12471 4586.11 3892.6 3191.82 50947.6 7250.57 8.59996e+07 21474.3 1.67936e+07 6735.43 1.67936e+07 1763.89 1.05021e+07 1544.56 1.05021e+07 1429.67 1.05021e+07 838639 1.17986e+06 8.04197e+06 3.19187e+07
73837 20230803.4 0.806337 17263.7 45563.1 12528.6 4354.52 3688.68 3312.09 48750.4 7351.44 8.59996e+07 21700.8 1.88908e+07 6755.01 1.67936e+07 1761.17 1.05021e+07 1546.08 1.05021e+07 1437.93 1.05021e+07 833358 1.18026e+06 8.15465e+06 3.07845e+07
73950 20230807.3 0.763997 17125.4 47805.3 12489.9 4382.22 3749.74 3418.96 46518.6 7301.51 8.59996e+07 21288.7 1.88908e+07 6755.38 1.67936e+07 1765.41 1.05021e+07 1542.1 1.05021e+07 1441.89 1.05021e+07 831467 1.18291e+06 8.15212e+06 3.08169e+07
74002 20230808.5 0.810463 17346.6 45597.8 12306 4512.47 3821.68 3370.24 48935.9 7347.76 8.59996e+07 21788.9 1.88908e+07 6763.92 1.67936e+07 1782.02 1.05021e+07 1543.11 1.05021e+07 1445.31 1.05021e+07 817752 1.18174e+06 8.15189e+06 3.07914e+07
74216 20230810.5 0.813408 17060.1 47577.1 12825.5 4545.65 3783.18 3331.89 50745.1 7242.86 8.39025e+07 21602.3 1.88908e+07 6727.09 1.67936e+07 1780.29 1.05021e+07 1544.66 1.05021e+07 1445.98 1.05021e+07 827904 1.178e+06 8.15257e+06 3.0797e+07

backport/release/3.x/pr-5529

build_id build_number Commit latency factor tpcc_virtual_cft^ ls_virtual_cft^ ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ tpcc_sgx_cft^ tpcc_sgx_cft_mem hist_sgx_cft^ ls_sgx_cft^ ls_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^
74315 20230810.25 0.79257 17083.7 45360 12811.6 4346.38 3790.79 3220.01 7254.74 8.59996e+07 48916.4 21229.4 1.88908e+07 6702.38 1.67936e+07 1782.11 1.05021e+07 1545.99 1.05021e+07 1444.15 1.05021e+07 838361 1.18405e+06 8.17568e+06 3.14549e+07
74344 20230810.30 0.77554 17300.7 47687.6 12933 4443.01 3847.95 3251.75 7386.74 8.59996e+07 49888.8 21319.8 1.88908e+07 6692.42 1.88908e+07 1780.07 1.05021e+07 1539.56 1.05021e+07 1436.52 1.05021e+07 832959 1.17273e+06 8.15313e+06 3.07873e+07

images

@achamayou achamayou merged commit d2571c3 into microsoft:release/3.x Aug 11, 2023
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jumaffre jumaffre jumaffre approved these changes

Assignees
No one assigned
Labels
3.x-backport Highlights PRs targeting the 3.x branch
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@achamayou @ccf-bot @jumaffre