Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ci: Fix change-detection to not fail when new tests are added. #333

Merged
merged 1 commit into from
Apr 17, 2022
Merged

ci: Fix change-detection to not fail when new tests are added. #333

merged 1 commit into from
Apr 17, 2022

Conversation

shahzadlone
Copy link
Member

Resolves #332 .

@shahzadlone shahzadlone added this to the DefraDB v0.3 milestone Apr 7, 2022
@shahzadlone shahzadlone self-assigned this Apr 7, 2022
@shahzadlone shahzadlone mentioned this pull request Apr 7, 2022
Merged
@source-devs
Copy link

Benchmark Results

Summary

  • 113 Benchmarks successfully compared.
  • 23 Benchmarks were ✅ Better.
  • 90 Benchmarks were ❌ Worse .
  • 0 Benchmarks were ✨ Unchanged.
✅ See Better Results...
time/opdelta
_Collection_UserSimple_Read_Sync_1000_10-4340µs ± 0%333µs ± 0%−1.99%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%9.31ms ± 0%−0.96%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4406µs ± 0%405µs ± 0%−0.09%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-411.8ms ± 0%11.7ms ± 0%−0.91%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-412.8µs ± 0%12.7µs ± 0%−0.90%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-413.6µs ± 0%13.4µs ± 0%−1.08%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-415.1µs ± 0%15.1µs ± 0%−0.21%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-419.2µs ± 0%18.7µs ± 0%−2.56%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-415.0µs ± 0%14.9µs ± 0%−0.59%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-420.4µs ± 0%19.9µs ± 0%−2.74%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4196µs ± 0%194µs ± 0%−0.88%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-453.0µs ± 0%52.7µs ± 0%−0.52%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4115µs ± 0%114µs ± 0%−1.46%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.14ms ± 0%1.14ms ± 0%−0.08%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.16ms ± 0%1.15ms ± 0%−0.44%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.22ms ± 0%1.20ms ± 0%−1.67%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4131µs ± 0%130µs ± 0%−1.30%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-48.20µs ± 0%8.16µs ± 0%−0.54%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-49.34µs ± 0%9.27µs ± 0%−0.74%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-415.0µs ± 0%14.5µs ± 0%−3.50%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4118µs ± 0%117µs ± 0%−0.94%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.19ms ± 0%1.18ms ± 0%−1.23%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.26ms ± 0%1.25ms ± 0%−0.98%(p=1.000 n=1+1)
 
❌ See Worse Results...
time/opdelta
_Collection_UserSimple_CreateMany_Sync_0_100-4208ms ± 0%217ms ± 0%+4.29%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-49.27ms ± 0%9.71ms ± 0%+4.75%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-493.8ms ± 0%104.5ms ± 0%+11.41%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-4963ms ± 0%1030ms ± 0%+6.94%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-441.9ms ± 0%45.7ms ± 0%+9.15%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4415ms ± 0%448ms ± 0%+7.92%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.31s ± 0%4.64s ± 0%+7.60%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4317µs ± 0%336µs ± 0%+6.06%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.40ms ± 0%3.48ms ± 0%+2.45%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-437.0ms ± 0%38.1ms ± 0%+2.83%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.55ms ± 0%3.96ms ± 0%+11.48%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4238µs ± 0%307µs ± 0%+28.92%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.71ms ± 0%2.37ms ± 0%+38.53%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-422.4ms ± 0%25.7ms ± 0%+14.57%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4249µs ± 0%316µs ± 0%+26.92%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.81ms ± 0%2.44ms ± 0%+35.08%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.10ms ± 0%1.21ms ± 0%+9.55%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.21ms ± 0%1.22ms ± 0%+1.33%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-49.56ms ± 0%9.71ms ± 0%+1.58%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4367µs ± 0%372µs ± 0%+1.20%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4416µs ± 0%426µs ± 0%+2.47%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4419µs ± 0%436µs ± 0%+4.12%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4617µs ± 0%658µs ± 0%+6.61%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4600µs ± 0%644µs ± 0%+7.33%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4629µs ± 0%642µs ± 0%+1.93%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4260µs ± 0%265µs ± 0%+2.07%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4262µs ± 0%275µs ± 0%+5.05%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4264µs ± 0%270µs ± 0%+2.35%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4384µs ± 0%396µs ± 0%+3.08%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.30ms ± 0%1.31ms ± 0%+0.82%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4118µs ± 0%125µs ± 0%+5.84%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4125µs ± 0%131µs ± 0%+5.34%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4133µs ± 0%144µs ± 0%+8.81%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4151µs ± 0%155µs ± 0%+2.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4192µs ± 0%195µs ± 0%+1.11%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-414.2µs ± 0%14.4µs ± 0%+1.69%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-414.4µs ± 0%14.7µs ± 0%+1.83%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-416.8µs ± 0%16.9µs ± 0%+0.45%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4131µs ± 0%137µs ± 0%+4.79%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4136µs ± 0%139µs ± 0%+2.52%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4142µs ± 0%149µs ± 0%+4.41%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4157µs ± 0%161µs ± 0%+2.43%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-444.7µs ± 0%58.1µs ± 0%+29.89%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-444.1µs ± 0%48.4µs ± 0%+9.58%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-445.6µs ± 0%48.0µs ± 0%+5.12%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-464.3µs ± 0%65.4µs ± 0%+1.65%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4325µs ± 0%365µs ± 0%+12.26%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4334µs ± 0%344µs ± 0%+3.04%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4348µs ± 0%352µs ± 0%+1.16%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4377µs ± 0%405µs ± 0%+7.22%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4467µs ± 0%508µs ± 0%+8.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-443.2µs ± 0%44.8µs ± 0%+3.71%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-443.0µs ± 0%47.1µs ± 0%+9.62%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-445.0µs ± 0%56.0µs ± 0%+24.61%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-451.1µs ± 0%54.6µs ± 0%+6.89%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-463.4µs ± 0%68.3µs ± 0%+7.81%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4328µs ± 0%348µs ± 0%+5.96%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4342µs ± 0%354µs ± 0%+3.41%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4362µs ± 0%366µs ± 0%+1.10%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4391µs ± 0%398µs ± 0%+1.59%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4476µs ± 0%484µs ± 0%+1.65%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4114µs ± 0%118µs ± 0%+3.96%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4118µs ± 0%119µs ± 0%+0.14%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4120µs ± 0%121µs ± 0%+1.47%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4133µs ± 0%136µs ± 0%+2.24%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.14ms ± 0%1.17ms ± 0%+2.32%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.33ms ± 0%1.36ms ± 0%+2.07%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4106µs ± 0%109µs ± 0%+2.77%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4109µs ± 0%111µs ± 0%+2.48%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4110µs ± 0%115µs ± 0%+4.89%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4114µs ± 0%120µs ± 0%+5.59%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.09ms ± 0%1.09ms ± 0%+0.02%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.09ms ± 0%1.13ms ± 0%+3.34%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.13ms ± 0%1.13ms ± 0%+0.07%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.16ms ± 0%1.22ms ± 0%+5.51%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.28ms ± 0%1.31ms ± 0%+2.45%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-48.31µs ± 0%8.51µs ± 0%+2.29%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-410.7µs ± 0%11.3µs ± 0%+6.44%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-485.4µs ± 0%85.8µs ± 0%+0.53%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-483.7µs ± 0%89.8µs ± 0%+7.25%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-496.2µs ± 0%104.8µs ± 0%+8.94%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4111µs ± 0%134µs ± 0%+20.63%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4150µs ± 0%180µs ± 0%+19.69%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4115µs ± 0%126µs ± 0%+9.11%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4116µs ± 0%123µs ± 0%+6.32%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4120µs ± 0%122µs ± 0%+2.08%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4124µs ± 0%127µs ± 0%+2.87%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.18ms ± 0%1.19ms ± 0%+0.99%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.16ms ± 0%1.21ms ± 0%+4.34%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.19ms ± 0%1.19ms ± 0%+0.01%(p=1.000 n=1+1)
 
✨ See Unchanged Results...
time/opdelta
 
🐋 See Full Results...
develop.txtcurrent.txt
time/opdelta
pkg:github.com/sourcenetwork/defradb/bench/collection goos:linux goarch:amd64
_Collection_UserSimple_CreateMany_Sync_0_10-410.1ms ± 0%10.3ms ± 0%+1.91%(p=1.000 n=1+1)
_Collection_UserSimple_CreateMany_Sync_0_100-4208ms ± 0%217ms ± 0%+4.29%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-49.27ms ± 0%9.71ms ± 0%+4.75%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-493.8ms ± 0%104.5ms ± 0%+11.41%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-4963ms ± 0%1030ms ± 0%+6.94%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-441.9ms ± 0%45.7ms ± 0%+9.15%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4415ms ± 0%448ms ± 0%+7.92%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.31s ± 0%4.64s ± 0%+7.60%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4317µs ± 0%336µs ± 0%+6.06%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.40ms ± 0%3.48ms ± 0%+2.45%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-437.0ms ± 0%38.1ms ± 0%+2.83%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4340µs ± 0%333µs ± 0%−1.99%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.55ms ± 0%3.96ms ± 0%+11.48%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4238µs ± 0%307µs ± 0%+28.92%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.71ms ± 0%2.37ms ± 0%+38.53%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-422.4ms ± 0%25.7ms ± 0%+14.57%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4249µs ± 0%316µs ± 0%+26.92%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.81ms ± 0%2.44ms ± 0%+35.08%(p=1.000 n=1+1)
pkg:github.com/sourcenetwork/defradb/bench/query/simple goos:linux goarch:amd64
_Query_UserSimple_Query_Sync_10-4327µs ± 0%372µs ± 0%+13.60%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.10ms ± 0%1.21ms ± 0%+9.55%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%9.31ms ± 0%−0.96%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4406µs ± 0%405µs ± 0%−0.09%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.21ms ± 0%1.22ms ± 0%+1.33%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-49.56ms ± 0%9.71ms ± 0%+1.58%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4367µs ± 0%372µs ± 0%+1.20%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4416µs ± 0%426µs ± 0%+2.47%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4419µs ± 0%436µs ± 0%+4.12%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4617µs ± 0%658µs ± 0%+6.61%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4600µs ± 0%644µs ± 0%+7.33%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4629µs ± 0%642µs ± 0%+1.93%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4260µs ± 0%265µs ± 0%+2.07%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4262µs ± 0%275µs ± 0%+5.05%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4264µs ± 0%270µs ± 0%+2.35%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4384µs ± 0%396µs ± 0%+3.08%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.30ms ± 0%1.31ms ± 0%+0.82%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-411.8ms ± 0%11.7ms ± 0%−0.91%(p=1.000 n=1+1)
pkg:github.com/sourcenetwork/defradb/bench/storage goos:linux goarch:amd64
_Storage_Simple_Read_Sync_1_10/ValueSize:0064-411.8µs ± 0%12.5µs ± 0%+6.27%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-412.8µs ± 0%12.7µs ± 0%−0.90%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-413.6µs ± 0%13.4µs ± 0%−1.08%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-415.1µs ± 0%15.1µs ± 0%−0.21%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-419.2µs ± 0%18.7µs ± 0%−2.56%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4118µs ± 0%125µs ± 0%+5.84%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4125µs ± 0%131µs ± 0%+5.34%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4133µs ± 0%144µs ± 0%+8.81%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4151µs ± 0%155µs ± 0%+2.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4192µs ± 0%195µs ± 0%+1.11%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-414.2µs ± 0%14.4µs ± 0%+1.69%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-414.4µs ± 0%14.7µs ± 0%+1.83%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-415.0µs ± 0%14.9µs ± 0%−0.59%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-416.8µs ± 0%16.9µs ± 0%+0.45%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-420.4µs ± 0%19.9µs ± 0%−2.74%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4131µs ± 0%137µs ± 0%+4.79%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4136µs ± 0%139µs ± 0%+2.52%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4142µs ± 0%149µs ± 0%+4.41%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4157µs ± 0%161µs ± 0%+2.43%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4196µs ± 0%194µs ± 0%−0.88%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-444.7µs ± 0%58.1µs ± 0%+29.89%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-444.1µs ± 0%48.4µs ± 0%+9.58%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-445.6µs ± 0%48.0µs ± 0%+5.12%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-453.0µs ± 0%52.7µs ± 0%−0.52%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-464.3µs ± 0%65.4µs ± 0%+1.65%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4325µs ± 0%365µs ± 0%+12.26%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4334µs ± 0%344µs ± 0%+3.04%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4348µs ± 0%352µs ± 0%+1.16%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4377µs ± 0%405µs ± 0%+7.22%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4467µs ± 0%508µs ± 0%+8.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-443.2µs ± 0%44.8µs ± 0%+3.71%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-443.0µs ± 0%47.1µs ± 0%+9.62%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-445.0µs ± 0%56.0µs ± 0%+24.61%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-451.1µs ± 0%54.6µs ± 0%+6.89%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-463.4µs ± 0%68.3µs ± 0%+7.81%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4328µs ± 0%348µs ± 0%+5.96%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4342µs ± 0%354µs ± 0%+3.41%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4362µs ± 0%366µs ± 0%+1.10%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4391µs ± 0%398µs ± 0%+1.59%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4476µs ± 0%484µs ± 0%+1.65%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4115µs ± 0%114µs ± 0%−1.46%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4114µs ± 0%118µs ± 0%+3.96%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4118µs ± 0%119µs ± 0%+0.14%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4120µs ± 0%121µs ± 0%+1.47%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4133µs ± 0%136µs ± 0%+2.24%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.14ms ± 0%1.14ms ± 0%−0.08%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.14ms ± 0%1.17ms ± 0%+2.32%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.16ms ± 0%1.15ms ± 0%−0.44%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.22ms ± 0%1.20ms ± 0%−1.67%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.33ms ± 0%1.36ms ± 0%+2.07%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4106µs ± 0%109µs ± 0%+2.77%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4109µs ± 0%111µs ± 0%+2.48%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4110µs ± 0%115µs ± 0%+4.89%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4114µs ± 0%120µs ± 0%+5.59%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4131µs ± 0%130µs ± 0%−1.30%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.09ms ± 0%1.09ms ± 0%+0.02%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.09ms ± 0%1.13ms ± 0%+3.34%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.13ms ± 0%1.13ms ± 0%+0.07%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.16ms ± 0%1.22ms ± 0%+5.51%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.28ms ± 0%1.31ms ± 0%+2.45%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-48.20µs ± 0%8.16µs ± 0%−0.54%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-48.31µs ± 0%8.51µs ± 0%+2.29%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-49.34µs ± 0%9.27µs ± 0%−0.74%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-410.7µs ± 0%11.3µs ± 0%+6.44%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-415.0µs ± 0%14.5µs ± 0%−3.50%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-485.4µs ± 0%85.8µs ± 0%+0.53%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-483.7µs ± 0%89.8µs ± 0%+7.25%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-496.2µs ± 0%104.8µs ± 0%+8.94%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4111µs ± 0%134µs ± 0%+20.63%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4150µs ± 0%180µs ± 0%+19.69%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4115µs ± 0%126µs ± 0%+9.11%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4116µs ± 0%123µs ± 0%+6.32%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4118µs ± 0%117µs ± 0%−0.94%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4120µs ± 0%122µs ± 0%+2.08%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4124µs ± 0%127µs ± 0%+2.87%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.19ms ± 0%1.18ms ± 0%−1.23%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.18ms ± 0%1.19ms ± 0%+0.99%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.16ms ± 0%1.21ms ± 0%+4.34%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.19ms ± 0%1.19ms ± 0%+0.01%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.26ms ± 0%1.25ms ± 0%−0.98%(p=1.000 n=1+1)
 

@shahzadlone shahzadlone mentioned this pull request Apr 8, 2022
Closed
@shahzadlone shahzadlone requested a review from jsimnz April 9, 2022 22:51
shahzadlone
shahzadlone commented Apr 9, 2022
View reviewed changes
db/tests/utils.go
@@ -552,11 +552,20 @@ func setupDatabaseUsingTargetBranch(
out, err := goTestCmd.Output()
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jsimnz

  • out is just an empty byte array ([]) and
  • err is chdir /tmp/defra/6f56272db758eb6b16addcdac1ae61f45d2430f1/code/db/tests/mutation/relation/delete: no such file or directory

where can I get the typed error code from?

@shahzadlone shahzadlone merged commit 41dbd5a into develop Apr 17, 2022
@shahzadlone shahzadlone deleted the lone/ci/change-detect-to-not-fail-on-new-test branch April 17, 2022 07:03
shahzadlone added a commit to shahzadlone/defradb that referenced this pull request Feb 23, 2024
@shahzadlone
ci: Fix change-detection to not fail when new tests are added. (sourc…
b0d1270 
…enetwork#333)

sourcenetwork#332
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AndrewSisley AndrewSisley AndrewSisley approved these changes

@jsimnz jsimnz Awaiting requested review from jsimnz

@orpheuslummis orpheuslummis Awaiting requested review from orpheuslummis

Assignees

@shahzadlone shahzadlone

Labels
None yet
Projects
None yet
Milestone
DefraDB v0.3
Development

Successfully merging this pull request may close these issues.

CI build fails as change detected if a new test is added.
3 participants
@shahzadlone @source-devs @AndrewSisley