Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: Move testing to top-level tests folder #446

Merged
merged 7 commits into from
May 20, 2022
Merged

chore: Move testing to top-level tests folder #446

merged 7 commits into from
May 20, 2022

Conversation

orpheuslummis
Copy link
Contributor

@orpheuslummis orpheuslummis commented May 16, 2022 •
edited
Loading

RELEVANT ISSUE(S)

Resolves #445

DESCRIPTION

  • New top-level folder testing
  • Puts bench and db/tests (renamed to db) in it
  • Changes locations of dependencies where necessary
  • Updates Makefile consequently

See issue for motivation.

HOW HAS THIS BEEN TESTED?

Made sure tests run by running make test and make test:bench.

CHECKLIST:

  • I have commented the code, particularly in hard-to-understand areas.
  • I have made corresponding changes to the repo-held documentation.
  • I have made sure that the PR title adheres to the conventional commit style (subset of the ones we use can be found under: tools/configs/chglog/config.yml

ENVIRONMENT / OS THIS WAS TESTED ON?

Please specify which of the following was this tested on (remove or add your own):

  • Arch Linux
  • Debian Linux
  • MacOS
  • Windows

@orpheuslummis orpheuslummis added the area/testing Related to any test or testing suite label May 16, 2022
@orpheuslummis orpheuslummis added this to the DefraDB v0.3 milestone May 16, 2022
@orpheuslummis orpheuslummis self-assigned this May 16, 2022
@jsimnz
Copy link
Member

jsimnz commented May 16, 2022

Should the bench folder be within the new testing folder? (My vote is no, but happy to hear from others)

@orpheuslummis
Copy link
Contributor Author

Should the bench folder be within the new testing folder? (My vote is no, but happy to hear from others)

Personally I saw it as a "subtype of integration testing", therefore belonging to the testing folder. We could imagine various kinds of benchmarks under that folder as well.

Any reason for it to be standalone?

@jsimnz
Copy link
Member

jsimnz commented May 16, 2022

Should the bench folder be within the new testing folder? (My vote is no, but happy to hear from others)

Personally I saw it as a "subtype of integration testing", therefore belonging to the testing folder. We could imagine various kinds of benchmarks under that folder as well.

Any reason for it to be standalone?

I saw conversely, where bench is explicitly separate from (integration) tests. Since they test actually rather little, and only do some minor sanity checks.

I agree there may be other kinds of benchmarks, but they can all live under bench instead of testing/bench.

@orpheuslummis
Copy link
Contributor Author

Either way is fine.
I do have a small preference for gathering it all under testing, conceptually thinking here of benchmarking as a type of testing (performance testing).
This PR can sit a little bit to see if anyone has a preference / arguments.

@source-devs
Copy link

Benchmark Results

Summary

  • 0 Benchmarks successfully compared.
  • 0 Benchmarks were ✅ Better.
  • 0 Benchmarks were ❌ Worse .
  • 0 Benchmarks were ✨ Unchanged.
✅ See Better Results...
time/opdelta
 
❌ See Worse Results...
time/opdelta
 
✨ See Unchanged Results...
time/opdelta
 
🐋 See Full Results...

@orpheuslummis
Copy link
Contributor Author

This broke the integration with the bot. Looking into it
@shahzadlone

@shahzadlone shahzadlone mentioned this pull request May 17, 2022
Closed
1 task
shahzadlone
shahzadlone previously requested changes May 17, 2022
View reviewed changes
Copy link
Member

@shahzadlone shahzadlone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Appreciate this re-structuring work for moving tests in one place @orpheuslummis, I have the following feedback:

  • suggestion: Rename of the PR to something like: chore: Move testing to the top-level ./tests folder (mainly only concerned about the usage of the word Locating.
  • todo: You missed updating the .gitignore file where we ignore these: bench/*.log bench/*.svg (check the commit below)

Orpheus: This broke the integration with the bot. Looking into it

I have fixed the issue of your branch in another branch that I branched off of your branch : lone/chore/integration-tests-location, more notably just the last commit: 1ea24ed
I tested it by opening this dummy PR: #453 and it works.

The problem was that when you run go benchmarks it outputs the full path and groups your bench outputs related to the full path of the package. I have added a step where we change it to just the package name rather than full location + package name. This should also ensure if we move things around in the future that we won't break it again as the benchstat expects matching package names in the stored artifact report (different path on develop) and the new report (generated in the new PR).

You can just rebase the branch or just cherry pick that commit and it should do the .gitignore suggestion and fix the broken comparison bot issue (or do it manually, whichever one you prefer).

testing/db/README.md Outdated Show resolved Hide resolved
@orpheuslummis
Copy link
Contributor Author

Thanks @shahzadlone !!

@orpheuslummis orpheuslummis changed the title chore: Locating integration tests in top-level folder chore: Move testing to top-level tests folder May 17, 2022
@orpheuslummis
Copy link
Contributor Author

Excuse my editor's auto-formatting of YAML files

@source-devs
Copy link

Benchmark Results

Summary

  • 113 Benchmarks successfully compared.
  • 3 Benchmarks were ✅ Better.
  • 110 Benchmarks were ❌ Worse .
  • 0 Benchmarks were ✨ Unchanged.
✅ See Better Results...
time/opdelta
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4153µs ± 0%139µs ± 0%−8.84%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-414.4µs ± 0%14.3µs ± 0%−0.67%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4195µs ± 0%180µs ± 0%−7.62%(p=1.000 n=1+1)
 
❌ See Worse Results...
time/opdelta
_Collection_UserSimple_CreateMany_Sync_0_100-4283ms ± 0%415ms ± 0%+46.35%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-413.6ms ± 0%19.7ms ± 0%+44.80%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-4113ms ± 0%157ms ± 0%+39.03%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-41.21s ± 0%1.53s ± 0%+26.19%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-445.2ms ± 0%60.6ms ± 0%+34.16%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4447ms ± 0%511ms ± 0%+14.27%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.55s ± 0%5.08s ± 0%+11.62%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4362µs ± 0%412µs ± 0%+13.75%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.88ms ± 0%4.45ms ± 0%+14.73%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-438.7ms ± 0%54.3ms ± 0%+40.07%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4368µs ± 0%473µs ± 0%+28.41%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.92ms ± 0%5.77ms ± 0%+47.15%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4251µs ± 0%546µs ± 0%+117.87%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.83ms ± 0%2.78ms ± 0%+52.41%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-423.4ms ± 0%27.5ms ± 0%+17.43%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4270µs ± 0%308µs ± 0%+13.91%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.83ms ± 0%2.89ms ± 0%+57.52%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.21ms ± 0%1.63ms ± 0%+34.22%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%12.13ms ± 0%+29.05%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4431µs ± 0%731µs ± 0%+69.47%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.25ms ± 0%2.47ms ± 0%+97.54%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-410.2ms ± 0%13.4ms ± 0%+31.06%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4408µs ± 0%624µs ± 0%+52.88%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4435µs ± 0%742µs ± 0%+70.54%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4427µs ± 0%582µs ± 0%+36.38%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4653µs ± 0%1022µs ± 0%+56.57%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4628µs ± 0%862µs ± 0%+37.27%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4640µs ± 0%808µs ± 0%+26.27%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4281µs ± 0%364µs ± 0%+29.26%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4285µs ± 0%383µs ± 0%+34.33%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4271µs ± 0%308µs ± 0%+13.57%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4412µs ± 0%597µs ± 0%+44.97%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.46ms ± 0%1.67ms ± 0%+14.39%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-412.0ms ± 0%15.6ms ± 0%+30.59%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-414.9µs ± 0%16.0µs ± 0%+7.49%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-415.8µs ± 0%23.1µs ± 0%+46.47%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-417.7µs ± 0%23.5µs ± 0%+32.66%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-423.3µs ± 0%28.3µs ± 0%+21.37%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4146µs ± 0%160µs ± 0%+9.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4158µs ± 0%175µs ± 0%+10.65%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4155µs ± 0%217µs ± 0%+40.05%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4172µs ± 0%215µs ± 0%+25.04%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4203µs ± 0%246µs ± 0%+20.90%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-415.4µs ± 0%23.2µs ± 0%+50.47%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-415.4µs ± 0%21.4µs ± 0%+38.51%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-417.1µs ± 0%22.2µs ± 0%+29.75%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-420.7µs ± 0%24.6µs ± 0%+18.58%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-424.1µs ± 0%32.0µs ± 0%+32.91%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4147µs ± 0%186µs ± 0%+26.80%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4144µs ± 0%226µs ± 0%+57.51%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4154µs ± 0%204µs ± 0%+32.38%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4164µs ± 0%293µs ± 0%+78.71%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4206µs ± 0%342µs ± 0%+66.26%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-451.1µs ± 0%92.0µs ± 0%+80.02%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-452.8µs ± 0%80.5µs ± 0%+52.32%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-452.2µs ± 0%73.9µs ± 0%+41.76%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-455.2µs ± 0%73.9µs ± 0%+33.80%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-467.2µs ± 0%78.7µs ± 0%+17.21%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4376µs ± 0%524µs ± 0%+39.52%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4392µs ± 0%535µs ± 0%+36.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4378µs ± 0%507µs ± 0%+34.14%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4461µs ± 0%564µs ± 0%+22.46%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4492µs ± 0%804µs ± 0%+63.38%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-453.5µs ± 0%65.0µs ± 0%+21.54%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-462.8µs ± 0%73.2µs ± 0%+16.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-455.8µs ± 0%71.5µs ± 0%+28.11%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-471.9µs ± 0%102.2µs ± 0%+42.21%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-480.9µs ± 0%87.2µs ± 0%+7.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4396µs ± 0%471µs ± 0%+19.07%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4412µs ± 0%452µs ± 0%+9.70%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4392µs ± 0%544µs ± 0%+38.83%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4446µs ± 0%482µs ± 0%+8.02%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4517µs ± 0%705µs ± 0%+36.28%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4122µs ± 0%143µs ± 0%+17.07%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4126µs ± 0%161µs ± 0%+27.67%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4126µs ± 0%164µs ± 0%+30.27%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4135µs ± 0%170µs ± 0%+26.21%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4148µs ± 0%217µs ± 0%+46.65%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.17ms ± 0%1.81ms ± 0%+54.61%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.27ms ± 0%1.83ms ± 0%+43.35%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.42ms ± 0%2.09ms ± 0%+46.94%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.44ms ± 0%2.16ms ± 0%+49.91%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.51ms ± 0%1.85ms ± 0%+22.19%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4139µs ± 0%148µs ± 0%+6.64%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4137µs ± 0%184µs ± 0%+33.93%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4153µs ± 0%180µs ± 0%+17.56%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4181µs ± 0%203µs ± 0%+12.13%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.25ms ± 0%1.49ms ± 0%+19.38%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.34ms ± 0%1.70ms ± 0%+26.41%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.27ms ± 0%1.31ms ± 0%+2.67%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.29ms ± 0%1.78ms ± 0%+38.37%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.63ms ± 0%1.90ms ± 0%+16.10%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-49.54µs ± 0%12.90µs ± 0%+35.19%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-49.79µs ± 0%12.07µs ± 0%+23.25%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-412.7µs ± 0%16.2µs ± 0%+27.31%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-416.3µs ± 0%21.9µs ± 0%+34.13%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-494.7µs ± 0%113.7µs ± 0%+19.97%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-493.8µs ± 0%108.3µs ± 0%+15.44%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-4109µs ± 0%116µs ± 0%+6.62%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4143µs ± 0%166µs ± 0%+16.04%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4127µs ± 0%139µs ± 0%+9.20%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4126µs ± 0%151µs ± 0%+19.54%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4133µs ± 0%143µs ± 0%+7.25%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4132µs ± 0%139µs ± 0%+5.17%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4142µs ± 0%151µs ± 0%+6.71%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.25ms ± 0%1.31ms ± 0%+4.72%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.16ms ± 0%1.73ms ± 0%+48.77%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.28ms ± 0%1.52ms ± 0%+18.81%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.29ms ± 0%1.54ms ± 0%+18.93%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.35ms ± 0%1.50ms ± 0%+11.26%(p=1.000 n=1+1)
 
✨ See Unchanged Results...
time/opdelta
 
🐋 See Full Results...
develop.txtcurrent.txt
time/opdelta
pkg:collection goos:linux goarch:amd64
_Collection_UserSimple_CreateMany_Sync_0_10-410.5ms ± 0%14.1ms ± 0%+34.14%(p=1.000 n=1+1)
_Collection_UserSimple_CreateMany_Sync_0_100-4283ms ± 0%415ms ± 0%+46.35%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-413.6ms ± 0%19.7ms ± 0%+44.80%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-4113ms ± 0%157ms ± 0%+39.03%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-41.21s ± 0%1.53s ± 0%+26.19%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-445.2ms ± 0%60.6ms ± 0%+34.16%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4447ms ± 0%511ms ± 0%+14.27%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.55s ± 0%5.08s ± 0%+11.62%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4362µs ± 0%412µs ± 0%+13.75%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.88ms ± 0%4.45ms ± 0%+14.73%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-438.7ms ± 0%54.3ms ± 0%+40.07%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4368µs ± 0%473µs ± 0%+28.41%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.92ms ± 0%5.77ms ± 0%+47.15%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4251µs ± 0%546µs ± 0%+117.87%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.83ms ± 0%2.78ms ± 0%+52.41%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-423.4ms ± 0%27.5ms ± 0%+17.43%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4270µs ± 0%308µs ± 0%+13.91%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.83ms ± 0%2.89ms ± 0%+57.52%(p=1.000 n=1+1)
pkg:query/simple goos:linux goarch:amd64
_Query_UserSimple_Query_Sync_10-4383µs ± 0%596µs ± 0%+55.81%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.21ms ± 0%1.63ms ± 0%+34.22%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%12.13ms ± 0%+29.05%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4431µs ± 0%731µs ± 0%+69.47%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.25ms ± 0%2.47ms ± 0%+97.54%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-410.2ms ± 0%13.4ms ± 0%+31.06%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4408µs ± 0%624µs ± 0%+52.88%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4435µs ± 0%742µs ± 0%+70.54%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4427µs ± 0%582µs ± 0%+36.38%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4653µs ± 0%1022µs ± 0%+56.57%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4628µs ± 0%862µs ± 0%+37.27%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4640µs ± 0%808µs ± 0%+26.27%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4281µs ± 0%364µs ± 0%+29.26%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4285µs ± 0%383µs ± 0%+34.33%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4271µs ± 0%308µs ± 0%+13.57%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4412µs ± 0%597µs ± 0%+44.97%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.46ms ± 0%1.67ms ± 0%+14.39%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-412.0ms ± 0%15.6ms ± 0%+30.59%(p=1.000 n=1+1)
pkg:storage goos:linux goarch:amd64
_Storage_Simple_Read_Sync_1_10/ValueSize:0064-414.3µs ± 0%17.0µs ± 0%+19.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-414.9µs ± 0%16.0µs ± 0%+7.49%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-415.8µs ± 0%23.1µs ± 0%+46.47%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-417.7µs ± 0%23.5µs ± 0%+32.66%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-423.3µs ± 0%28.3µs ± 0%+21.37%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4146µs ± 0%160µs ± 0%+9.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4158µs ± 0%175µs ± 0%+10.65%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4155µs ± 0%217µs ± 0%+40.05%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4172µs ± 0%215µs ± 0%+25.04%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4203µs ± 0%246µs ± 0%+20.90%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-415.4µs ± 0%23.2µs ± 0%+50.47%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-415.4µs ± 0%21.4µs ± 0%+38.51%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-417.1µs ± 0%22.2µs ± 0%+29.75%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-420.7µs ± 0%24.6µs ± 0%+18.58%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-424.1µs ± 0%32.0µs ± 0%+32.91%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4147µs ± 0%186µs ± 0%+26.80%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4144µs ± 0%226µs ± 0%+57.51%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4154µs ± 0%204µs ± 0%+32.38%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4164µs ± 0%293µs ± 0%+78.71%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4206µs ± 0%342µs ± 0%+66.26%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-451.1µs ± 0%92.0µs ± 0%+80.02%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-452.8µs ± 0%80.5µs ± 0%+52.32%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-452.2µs ± 0%73.9µs ± 0%+41.76%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-455.2µs ± 0%73.9µs ± 0%+33.80%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-467.2µs ± 0%78.7µs ± 0%+17.21%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4376µs ± 0%524µs ± 0%+39.52%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4392µs ± 0%535µs ± 0%+36.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4378µs ± 0%507µs ± 0%+34.14%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4461µs ± 0%564µs ± 0%+22.46%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4492µs ± 0%804µs ± 0%+63.38%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-453.5µs ± 0%65.0µs ± 0%+21.54%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-462.8µs ± 0%73.2µs ± 0%+16.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-455.8µs ± 0%71.5µs ± 0%+28.11%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-471.9µs ± 0%102.2µs ± 0%+42.21%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-480.9µs ± 0%87.2µs ± 0%+7.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4396µs ± 0%471µs ± 0%+19.07%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4412µs ± 0%452µs ± 0%+9.70%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4392µs ± 0%544µs ± 0%+38.83%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4446µs ± 0%482µs ± 0%+8.02%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4517µs ± 0%705µs ± 0%+36.28%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4122µs ± 0%143µs ± 0%+17.07%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4126µs ± 0%161µs ± 0%+27.67%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4126µs ± 0%164µs ± 0%+30.27%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4135µs ± 0%170µs ± 0%+26.21%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4148µs ± 0%217µs ± 0%+46.65%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.17ms ± 0%1.81ms ± 0%+54.61%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.27ms ± 0%1.83ms ± 0%+43.35%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.42ms ± 0%2.09ms ± 0%+46.94%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.44ms ± 0%2.16ms ± 0%+49.91%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.51ms ± 0%1.85ms ± 0%+22.19%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4153µs ± 0%139µs ± 0%−8.84%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4139µs ± 0%148µs ± 0%+6.64%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4137µs ± 0%184µs ± 0%+33.93%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4153µs ± 0%180µs ± 0%+17.56%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4181µs ± 0%203µs ± 0%+12.13%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.25ms ± 0%1.49ms ± 0%+19.38%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.34ms ± 0%1.70ms ± 0%+26.41%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.27ms ± 0%1.31ms ± 0%+2.67%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.29ms ± 0%1.78ms ± 0%+38.37%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.63ms ± 0%1.90ms ± 0%+16.10%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-49.54µs ± 0%12.90µs ± 0%+35.19%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-49.79µs ± 0%12.07µs ± 0%+23.25%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-414.4µs ± 0%14.3µs ± 0%−0.67%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-412.7µs ± 0%16.2µs ± 0%+27.31%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-416.3µs ± 0%21.9µs ± 0%+34.13%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-494.7µs ± 0%113.7µs ± 0%+19.97%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-493.8µs ± 0%108.3µs ± 0%+15.44%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-4109µs ± 0%116µs ± 0%+6.62%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4143µs ± 0%166µs ± 0%+16.04%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4195µs ± 0%180µs ± 0%−7.62%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4127µs ± 0%139µs ± 0%+9.20%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4126µs ± 0%151µs ± 0%+19.54%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4133µs ± 0%143µs ± 0%+7.25%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4132µs ± 0%139µs ± 0%+5.17%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4142µs ± 0%151µs ± 0%+6.71%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.25ms ± 0%1.31ms ± 0%+4.72%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.16ms ± 0%1.73ms ± 0%+48.77%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.28ms ± 0%1.52ms ± 0%+18.81%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.29ms ± 0%1.54ms ± 0%+18.93%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.35ms ± 0%1.50ms ± 0%+11.26%(p=1.000 n=1+1)
 

@source-devs
Copy link

Benchmark Results

Summary

  • 113 Benchmarks successfully compared.
  • 53 Benchmarks were ✅ Better.
  • 60 Benchmarks were ❌ Worse .
  • 0 Benchmarks were ✨ Unchanged.
✅ See Better Results...
time/opdelta
_Collection_UserSimple_CreateMany_Sync_0_100-4283ms ± 0%235ms ± 0%−17.03%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-413.6ms ± 0%10.6ms ± 0%−21.68%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-4113ms ± 0%101ms ± 0%−10.40%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-41.21s ± 0%1.07s ± 0%−11.72%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4362µs ± 0%352µs ± 0%−2.70%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4368µs ± 0%366µs ± 0%−0.62%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.92ms ± 0%3.78ms ± 0%−3.68%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4251µs ± 0%245µs ± 0%−2.25%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4270µs ± 0%262µs ± 0%−2.92%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.83ms ± 0%1.83ms ± 0%−0.49%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-414.9µs ± 0%14.2µs ± 0%−5.04%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-417.7µs ± 0%16.3µs ± 0%−7.96%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-423.3µs ± 0%20.3µs ± 0%−13.01%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4146µs ± 0%132µs ± 0%−9.75%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4158µs ± 0%134µs ± 0%−15.44%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4155µs ± 0%150µs ± 0%−3.37%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4172µs ± 0%163µs ± 0%−5.04%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-417.1µs ± 0%16.3µs ± 0%−4.68%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-420.7µs ± 0%18.2µs ± 0%−12.07%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-424.1µs ± 0%23.3µs ± 0%−3.16%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4392µs ± 0%380µs ± 0%−3.26%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4461µs ± 0%426µs ± 0%−7.44%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-462.8µs ± 0%53.7µs ± 0%−14.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-455.8µs ± 0%53.8µs ± 0%−3.58%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-471.9µs ± 0%58.8µs ± 0%−18.19%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-480.9µs ± 0%72.9µs ± 0%−9.87%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4446µs ± 0%426µs ± 0%−4.33%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4517µs ± 0%511µs ± 0%−1.21%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4122µs ± 0%120µs ± 0%−2.12%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4135µs ± 0%129µs ± 0%−4.42%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.27ms ± 0%1.26ms ± 0%−1.39%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.42ms ± 0%1.34ms ± 0%−6.11%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.44ms ± 0%1.38ms ± 0%−4.27%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.51ms ± 0%1.46ms ± 0%−3.40%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4153µs ± 0%119µs ± 0%−22.16%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4139µs ± 0%125µs ± 0%−9.90%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4137µs ± 0%119µs ± 0%−13.37%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4153µs ± 0%143µs ± 0%−6.50%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4181µs ± 0%140µs ± 0%−22.88%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.25ms ± 0%1.16ms ± 0%−7.18%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.34ms ± 0%1.17ms ± 0%−13.02%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.27ms ± 0%1.17ms ± 0%−7.69%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.29ms ± 0%1.27ms ± 0%−1.59%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.63ms ± 0%1.52ms ± 0%−6.98%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-49.54µs ± 0%8.76µs ± 0%−8.18%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-414.4µs ± 0%10.9µs ± 0%−24.42%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-412.7µs ± 0%11.5µs ± 0%−9.74%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-4109µs ± 0%102µs ± 0%−6.53%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4143µs ± 0%139µs ± 0%−2.31%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4195µs ± 0%190µs ± 0%−2.83%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4133µs ± 0%129µs ± 0%−2.94%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4132µs ± 0%132µs ± 0%−0.34%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.28ms ± 0%1.26ms ± 0%−1.40%(p=1.000 n=1+1)
 
❌ See Worse Results...
time/opdelta
_Collection_UserSimple_Create_Async_0_100-445.2ms ± 0%45.7ms ± 0%+1.27%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4447ms ± 0%451ms ± 0%+0.99%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.55s ± 0%4.76s ± 0%+4.61%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.88ms ± 0%4.13ms ± 0%+6.39%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-438.7ms ± 0%39.1ms ± 0%+0.99%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.83ms ± 0%1.87ms ± 0%+2.16%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-423.4ms ± 0%25.1ms ± 0%+7.11%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.21ms ± 0%1.24ms ± 0%+2.28%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%10.08ms ± 0%+7.32%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4431µs ± 0%467µs ± 0%+8.26%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.25ms ± 0%1.49ms ± 0%+18.77%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-410.2ms ± 0%10.6ms ± 0%+3.87%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4408µs ± 0%410µs ± 0%+0.55%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4435µs ± 0%486µs ± 0%+11.71%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4427µs ± 0%446µs ± 0%+4.50%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4653µs ± 0%738µs ± 0%+13.14%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4628µs ± 0%754µs ± 0%+20.18%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4640µs ± 0%672µs ± 0%+4.94%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4281µs ± 0%327µs ± 0%+16.17%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4285µs ± 0%311µs ± 0%+8.93%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4271µs ± 0%291µs ± 0%+7.49%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4412µs ± 0%457µs ± 0%+10.89%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.46ms ± 0%1.52ms ± 0%+4.34%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-412.0ms ± 0%12.6ms ± 0%+5.27%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-415.8µs ± 0%15.9µs ± 0%+0.48%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4203µs ± 0%203µs ± 0%+0.02%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-415.4µs ± 0%15.9µs ± 0%+2.85%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-415.4µs ± 0%16.1µs ± 0%+4.41%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4147µs ± 0%155µs ± 0%+5.61%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4144µs ± 0%154µs ± 0%+6.96%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4154µs ± 0%169µs ± 0%+9.77%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4164µs ± 0%182µs ± 0%+10.74%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4206µs ± 0%227µs ± 0%+10.41%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-451.1µs ± 0%54.6µs ± 0%+6.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-452.8µs ± 0%62.1µs ± 0%+17.56%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-452.2µs ± 0%60.5µs ± 0%+15.93%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-455.2µs ± 0%66.4µs ± 0%+20.11%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-467.2µs ± 0%75.2µs ± 0%+12.01%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4376µs ± 0%415µs ± 0%+10.46%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4378µs ± 0%389µs ± 0%+2.95%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4492µs ± 0%523µs ± 0%+6.30%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-453.5µs ± 0%57.1µs ± 0%+6.73%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4396µs ± 0%433µs ± 0%+9.29%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4412µs ± 0%426µs ± 0%+3.54%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4392µs ± 0%394µs ± 0%+0.55%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4126µs ± 0%132µs ± 0%+4.73%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4126µs ± 0%129µs ± 0%+2.92%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4148µs ± 0%152µs ± 0%+2.66%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.17ms ± 0%1.27ms ± 0%+7.91%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-49.79µs ± 0%10.03µs ± 0%+2.45%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-416.3µs ± 0%17.3µs ± 0%+5.91%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-494.7µs ± 0%108.4µs ± 0%+14.44%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-493.8µs ± 0%99.3µs ± 0%+5.85%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4127µs ± 0%136µs ± 0%+7.05%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4126µs ± 0%132µs ± 0%+4.27%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4142µs ± 0%149µs ± 0%+5.27%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.25ms ± 0%1.40ms ± 0%+11.63%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.16ms ± 0%1.28ms ± 0%+9.89%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.29ms ± 0%1.32ms ± 0%+2.15%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.35ms ± 0%1.42ms ± 0%+5.40%(p=1.000 n=1+1)
 
✨ See Unchanged Results...
time/opdelta
 
🐋 See Full Results...
develop.txtcurrent.txt
time/opdelta
pkg:collection goos:linux goarch:amd64
_Collection_UserSimple_CreateMany_Sync_0_10-410.5ms ± 0%11.1ms ± 0%+5.29%(p=1.000 n=1+1)
_Collection_UserSimple_CreateMany_Sync_0_100-4283ms ± 0%235ms ± 0%−17.03%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-413.6ms ± 0%10.6ms ± 0%−21.68%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-4113ms ± 0%101ms ± 0%−10.40%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-41.21s ± 0%1.07s ± 0%−11.72%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-445.2ms ± 0%45.7ms ± 0%+1.27%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4447ms ± 0%451ms ± 0%+0.99%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.55s ± 0%4.76s ± 0%+4.61%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4362µs ± 0%352µs ± 0%−2.70%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.88ms ± 0%4.13ms ± 0%+6.39%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-438.7ms ± 0%39.1ms ± 0%+0.99%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4368µs ± 0%366µs ± 0%−0.62%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.92ms ± 0%3.78ms ± 0%−3.68%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4251µs ± 0%245µs ± 0%−2.25%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.83ms ± 0%1.87ms ± 0%+2.16%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-423.4ms ± 0%25.1ms ± 0%+7.11%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4270µs ± 0%262µs ± 0%−2.92%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.83ms ± 0%1.83ms ± 0%−0.49%(p=1.000 n=1+1)
pkg:query/simple goos:linux goarch:amd64
_Query_UserSimple_Query_Sync_10-4383µs ± 0%359µs ± 0%−6.23%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.21ms ± 0%1.24ms ± 0%+2.28%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%10.08ms ± 0%+7.32%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4431µs ± 0%467µs ± 0%+8.26%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.25ms ± 0%1.49ms ± 0%+18.77%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-410.2ms ± 0%10.6ms ± 0%+3.87%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4408µs ± 0%410µs ± 0%+0.55%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4435µs ± 0%486µs ± 0%+11.71%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4427µs ± 0%446µs ± 0%+4.50%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4653µs ± 0%738µs ± 0%+13.14%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4628µs ± 0%754µs ± 0%+20.18%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4640µs ± 0%672µs ± 0%+4.94%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4281µs ± 0%327µs ± 0%+16.17%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4285µs ± 0%311µs ± 0%+8.93%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4271µs ± 0%291µs ± 0%+7.49%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4412µs ± 0%457µs ± 0%+10.89%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.46ms ± 0%1.52ms ± 0%+4.34%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-412.0ms ± 0%12.6ms ± 0%+5.27%(p=1.000 n=1+1)
pkg:storage goos:linux goarch:amd64
_Storage_Simple_Read_Sync_1_10/ValueSize:0064-414.3µs ± 0%13.9µs ± 0%−2.73%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-414.9µs ± 0%14.2µs ± 0%−5.04%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-415.8µs ± 0%15.9µs ± 0%+0.48%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-417.7µs ± 0%16.3µs ± 0%−7.96%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-423.3µs ± 0%20.3µs ± 0%−13.01%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4146µs ± 0%132µs ± 0%−9.75%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4158µs ± 0%134µs ± 0%−15.44%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4155µs ± 0%150µs ± 0%−3.37%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4172µs ± 0%163µs ± 0%−5.04%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4203µs ± 0%203µs ± 0%+0.02%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-415.4µs ± 0%15.9µs ± 0%+2.85%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-415.4µs ± 0%16.1µs ± 0%+4.41%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-417.1µs ± 0%16.3µs ± 0%−4.68%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-420.7µs ± 0%18.2µs ± 0%−12.07%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-424.1µs ± 0%23.3µs ± 0%−3.16%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4147µs ± 0%155µs ± 0%+5.61%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4144µs ± 0%154µs ± 0%+6.96%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4154µs ± 0%169µs ± 0%+9.77%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4164µs ± 0%182µs ± 0%+10.74%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4206µs ± 0%227µs ± 0%+10.41%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-451.1µs ± 0%54.6µs ± 0%+6.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-452.8µs ± 0%62.1µs ± 0%+17.56%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-452.2µs ± 0%60.5µs ± 0%+15.93%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-455.2µs ± 0%66.4µs ± 0%+20.11%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-467.2µs ± 0%75.2µs ± 0%+12.01%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4376µs ± 0%415µs ± 0%+10.46%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4392µs ± 0%380µs ± 0%−3.26%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4378µs ± 0%389µs ± 0%+2.95%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4461µs ± 0%426µs ± 0%−7.44%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4492µs ± 0%523µs ± 0%+6.30%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-453.5µs ± 0%57.1µs ± 0%+6.73%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-462.8µs ± 0%53.7µs ± 0%−14.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-455.8µs ± 0%53.8µs ± 0%−3.58%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-471.9µs ± 0%58.8µs ± 0%−18.19%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-480.9µs ± 0%72.9µs ± 0%−9.87%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4396µs ± 0%433µs ± 0%+9.29%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4412µs ± 0%426µs ± 0%+3.54%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4392µs ± 0%394µs ± 0%+0.55%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4446µs ± 0%426µs ± 0%−4.33%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4517µs ± 0%511µs ± 0%−1.21%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4122µs ± 0%120µs ± 0%−2.12%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4126µs ± 0%132µs ± 0%+4.73%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4126µs ± 0%129µs ± 0%+2.92%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4135µs ± 0%129µs ± 0%−4.42%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4148µs ± 0%152µs ± 0%+2.66%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.17ms ± 0%1.27ms ± 0%+7.91%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.27ms ± 0%1.26ms ± 0%−1.39%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.42ms ± 0%1.34ms ± 0%−6.11%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.44ms ± 0%1.38ms ± 0%−4.27%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.51ms ± 0%1.46ms ± 0%−3.40%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4153µs ± 0%119µs ± 0%−22.16%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4139µs ± 0%125µs ± 0%−9.90%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4137µs ± 0%119µs ± 0%−13.37%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4153µs ± 0%143µs ± 0%−6.50%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4181µs ± 0%140µs ± 0%−22.88%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.25ms ± 0%1.16ms ± 0%−7.18%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.34ms ± 0%1.17ms ± 0%−13.02%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.27ms ± 0%1.17ms ± 0%−7.69%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.29ms ± 0%1.27ms ± 0%−1.59%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.63ms ± 0%1.52ms ± 0%−6.98%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-49.54µs ± 0%8.76µs ± 0%−8.18%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-49.79µs ± 0%10.03µs ± 0%+2.45%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-414.4µs ± 0%10.9µs ± 0%−24.42%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-412.7µs ± 0%11.5µs ± 0%−9.74%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-416.3µs ± 0%17.3µs ± 0%+5.91%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-494.7µs ± 0%108.4µs ± 0%+14.44%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-493.8µs ± 0%99.3µs ± 0%+5.85%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-4109µs ± 0%102µs ± 0%−6.53%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4143µs ± 0%139µs ± 0%−2.31%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4195µs ± 0%190µs ± 0%−2.83%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4127µs ± 0%136µs ± 0%+7.05%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4126µs ± 0%132µs ± 0%+4.27%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4133µs ± 0%129µs ± 0%−2.94%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4132µs ± 0%132µs ± 0%−0.34%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4142µs ± 0%149µs ± 0%+5.27%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.25ms ± 0%1.40ms ± 0%+11.63%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.16ms ± 0%1.28ms ± 0%+9.89%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.28ms ± 0%1.26ms ± 0%−1.40%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.29ms ± 0%1.32ms ± 0%+2.15%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.35ms ± 0%1.42ms ± 0%+5.40%(p=1.000 n=1+1)
 

@orpheuslummis orpheuslummis dismissed shahzadlone’s stale review May 17, 2022 16:33

Dismissing was the only way to "accept"

@source-devs
Copy link

Benchmark Results

Summary

  • 113 Benchmarks successfully compared.
  • 6 Benchmarks were ✅ Better.
  • 107 Benchmarks were ❌ Worse .
  • 0 Benchmarks were ✨ Unchanged.
✅ See Better Results...
time/opdelta
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4408µs ± 0%395µs ± 0%−3.30%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.46ms ± 0%1.38ms ± 0%−5.08%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-453.5µs ± 0%49.1µs ± 0%−8.09%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-462.8µs ± 0%48.6µs ± 0%−22.64%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-455.8µs ± 0%52.4µs ± 0%−6.07%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-471.9µs ± 0%58.4µs ± 0%−18.72%(p=1.000 n=1+1)
 
❌ See Worse Results...
time/opdelta
_Collection_UserSimple_CreateMany_Sync_0_100-4283ms ± 0%354ms ± 0%+24.82%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-413.6ms ± 0%18.8ms ± 0%+38.21%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-4113ms ± 0%209ms ± 0%+85.45%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-41.21s ± 0%1.69s ± 0%+39.21%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-445.2ms ± 0%57.2ms ± 0%+26.70%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4447ms ± 0%464ms ± 0%+3.80%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.55s ± 0%5.14s ± 0%+13.06%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4362µs ± 0%434µs ± 0%+19.87%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.88ms ± 0%5.22ms ± 0%+34.44%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-438.7ms ± 0%39.9ms ± 0%+2.90%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4368µs ± 0%379µs ± 0%+2.78%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.92ms ± 0%4.71ms ± 0%+20.20%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4251µs ± 0%333µs ± 0%+32.68%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.83ms ± 0%1.94ms ± 0%+5.98%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-423.4ms ± 0%25.5ms ± 0%+9.03%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4270µs ± 0%277µs ± 0%+2.60%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.83ms ± 0%1.87ms ± 0%+2.01%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.21ms ± 0%1.33ms ± 0%+9.96%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%10.26ms ± 0%+9.18%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4431µs ± 0%505µs ± 0%+17.09%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.25ms ± 0%1.39ms ± 0%+11.18%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-410.2ms ± 0%10.2ms ± 0%+0.04%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4435µs ± 0%536µs ± 0%+23.19%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4427µs ± 0%453µs ± 0%+5.97%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4653µs ± 0%774µs ± 0%+18.56%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4628µs ± 0%699µs ± 0%+11.28%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4640µs ± 0%760µs ± 0%+18.70%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4281µs ± 0%418µs ± 0%+48.66%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4285µs ± 0%398µs ± 0%+39.45%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4271µs ± 0%283µs ± 0%+4.46%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4412µs ± 0%416µs ± 0%+0.89%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-412.0ms ± 0%12.4ms ± 0%+4.07%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-414.9µs ± 0%16.0µs ± 0%+7.06%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-415.8µs ± 0%18.1µs ± 0%+14.72%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-417.7µs ± 0%24.5µs ± 0%+38.35%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-423.3µs ± 0%27.4µs ± 0%+17.73%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4146µs ± 0%170µs ± 0%+16.73%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4158µs ± 0%168µs ± 0%+6.14%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4155µs ± 0%211µs ± 0%+35.99%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4172µs ± 0%206µs ± 0%+19.62%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4203µs ± 0%309µs ± 0%+51.82%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-415.4µs ± 0%22.7µs ± 0%+47.28%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-415.4µs ± 0%21.2µs ± 0%+37.08%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-417.1µs ± 0%21.2µs ± 0%+24.28%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-420.7µs ± 0%26.9µs ± 0%+29.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-424.1µs ± 0%46.9µs ± 0%+94.87%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4147µs ± 0%148µs ± 0%+1.01%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4144µs ± 0%146µs ± 0%+1.42%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4154µs ± 0%155µs ± 0%+0.36%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4164µs ± 0%180µs ± 0%+9.48%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4206µs ± 0%230µs ± 0%+11.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-451.1µs ± 0%56.5µs ± 0%+10.62%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-452.8µs ± 0%54.3µs ± 0%+2.65%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-452.2µs ± 0%79.6µs ± 0%+52.63%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-455.2µs ± 0%71.6µs ± 0%+29.62%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-467.2µs ± 0%84.9µs ± 0%+26.36%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4376µs ± 0%464µs ± 0%+23.66%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4392µs ± 0%518µs ± 0%+31.92%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4378µs ± 0%524µs ± 0%+38.67%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4461µs ± 0%513µs ± 0%+11.30%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4492µs ± 0%637µs ± 0%+29.29%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-480.9µs ± 0%85.7µs ± 0%+5.95%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4396µs ± 0%429µs ± 0%+8.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4412µs ± 0%472µs ± 0%+14.69%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4392µs ± 0%528µs ± 0%+34.94%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4446µs ± 0%623µs ± 0%+39.77%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4517µs ± 0%663µs ± 0%+28.18%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4122µs ± 0%175µs ± 0%+43.18%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4126µs ± 0%204µs ± 0%+61.25%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4126µs ± 0%189µs ± 0%+50.38%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4135µs ± 0%170µs ± 0%+26.41%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4148µs ± 0%214µs ± 0%+44.79%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.17ms ± 0%1.88ms ± 0%+60.47%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.27ms ± 0%2.19ms ± 0%+71.58%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.42ms ± 0%1.95ms ± 0%+36.78%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.44ms ± 0%1.73ms ± 0%+20.23%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.51ms ± 0%2.13ms ± 0%+40.78%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4153µs ± 0%170µs ± 0%+11.02%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4139µs ± 0%168µs ± 0%+21.30%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4137µs ± 0%163µs ± 0%+19.06%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4153µs ± 0%187µs ± 0%+22.10%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4181µs ± 0%203µs ± 0%+11.99%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.25ms ± 0%1.96ms ± 0%+56.59%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.34ms ± 0%1.68ms ± 0%+24.88%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.27ms ± 0%1.43ms ± 0%+12.60%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.29ms ± 0%1.73ms ± 0%+34.27%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.63ms ± 0%2.22ms ± 0%+35.66%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-49.54µs ± 0%17.18µs ± 0%+80.00%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-49.79µs ± 0%10.74µs ± 0%+9.69%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-414.4µs ± 0%16.3µs ± 0%+13.06%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-412.7µs ± 0%19.4µs ± 0%+52.71%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-416.3µs ± 0%26.1µs ± 0%+60.01%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-494.7µs ± 0%136.3µs ± 0%+43.91%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-493.8µs ± 0%158.1µs ± 0%+68.56%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-4109µs ± 0%134µs ± 0%+22.79%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4143µs ± 0%209µs ± 0%+46.38%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4195µs ± 0%282µs ± 0%+44.73%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4127µs ± 0%179µs ± 0%+41.09%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4126µs ± 0%173µs ± 0%+37.00%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4133µs ± 0%175µs ± 0%+31.92%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4132µs ± 0%163µs ± 0%+23.10%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4142µs ± 0%183µs ± 0%+29.35%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.25ms ± 0%1.83ms ± 0%+46.11%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.16ms ± 0%1.74ms ± 0%+50.04%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.28ms ± 0%2.01ms ± 0%+57.78%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.29ms ± 0%1.69ms ± 0%+30.53%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.35ms ± 0%1.75ms ± 0%+29.73%(p=1.000 n=1+1)
 
✨ See Unchanged Results...
time/opdelta
 
🐋 See Full Results...
develop.txtcurrent.txt
time/opdelta
pkg:collection goos:linux goarch:amd64
_Collection_UserSimple_CreateMany_Sync_0_10-410.5ms ± 0%13.9ms ± 0%+31.74%(p=1.000 n=1+1)
_Collection_UserSimple_CreateMany_Sync_0_100-4283ms ± 0%354ms ± 0%+24.82%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_10-413.6ms ± 0%18.8ms ± 0%+38.21%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_100-4113ms ± 0%209ms ± 0%+85.45%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Sync_0_1000-41.21s ± 0%1.69s ± 0%+39.21%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_100-445.2ms ± 0%57.2ms ± 0%+26.70%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_1000-4447ms ± 0%464ms ± 0%+3.80%(p=1.000 n=1+1)
_Collection_UserSimple_Create_Async_0_10000-44.55s ± 0%5.14s ± 0%+13.06%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_10_10-4362µs ± 0%434µs ± 0%+19.87%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_100_100-43.88ms ± 0%5.22ms ± 0%+34.44%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_1000-438.7ms ± 0%39.9ms ± 0%+2.90%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_10-4368µs ± 0%379µs ± 0%+2.78%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Sync_1000_100-43.92ms ± 0%4.71ms ± 0%+20.20%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_10_10-4251µs ± 0%333µs ± 0%+32.68%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_100_100-41.83ms ± 0%1.94ms ± 0%+5.98%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_1000-423.4ms ± 0%25.5ms ± 0%+9.03%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_10-4270µs ± 0%277µs ± 0%+2.60%(p=1.000 n=1+1)
_Collection_UserSimple_Read_Async_1000_100-41.83ms ± 0%1.87ms ± 0%+2.01%(p=1.000 n=1+1)
pkg:query/simple goos:linux goarch:amd64
_Query_UserSimple_Query_Sync_10-4383µs ± 0%364µs ± 0%−4.96%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_100-41.21ms ± 0%1.33ms ± 0%+9.96%(p=1.000 n=1+1)
_Query_UserSimple_Query_Sync_1000-49.40ms ± 0%10.26ms ± 0%+9.18%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_10-4431µs ± 0%505µs ± 0%+17.09%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_100-41.25ms ± 0%1.39ms ± 0%+11.18%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithFilter_Sync_1000-410.2ms ± 0%10.2ms ± 0%+0.04%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_10-4408µs ± 0%395µs ± 0%−3.30%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_100-4435µs ± 0%536µs ± 0%+23.19%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithLimitOffset_Sync_1000-4427µs ± 0%453µs ± 0%+5.97%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_10-4653µs ± 0%774µs ± 0%+18.56%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_100-4628µs ± 0%699µs ± 0%+11.28%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithMultiLookup_Sync_1000-4640µs ± 0%760µs ± 0%+18.70%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_10-4281µs ± 0%418µs ± 0%+48.66%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_100-4285µs ± 0%398µs ± 0%+39.45%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSingleLookup_Sync_1000-4271µs ± 0%283µs ± 0%+4.46%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_10-4412µs ± 0%416µs ± 0%+0.89%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_100-41.46ms ± 0%1.38ms ± 0%−5.08%(p=1.000 n=1+1)
_Query_UserSimple_Query_WithSort_Sync_1000-412.0ms ± 0%12.4ms ± 0%+4.07%(p=1.000 n=1+1)
pkg:storage goos:linux goarch:amd64
_Storage_Simple_Read_Sync_1_10/ValueSize:0064-414.3µs ± 0%16.0µs ± 0%+11.97%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0128-414.9µs ± 0%16.0µs ± 0%+7.06%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0256-415.8µs ± 0%18.1µs ± 0%+14.72%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:0512-417.7µs ± 0%24.5µs ± 0%+38.35%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_10/ValueSize:1024-423.3µs ± 0%27.4µs ± 0%+17.73%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0064-4146µs ± 0%170µs ± 0%+16.73%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0128-4158µs ± 0%168µs ± 0%+6.14%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0256-4155µs ± 0%211µs ± 0%+35.99%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:0512-4172µs ± 0%206µs ± 0%+19.62%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_1_100/ValueSize:1024-4203µs ± 0%309µs ± 0%+51.82%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0064-415.4µs ± 0%22.7µs ± 0%+47.28%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0128-415.4µs ± 0%21.2µs ± 0%+37.08%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0256-417.1µs ± 0%21.2µs ± 0%+24.28%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:0512-420.7µs ± 0%26.9µs ± 0%+29.46%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_10/ValueSize:1024-424.1µs ± 0%46.9µs ± 0%+94.87%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0064-4147µs ± 0%148µs ± 0%+1.01%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0128-4144µs ± 0%146µs ± 0%+1.42%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0256-4154µs ± 0%155µs ± 0%+0.36%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:0512-4164µs ± 0%180µs ± 0%+9.48%(p=1.000 n=1+1)
_Storage_Simple_Read_Sync_100_100/ValueSize:1024-4206µs ± 0%230µs ± 0%+11.85%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0064-451.1µs ± 0%56.5µs ± 0%+10.62%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0128-452.8µs ± 0%54.3µs ± 0%+2.65%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0256-452.2µs ± 0%79.6µs ± 0%+52.63%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:0512-455.2µs ± 0%71.6µs ± 0%+29.62%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_10/ValueSize:1024-467.2µs ± 0%84.9µs ± 0%+26.36%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0064-4376µs ± 0%464µs ± 0%+23.66%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0128-4392µs ± 0%518µs ± 0%+31.92%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0256-4378µs ± 0%524µs ± 0%+38.67%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:0512-4461µs ± 0%513µs ± 0%+11.30%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_0_100/ValueSize:1024-4492µs ± 0%637µs ± 0%+29.29%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0064-453.5µs ± 0%49.1µs ± 0%−8.09%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0128-462.8µs ± 0%48.6µs ± 0%−22.64%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0256-455.8µs ± 0%52.4µs ± 0%−6.07%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:0512-471.9µs ± 0%58.4µs ± 0%−18.72%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_10/ValueSize:1024-480.9µs ± 0%85.7µs ± 0%+5.95%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0064-4396µs ± 0%429µs ± 0%+8.47%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0128-4412µs ± 0%472µs ± 0%+14.69%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0256-4392µs ± 0%528µs ± 0%+34.94%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:0512-4446µs ± 0%623µs ± 0%+39.77%(p=1.000 n=1+1)
_Storage_Simple_WriteMany_Sync_100_100/ValueSize:1024-4517µs ± 0%663µs ± 0%+28.18%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0064-4122µs ± 0%175µs ± 0%+43.18%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0128-4126µs ± 0%204µs ± 0%+61.25%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0256-4126µs ± 0%189µs ± 0%+50.38%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:0512-4135µs ± 0%170µs ± 0%+26.41%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_10/ValueSize:1024-4148µs ± 0%214µs ± 0%+44.79%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0064-41.17ms ± 0%1.88ms ± 0%+60.47%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0128-41.27ms ± 0%2.19ms ± 0%+71.58%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0256-41.42ms ± 0%1.95ms ± 0%+36.78%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:0512-41.44ms ± 0%1.73ms ± 0%+20.23%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_0_100/ValueSize:1024-41.51ms ± 0%2.13ms ± 0%+40.78%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0064-4153µs ± 0%170µs ± 0%+11.02%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0128-4139µs ± 0%168µs ± 0%+21.30%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0256-4137µs ± 0%163µs ± 0%+19.06%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:0512-4153µs ± 0%187µs ± 0%+22.10%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_10/ValueSize:1024-4181µs ± 0%203µs ± 0%+11.99%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0064-41.25ms ± 0%1.96ms ± 0%+56.59%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0128-41.34ms ± 0%1.68ms ± 0%+24.88%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0256-41.27ms ± 0%1.43ms ± 0%+12.60%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:0512-41.29ms ± 0%1.73ms ± 0%+34.27%(p=1.000 n=1+1)
_Storage_Simple_Write_Sync_100_100/ValueSize:1024-41.63ms ± 0%2.22ms ± 0%+35.66%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0064-49.54µs ± 0%17.18µs ± 0%+80.00%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0128-49.79µs ± 0%10.74µs ± 0%+9.69%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0256-414.4µs ± 0%16.3µs ± 0%+13.06%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:0512-412.7µs ± 0%19.4µs ± 0%+52.71%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_10_10/ValueSize:1024-416.3µs ± 0%26.1µs ± 0%+60.01%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0064-494.7µs ± 0%136.3µs ± 0%+43.91%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0128-493.8µs ± 0%158.1µs ± 0%+68.56%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0256-4109µs ± 0%134µs ± 0%+22.79%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:0512-4143µs ± 0%209µs ± 0%+46.38%(p=1.000 n=1+1)
_Storage_Simple_Txn_Read_Sync_100_100/ValueSize:1024-4195µs ± 0%282µs ± 0%+44.73%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0064-4127µs ± 0%179µs ± 0%+41.09%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0128-4126µs ± 0%173µs ± 0%+37.00%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0256-4133µs ± 0%175µs ± 0%+31.92%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:0512-4132µs ± 0%163µs ± 0%+23.10%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_10_1_10/ValueSize:1024-4142µs ± 0%183µs ± 0%+29.35%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0064-41.25ms ± 0%1.83ms ± 0%+46.11%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0128-41.16ms ± 0%1.74ms ± 0%+50.04%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0256-41.28ms ± 0%2.01ms ± 0%+57.78%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:0512-41.29ms ± 0%1.69ms ± 0%+30.53%(p=1.000 n=1+1)
_Storage_Simple_Txn_Iterator_Sync_100_1_100/ValueSize:1024-41.35ms ± 0%1.75ms ± 0%+29.73%(p=1.000 n=1+1)
 

fredcarle
fredcarle approved these changes May 19, 2022
View reviewed changes
Copy link
Collaborator

@fredcarle fredcarle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@orpheuslummis orpheuslummis merged commit fd76c5c into develop May 20, 2022
@orpheuslummis orpheuslummis deleted the orpheus/chore/integration-tests-location branch May 20, 2022 13:04
shahzadlone pushed a commit to shahzadlone/defradb that referenced this pull request Feb 23, 2024
@orpheuslummis
chore: Move testing to top-level tests folder (sourcenetwork#446)
3261e5b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@fredcarle fredcarle fredcarle approved these changes

@shahzadlone shahzadlone shahzadlone approved these changes

@jsimnz jsimnz Awaiting requested review from jsimnz

@AndrewSisley AndrewSisley Awaiting requested review from AndrewSisley

Assignees

@orpheuslummis orpheuslummis

Labels
area/testing Related to any test or testing suite
Projects
None yet
Milestone
DefraDB v0.3
Development

Successfully merging this pull request may close these issues.

Integration tests located in a top-level folder
5 participants
@orpheuslummis @jsimnz @source-devs @fredcarle @shahzadlone