Skip to content
This repository has been archived by the owner on Sep 30, 2023. It is now read-only.

Add putAll() function #36

Merged
merged 1 commit into from
May 12, 2020
Merged

Add putAll() function #36

merged 1 commit into from
May 12, 2020

Conversation

phillmac
Copy link
Contributor

When putting bulk amounts of documents, the oplog quickly grows unmanageable if every single document put generates a corresponding oplog PUT entry. This PR aims to fix this performance cost by batching large volumes of documents into a single PUTALL oplog entry.

put vs putall performance: https://gist.github.com/phillmac/155ed1eb232e75fda4a793e7672460fd

Includes some style fixes from standard --fix

@aphelionz
Copy link
Contributor

aphelionz commented Apr 19, 2020

I'd like to see if this compatible with @vasa-develop's b-tree work

@phillmac
Copy link
Contributor Author

Sure, I can run a merge test and see what happens, if someone could point me to the b-tree implementation

@vasa-develop
Copy link

vasa-develop commented Apr 20, 2020

@phillmac Here is the commit for b-tree with aviondb

All the b-tree stuff is in the src/CollectionIndex.js

It's pretty basic.

@aphelionz aphelionz mentioned this pull request May 12, 2020
@aphelionz aphelionz merged commit 11a8c0e into master May 12, 2020
@aphelionz aphelionz deleted the feat/put-all-v2 branch May 12, 2020 00:20
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants