Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LMDB config #1

Open
jakirkham opened this issue Aug 26, 2022 · 1 comment
Open

LMDB config #1

jakirkham opened this issue Aug 26, 2022 · 1 comment

Comments

@jakirkham
Copy link

There are some differences between the LMDB config used here...

map_size=100 * 2 ** 30,
# sync=False,
readahead=False,
writemap=True,
meminit=False,
max_spare_txns=4,
max_readers=16,

...compared to what is used by Zarr or Zict.

Am curious how the config here started and how the current config was determined.

@martindurant
Copy link
Owner

It was not hugely thought through, just a brief skim of the docs. Happy to be shown that switching one of the flags makes a difference; although it doesn't appear to be much different in fact between mine and zarr's. (sync probably doesn't matter since we close the connection on every access, which may be a far bigger impact on performance!)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants