-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: add some params for rocksdb write #2538
Conversation
fix rsync client main return
feat:add rocksdb write params
!!! This configuration is only reasonable for specific scenarios, please do not imitate it.!!!
beforeafter |
我理解这些参数本身rocksdb已经支持了动态调节,您是否可以一块修改下pika代码,支持通过config set动态调节这些参数? |
I understand that rocksdb already supports dynamic adjustment of these parameters. Can you modify the pika code together to support dynamic adjustment of these parameters through config set? |
好的 |
OK |
feat:add new param reload
pls view |
pls view |
* feat:ad rocksdb write params * add new param reload --------- Co-authored-by: shengxin.hou <[email protected]>
* feat:ad rocksdb write params * add new param reload --------- Co-authored-by: shengxin.hou <[email protected]>
Add some new params for rocksdb
Background
Frequent write stop/stall in large-volume random write tests
Change
level0_file_num_compaction_trigger
level0_stop_writes_trigger
level0_slowdown_writes_trigger
min_write_buffer_number_to_merge
max_bytes_for_level_base
max_subcompactions
For the sake of compatibility, the parameters in MR still maintain the default parameters of Rocksdb. If necessary, you can test and adjust by yourself.
Result
In the case of a large number of random writes, the write/stall situation can be greatly alleviated through specific parameter combinations.