perf(declarative) use luajit serializer for lmdb #8942
Conversation
bungle
force-pushed
the
perf/lmdb-luajit-serializer
branch
from
db7deb8
to
fb0c5cc
Compare
| shm_value = function(str_value, value_type) | ||
| return fmt("%d:%s", value_type, str_value) | ||
| end, | ||
| local encode = buffer.encode |
There was a problem hiding this comment.
Nice! I had been meaning to try this out myself.
I wonder if it's possible to use the dict optimization that the docs describe here:
(can't seem to find a published version of this html)
Adding some field names from core entities would probably be a performance win. The only downside is the list has to be fairly static or else we risk the persisted data becoming unreadable. I guess maybe we could store the list as metadata in lmdb too (in pure json or some other format that is guaranteed to be forward-safe).
There was a problem hiding this comment.
@flrgh, yes dict optimization for sure, need to analyze the data a bit to compile nice dictionary. Perhaps we can do it in different PR though.
bungle
force-pushed
the
perf/lmdb-luajit-serializer
branch
from
fb0c5cc
to
713f5a7
Compare
|
Seems to be green now, other than the |
Summary
Replaces
cjsonbased serializer with LuaJITstring.bufferserializer.