replace bincode with zero-copy serialization library

[jbcaron]

Is there an existing issue?

• I have searched the existing issues

Motivation

our current use of bincode for data serialization and storage in rocksDB is not optimal, as bincode is built on top of serde, which we would also like to avoid. We need to find a more suitable serialization library that provides efficient zero-copy serialization and deserialization capabilities, while also allowing us to easily serialize our data to JSON for our RPC methods.

Request

• research and evaluate possible zero-copy serialization libraries, such as cap'n proto, rkyv or other solution.
• implement a poc integration of the chosen library, ensuring that it meets our requirements for zero-copy serialization and JSON support.
• migrate our existing bincode-based serialization code to the new library, ensuring a smooth transition and maintaining compatibility

Solution

No response

Are you willing to help with this request?

Yes!