Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP Optimized utf8 #1051

Open
wants to merge 4 commits into
base: release-0.6
Choose a base branch
from
Open

WIP Optimized utf8 #1051

wants to merge 4 commits into from

Conversation

bettio
Copy link
Collaborator

@bettio bettio commented Feb 18, 2024

These changes are made under both the "Apache 2.0" and the "GNU Lesser General
Public License 2.1 or later" license terms (dual license).

SPDX-License-Identifier: Apache-2.0 OR LGPL-2.1-or-later

Allow also utf8 and unicode encodings in addition to latin1.

Signed-off-by: Davide Bettio <[email protected]>
Both functions have been introduced with OTP23 and they default to utf8.

Signed-off-by: Davide Bettio <[email protected]>
Test conversion from binary/list to unicode atoms and viceversa, and a
number of other corner cases.

Signed-off-by: Davide Bettio <[email protected]>
Add utf8 decoder taken from
http://bjoern.hoehrmann.de/utf-8/decoder/dfa/ by Björn Höhrmann, under
MIT license.

Signed-off-by: Davide Bettio <[email protected]>
@bettio bettio changed the base branch from main to release-0.6 February 18, 2024 00:04
@bettio bettio changed the title Optimized utf8 WIP Optimized utf8 Feb 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant