Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[UTF-8] Charset problems [multi-byte UTF-8 characters] #19

Closed
netmist opened this issue Apr 25, 2017 · 8 comments
Closed

[UTF-8] Charset problems [multi-byte UTF-8 characters] #19

netmist opened this issue Apr 25, 2017 · 8 comments

Comments

@netmist
Copy link

netmist commented Apr 25, 2017

I am facing the problem descrived here.
In my device xperia Z5 is working ok but in the emulator (or any Intel processor device) I see the special chars retrieved from sqlite like this ?ffffffc3??ffffffb3? for ó, etc.

As brunocollaco suggests on the above linked thread I think this is a bug with evcore-extbuild-free plugin on intel processors.

Any ideas?

Thank you.

@mmp-schmitt
Copy link

I recently switched from cordova-sqlite-ext to cordova-sqlite-evcore-extbuild-free. I can confirm the same problem. This problem only occurs with Android, not with iOS.

@netmist
Copy link
Author

netmist commented Apr 28, 2017

Yes mmp-schmitt this problem occurs with Androids working on a Intel processor device and there are a lot of them.
And also occurs with not-so-special chars ?ffffffe2??ffffff82? is what I got from the € symbol.

@mmp-schmitt
Copy link

The problem occurs with all UTF-8 characters beyond code 7F. When a character requires 2 bytes or more, the program fails. The Euro character has the URF-8 Hex code: e2 82 ac.
Obviously there is a character misinterpretation between the x86 C library libsqlc-evcore-native-driver.so and the Java parts.

@brodycj brodycj changed the title Charset problems [UTF-8] Charset problems Oct 8, 2017
@brodycj
Copy link
Contributor

brodycj commented Oct 8, 2017

Possible solution contributed in storesafe/android-sqlite-evcore-ndk-driver-free#2

Planning to publish a similar solution in November 2017.

@brodycj
Copy link
Contributor

brodycj commented Jan 17, 2018

From storesafe/android-sqlite-evcore-ndk-driver-free#2 (comment):

I just saw the issue in case of 2-octet and 3-octet UTF-8 characters on Android x86_64 emulator, hoping to make this fix in the near future [...]

P.S. I also see this on Intel x86 (32-bit) and x86_64 emulators.

@brodycj brodycj changed the title [UTF-8] Charset problems [UTF-8] Charset problems [multi-byte UTF-8 characters] Jan 17, 2018
@brodycj
Copy link
Contributor

brodycj commented Jan 17, 2018

Some related issues:

I expect to fix this issue in the next major release (related to next major release of cordova-sqlite-storage discussed in storesafe/cordova-sqlite-storage#687).

brodycj pushed a commit to storesafe/android-sqlite-evcore-ndk-driver-free that referenced this issue Apr 5, 2018
(unwanted sign extension in conversion)

THANKS to @spacepope (Hannes Petersen <[email protected]>)
for pointing this one out.

Closes #2

Fixes #1
(marked as duplicate)

(Also reported in storesafe/cordova-sqlite-evcore-extbuild-free#19)
brodycj pushed a commit to storesafe/android-sqlite-evcore-ndk-driver-free that referenced this issue Apr 6, 2018
(unwanted sign extension in conversion)

THANKS to @spacepope (Hannes Petersen <[email protected]>)
for pointing this one out.

- #2
- fixes #1
  (marked as duplicate)
- storesafe/cordova-sqlite-evcore-extbuild-free#19
brodycj pushed a commit to storesafe/android-sqlite-evcore-ndk-driver-free that referenced this issue Apr 11, 2018
brodycj pushed a commit to brodycj/cordova-sqlite-evcore-free-dependencies that referenced this issue Apr 11, 2018
brodycj pushed a commit to cbforks/cordova-sqlite-evcore-legacy-ext-common-free-dev that referenced this issue Apr 11, 2018
brodycj pushed a commit that referenced this issue Apr 12, 2018
(cordova-sqlite-evcore-extbuild-free 0.9.7-pre1)

in included evcore-native-driver.jar for Android

ref:
- #19
- storesafe/android-sqlite-evcore-ndk-driver-free#1
- storesafe/android-sqlite-evcore-ndk-driver-free#2
brodycj pushed a commit to storesafe/cordova-plugin-sqlite-evplus-ext-common-free that referenced this issue Apr 12, 2018
@brodycj
Copy link
Contributor

brodycj commented Apr 12, 2018

This issue is now resolved ref: storesafe/android-sqlite-evcore-ndk-driver-free#2 (comment)

@21pg
Copy link

21pg commented May 29, 2020

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants