Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bad encoding for resources uploaded into DataStore #174

Open
quinoescobar opened this issue Sep 29, 2022 · 0 comments
Open

Bad encoding for resources uploaded into DataStore #174

quinoescobar opened this issue Sep 29, 2022 · 0 comments

Comments

@quinoescobar
Copy link

quinoescobar commented Sep 29, 2022 •
edited
Loading

Version

CKAN 2.9.5; XLoader 0.11.0

Describe the bug

Uploading a resource with accented characters are stored and are shown in the previews with bad encoding.

Expected behavior

Uploading a resource with accented characters are stored and shown with the correct encoding.

Additional details

Looks like somehow if the first rows of the file are accented the resource is being uploaded OK.

See the column 'Vwx' of the Attached two files after being xloaded to the datastore:

Good.csv : This is uploaded and show correctly.
Bad.csv: This is uploaded and shown incorrectly.

MessyTables behavior is set to False

ckanext.xloader.just_load_with_messytables = False

Good.csv
Bad.csv
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@quinoescobar