Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some emoji will become wrong character stored in bigquery while using load_table_from_json #864

Closed
grimmer0125 opened this issue Aug 9, 2021 · 0 comments · Fixed by #865
Labels
api: bigquery Issues related to the googleapis/python-bigquery API.

Comments

@grimmer0125
Copy link
Contributor

grimmer0125 commented Aug 9, 2021

Thanks for stopping by to let us know something could be better!

PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Please run down the following list and make sure you've tried the usual "quick fixes":

If you are still having issues, please be sure to include as much information as possible:

Environment details

  • OS type and version: macOS Big Sur
  • Python version: python --version 3.8.8
  • pip version: pip --version: 21.0.1
  • google-cloud-bigquery version: pip show google-cloud-bigquery: 2.6.1

Steps to reproduce

  1. insert any emoji which is over 0xFFFF into a dict, e.g. 🏦 (\U0001F3E6)
  2. use client.load_table_from_json(rows_to_insert... to upload
  3. see that emoji icon become �� in BigQuery web console

Code example

    bank = "\U0001F3E6" 
    rows_to_insert = [{"emoji": bank}]
    client.load_table_from_json(rows_to_insert, table_id, job_config=job_config)

Stack trace

# example

Making sure to follow these steps will guarantee the quickest resolution possible.

Thanks!

@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-bigquery API. label Aug 9, 2021
grimmer0125 added a commit to grimmer0125/python-bigquery that referenced this issue Aug 9, 2021
@grimmer0125 grimmer0125 changed the title some emoji (e.g. \U0001FE6) will become wrong character stored in bigquery while using load_table_from_json some emoji will become wrong character stored in bigquery while using load_table_from_json Aug 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery API.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant