Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SRC Google Analytics V4] Syncs on 0.1.7 fails when upgrading from 0.1.6 #6977

Closed
philippeboyd opened this issue Oct 12, 2021 · 4 comments · Fixed by #7020
Closed

[SRC Google Analytics V4] Syncs on 0.1.7 fails when upgrading from 0.1.6 #6977

philippeboyd opened this issue Oct 12, 2021 · 4 comments · Fixed by #7020

Comments

@philippeboyd
Copy link
Contributor

philippeboyd commented Oct 12, 2021

Enviroment

  • Airbyte version: 0.30.16-alpha
  • OS Version / Instance: GCP COS
  • Deployment: Docker
  • Source Connector and version: Google Analytics V4 0.1.7
  • Destination Connector and version: Snowflake 0.3.14
  • Severity: Medium
  • Step where error happened: Sync job

Current Behavior

Probably related to PR #6414
We're using a service account to communicate with Google Analytics and we've setup the newly GA v4 connector about 2 weeks ago and when upgrading from GA v4 0.1.6 to 0.1.7 (latest) we cannot sync anymore since the configuration with a service account seems to be missing a required key (see logs)

Expected Behavior

A migration of the configuration should probably have been done if the key wasn't there before.

Logs


2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 - Traceback (most recent call last):
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -   File "/airbyte/integration_code/main.py", line 13, in <module>
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -     launch(source, sys.argv[1:])
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 105, in launch
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -     for message in source_entrypoint.run(parsed_args):
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 76, in run
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -     check_config_against_spec_or_exit(config, source_spec, logger)
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/utils/schema_helpers.py", line 121, in check_config_against_spec_or_exit
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 -     raise Exception("Config validation error: " + validation_error.message) from None
2021-10-12 12:32:18 ERROR () LineGobbler(voidCall):65 - Exception: Config validation error: 'auth_type' is a required property

Steps to Reproduce

  1. Setup a GA v4 source using connector 0.1.6
  2. Setup a Snowflake destination
  3. Do a sync
  4. Upgrade GA v4 connector to 0.1.7
  5. Do a sync (should fail)
@gaart
Copy link
Contributor

gaart commented Oct 12, 2021

Hi @philippeboyd
Could you reestablish the GA v4 connector (remove and setup it again) and let me know if it helps?

@philippeboyd
Copy link
Contributor Author

@gaart a bit inconvenient when you have to do it dozens of time... (we have a lot of different GA sources)

@gaart
Copy link
Contributor

gaart commented Oct 14, 2021

@philippeboyd

We just merged this feature into master and released a new version of the connector.

Upgrade your connector to version 0.1.8 and get started. To upgrade your connector version, go to the admin panel in the left hand side of the UI, find this connector in the list, and input the latest connector version.

Please let us know if you have any further questions.

Enjoy!

@philippeboyd
Copy link
Contributor Author

@gaart, seems to be fine with 0.1.8, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment