feat(source-gcs): added oauth flow

[darynaishchenko]

What

Add supporting OAuth
Additionally:
resolves: https://github.com/airbytehq/airbyte-internal-issues/issues/9745 (remove discriminator fields)

How

Extended spec with advanced_auth, added credentials object with config migration that adds deprecated service_account field into credentials object.
Added and updated unit tests.

PR for the platform: https://github.com/airbytehq/airbyte-platform-internal/pull/13923

Review guide

1. airbyte-integrations/connectors/source-gcs/source_gcs/config.py
2. airbyte-integrations/connectors/source-gcs/source_gcs/source.py
3. airbyte-integrations/connectors/source-gcs/source_gcs/stream_reader.py
4. other files

User Impact

Can this PR be safely reverted and rolled back?

• YES 💚
• NO ❌

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 24, 2024 2:07pm

[girarda]

I expect the discriminator fields to trip up the Terraform provider. Maybe we need a method similar to this one where we remove them from the schemas

airbyte/airbyte-cdk/python/airbyte_cdk/sources/file_based/config/abstract_file_based_spec.py

Lines 58 to 60 in fc12432

	def remove_discriminator(schema: Dict[str, Any]) -> None:
	"""pydantic adds "discriminator" to the schema for oneOfs, which is not treated right by the platform as we inline all references"""
	dpath.delete(schema, "properties/**/discriminator")

[darynaishchenko]

removed def remove_discriminator from Config class, so both discriminators are being removed from spec

[girarda]

PR looks good! @darynaishchenko just to confirm - we need to update our app's scopes to be able to test the new flow, correct?

[darynaishchenko]

PR looks good! @darynaishchenko just to confirm - we need to update our app's scopes to be able to test the new flow, correct?

@girarda, We need:

1. merge pr for platform
2. make a dev image of the source based changes in this pr
3. add client id/secret (for example from other google app) to platform

Ask google support to test it for verification. Scopes have been already added to our app. cc: @DanyloGL