fix bigquery connector

[pawel-big-lebowski]

Signed-off-by: Pawel Leszczynski [email protected]

Problem

Spark integration fails with spark-bigquery-connector >=0.25.0

Closes: #1105

Solution

• make Spark integration work with the latest connector
• provide a change in a way that the old version would work either

Note: All schema changes require discussion. Please link the issue for context.

• Your change modifies the core OpenLineage model
• Your change modifies one or more OpenLineage facets

If you're contributing a new integration, please specify the scope of the integration and how/where it has been tested (e.g., Apache Spark integration supports S3 and GCS filesystem operations, tested with AWS EMR).

Checklist

• You've signed-off your work
• Your pull request title follows our guidelines
• Your changes are accompanied by tests (if relevant)
• Your change contains a small diff and is self-contained
• You've updated any relevant documentation (if relevant)
• You've updated the CHANGELOG.md with details about your change under the "Unreleased" section (if relevant, depending on the change, this may not be necessary)
• You've versioned the core OpenLineage model or facets according to SchemaVer (if relevant)
• You've added a header to source files (if relevant)

[pawel-big-lebowski]

This is the main change of the PR: call both methods tableName and getTableName on BigQueryRelation to retrieve name regardless of version.

[pawel-big-lebowski]

bigquery dependencies are not needed for spark2, spark3 and spark32 subprojects. Instead of upgrading, I remove them,