[airbyte-cdk] - Update HttpClient to call authenticator on backoff retry attempts in HttpClient._send

[pnilan]

What

• OC: https://github.com/airbytehq/oncall/issues/6675
• The backoff handler wraps the HttpClient._send method. When the source-google-analytics-data-api would exceed its 1-hour quota threshold it would back off for 1800s (30 mins) twice. On the third attempt, after 60 minutes from the original attempt, the _send method is retried again, but does not invoke the authenticator's __call__ method, resulting in an attempt w/o refreshing the access token. This is likely an issue for all connectors that use oauth and have to backoff for a duration longer than the lifespan of the access token.
• Reduces complexity of _send by moving error resolution handling to new _handle_error_resolution method. (Required to due change exceeding flake8 complexity threshold)

How

• The HttpClient._send method already included logic for checking the attempt count. On subsequent attempts, will re-invoke the authenticator w/ the given request. For oauth authenticators, this will typically check the expiration of the token and refresh if needed.

Review guide

1. http_client.py

User Impact

• Improves sync reliability for connectors w/ oauth

Can this PR be safely reverted and rolled back?

• YES 💚
• NO ❌

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 21, 2024 11:49pm

[aldogonzalez8]

APPROVED

[pnilan]

/approve-regression-tests https://github.com/airbytehq/airbyte/actions/runs/11468980387/job/31915233015

Check job output.

✅ Approving regression tests

[sentry-io]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Internal server error. /usr/local/lib/python3.9/site-packages/airbyte_... View Issue

_{Did you find this useful? React with a 👍 or 👎}