Add default region config to AWS

[legoguy1000]

What does this PR do?

Adds a new config to the AWS common module deafult_region.

Why is it important?

This is to resolve issues as discussed in https://discuss.elastic.co/t/input-aws-s3-failed-with-failed-to-initialize-s3-poller/288130. Currently the module uses the us-east-1 region as the default anytime there isn't another item overriding it, like to query the location of a S3 bucket. As shown in the forum, that doesn't always work and should have a way to change the default like with the AWS CLI.

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

• [ ]

How to test this PR locally

Run unit/integration tests for the AWS common module

Related issues

Use cases

Screenshots

Logs

[mergify]

This pull request does not have a backport label. Could you fix it @legoguy1000? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

• backport-v./d./d./d is the label to automatically backport to the 7./d branch. /d is the digit

NOTE: backport-skip has been added to this pull request.

[elasticmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Start Time: 2021-12-14T15:40:07.567+0000

• Duration: 145 min 55 sec

• Commit: e831965

Test stats 🧪

Test	Results
Failed	0
Passed	28973
Skipped	1917
Total	30890

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

• /test : Re-trigger the build.

• /package : Generate the packages and run the E2E tests.

• /beats-tester : Run the installation tests with beats-tester.

• run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

[mergify]

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b aws-default-region upstream/aws-default-region
git merge upstream/master
git push upstream aws-default-region

[aspacca]

thanks @legoguy1000 for the PR

only thing left is to add test coverage for the change

[legoguy1000]

thanks @legoguy1000 for the PR

only thing left is to add test coverage for the change

Yup tracking, it's on my list for later today.

[elasticmachine]

Pinging @elastic/integrations (Team:Integrations)

[ayushmathur86]

Hello,
Any idea when this update will be available and in what version of beats ? I'm currently running on 7.16.2 so would like to prepare for the next upgrade for this change.
Thank You !

[legoguy1000]

Right now it's only in 8.0+. @aspacca is it too late to get into the next 7.x version?

[aspacca]

@ayushmathur86 @legoguy1000

the feature will hit 8.0
7.17 and 8.0 releases are only one week away