[Filebeat] aws-s3 input should support any queue_url

[andrewkroh]

Describe the enhancement:

The aws-s3 input makes assumptions about the format of the queue_url for the purposes of determining the AWS region. I want to be able to run the aws-s3 input against emulated SQS and S3 services running in Localstack.

I don't know how the region it extracts from the URL gets used with respect to sqs mode, but I would assume that if the region is explicitly configured that we can skip trying to parse the region from the URL. (It may be using the region to determine what S3 region to use when downloading objects.)

Describe a specific use case for the enhancement or feature:

Testing the input in an offline and isolated environment.

Related

• Blocks: Make terraform outputs available as variables in tests elastic-package#703

[elasticmachine]

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)