[ETL-670] Update code to paginate over all results

[BryanFauble]

Problem:

1. There is a maximum of 1000 objects that can return from a single call to list_objects_v2

Solution:

1. Using a pagination to loop over all objects in the bucket/prefix

Testing:

1. To review the action runs

[sonarcloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[philerooski]

This works 👍 You might have also invoked the CLI directly

aws s3 rm s3://<bucket-name>/<path> --exclude <exclusion-pattern> --recursive