dynamodb - Support backing off a bit when throttling / limit-exceeded exceptions happen

[johnewart]

Adds retrying creation of tables wth some back-off when an AWS ThrottlingException or LimitExceededException is thrown by the DynamoDB API

[catsby]

hey @johnewart – the SDK has some concept(s) of throttling builtin:

• https://github.com/aws/aws-sdk-go/blob/master/aws/service.go

Is that something we could use here?

[johnewart]

I didn't know there was any such thing, but I'll look at it; it would be preferable to use something built into the SDK

[johnewart]

In looking at it the AWS SDK my understanding is that the auto-generated dynamodb service client would need to take advantage of those bits but it doesn't at the moment (it gets generated here: https://github.com/aws/aws-sdk-go/blob/master/internal/model/api/api.go#L224). Probably worth a stab at fixing that in the SDK at some point, so maybe I'll look at that later. Until that time, though, I think this is a reasonable solution.

[mitchellh]

I'd be okay with merging this as a stop-gap, but can you report this upstream @johnewart?

I'll leave the review to you @catsby

[johnewart]

Sure, I'll look at opening a ticket and possibly even put up some code for the SDK if needed because this seems to be something that should be built-in

[catsby]

Excellent, thanks all – merging

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.