Local Region?

[olliebatch]

Prerequisites

• I've searched for previous similar issues or discussions and didn't find any solution.
• I searched the Developer Guide for an answer to my question.

Question Description

Is it possible to have a custom region so that we can use custom endpoints for regions?
https://docs.rs/rusoto_core/latest/rusoto_core/enum.Region.html.

This allowed a really nice way to test locally before pushing into aws environments.

When i try to test this with a local sqs queue, It gets an error of
("The address https://sqs.eu-west-1.amazonaws.com/ is not valid for this endpoint.")

When the queue url i am supplying is
queue_url =http://localhost:9324/queue/analytics-queue-dev

let rcv_message_output = sqs_client
            .receive_message()
            .queue_url(queue_url)
            .send()
            .await;

Is this possible and i just haven't found the docs for it yet?

Platform/OS/Device

MAC OS M1

Language Version

Rust 1.56

[rcoh]

is this helpful: https://docs.aws.amazon.com/sdk-for-rust/latest/dg/localstack.html?

[evbo]

for those loading config from env vars and just need endpoint url overridden, since the breaking change Endpoint is deprecated and you should use:

let config = aws_config::from_env()
    .endpoint_url("http://localstack:4566")
    .load().await;
  aws_sdk_s3::Client::new(&config)

[gdesmott]

I'm facing a similar problem. What would be the equivalent API of rusoto Region::Custom enum?

[josb]

Thanks, I'll look into how to use the endpoint_resolver to achieve this. The examples seem straightforward enough.

[gdesmott]

We are improving the documentation of our gst aws element about this. If that helps you: https://gitlab.freedesktop.org/gstreamer/gst-plugins-rs/-/merge_requests/960/diffs

[josb]

Thanks @gdesmott, I'll take a look.

[evbo]

Regions are not an enum in the AWS Rust SDK, but rather, an arbitrary string. The endpoint is organized separately, and can be overridden with the endpoint provider.

@jdisanti super helpful, thank you! But what are strategies for safely detecting a local endpoint should be used? For instance, how can I deploy the same code to production and not have the Lambda communicating with localhost?

I know I could add my own custom env var and add an if statement for when that env var is defined, but that scares me I'd introduce bugs, accidentally triggering the localhsot endpoint.

I did find this RFC specification that is exactly what I was hoping for! Will something like this exist soon?:

Configuration driven URL override. This mechanism hasn't been specified, but suppose that the Rust SDK supported an SDK_ENDPOINT environment variable. This variable would be an input to the existing endpoint resolver. machinery and would be backwards compatible with other SDKs (e.g. by prefixing the bucket as a host label for S3).

[rcoh]

SDK_ENDPOINT was not added—I would probably conditionally set .endpoint_url on the configuration object iff the environment variable was set (as you suggest above). You could also set ENDPOINT_URL to the value of the environment variable to make it less likely to be triggered by accident (since the URL would need to be in the variable)

let mut config = aws_config::from_env();
if let Some(endpoint_url) = std::env::var::get("ENDPOINT_URL").ok() {
  config = config.endpoint_url(endpoint_url)
}
let config = config.load().await

[github-actions[bot]]

Hello! Reopening this discussion to make it searchable.