-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
aws emr create-cluster --configurations and web console settings are inconsistent #1678
Comments
Thanks for bringing this to our attention. The underlying API expects a raw json as input. Web console and CLI each provides a convenience on top of it to give customer a chance to load json content directly from a file. It turns out they implement different input format. Web console accepts That being said, it is still possible in future we add a |
I can see that it isn't a priority, I just stumbled upon it while writing a howto for users of our product and saw the differences. These little paper-cuts tend to confuse users and can be a source of much wasted time. That's why I submitted the issue here. |
While having the console and the cli be consistent and both support http and s3 protocols, the real issue is that users can't currently host a public configuration file in an s3 bucket and make it available for others to use in the console. Since the console requires s3 protocol, people in different regions or accounts will get errors when trying to specify the configuration URI. Using the http protocol is preferred in this case. Related to the following forums post : https://forums.aws.amazon.com/message.jspa?messageID=696248#696248 |
If http is not an option, it should at least behave the same way that EMR bootstrap-actions behave. They can be used from any public bucket, which makes sharing them very easy. |
Good Morning! We're closing this issue here on GitHub, as part of our migration to UserVoice for feature requests involving the AWS CLI. This will let us get the most important features to you, by making it easier to search for and show support for the features you care the most about, without diluting the conversation with bug reports. As a quick UserVoice primer (if not already familiar): after an idea is posted, people can vote on the ideas, and the product team will be responding directly to the most popular suggestions. We’ve imported existing feature requests from GitHub - Search for this issue there! And don't worry, this issue will still exist on GitHub for posterity's sake. As it’s a text-only import of the original post into UserVoice, we’ll still be keeping in mind the comments and discussion that already exist here on the GitHub issue. GitHub will remain the channel for reporting bugs. Once again, this issue can now be found by searching for the title on: https://aws.uservoice.com/forums/598381-aws-command-line-interface -The AWS SDKs & Tools Team |
This message was created automatically by mail delivery software.
A message that you sent could not be delivered to one or more of its
recipients. This is a temporary error. The following address(es) deferred:
[email protected]
Domain salmanwaheed.info has exceeded the max emails per hour (164/150 (109%)) allowed. Message will be reattempted later
…------- This is a copy of the message, including all the headers. ------
------ The body of the message is 6164 characters long; only the first
------ 5000 or so are included here.
Received: from o7.sgmail.github.com ([167.89.101.198]:54583)
by box1177.bluehost.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128)
(Exim 4.89_1)
(envelope-from <[email protected]>)
id 1ej0Pr-001asR-AT
for [email protected]; Tue, 06 Feb 2018 03:23:55 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=github.com;
h=from:reply-to:to:cc:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding:list-id:list-archive:list-post:list-unsubscribe;
s=s20150108; bh=Mj0NcYqJIK6dQwIiDdi8eAtn488=; b=m4Z47nDNUrd6gdlR
a1uUD9XZw164fdWOkgp7bnetdi/24UoV39BDuLv3GnFkEFXoEctkjx6c66QelxN4
283dlAMl57H+IrdI3BZ4T3Y6TFPRDhQUkEy599lxb2iQxRQ2LD3pAMsnOMBqSpAK
NK4ZqsfS12GXmbtY5/PHmYXwCnM=
Received: by filter0602p1mdw1.sendgrid.net with SMTP id filter0602p1mdw1-17352-5A79822E-18
2018-02-06 10:23:42.854042013 +0000 UTC
Received: from github-smtp2b-ext-cp1-prd.iad.github.net (github-smtp2b-ext-cp1-prd.iad.github.net [192.30.253.17])
by ismtpd0006p1iad2.sendgrid.net (SG) with ESMTP id s3NgQBkVSdaAu6SXtjRwSw
for <[email protected]>; Tue, 06 Feb 2018 10:23:42.798 +0000 (UTC)
Date: Tue, 06 Feb 2018 10:23:42 +0000 (UTC)
From: Andre Sayre <[email protected]>
Reply-To: aws/aws-cli <[email protected]>
To: aws/aws-cli <[email protected]>
Cc: Subscribed <[email protected]>
Message-ID: <aws/aws-cli/issues/1678/[email protected]>
In-Reply-To: <aws/aws-cli/issues/[email protected]>
References: <aws/aws-cli/issues/[email protected]>
Subject: Re: [aws/aws-cli] aws emr create-cluster --configurations and web
console settings are inconsistent (#1678)
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary="--==_mimepart_5a79822e9d70e_8393fbb60110f34565610";
charset=UTF-8
Content-Transfer-Encoding: 7bit
Precedence: list
X-GitHub-Sender: ASayre
X-GitHub-Recipient: salmanwaheed
X-GitHub-Reason: subscribed
List-ID: aws/aws-cli <aws-cli.aws.github.com>
List-Archive: https://github.com/aws/aws-cli
List-Post: <mailto:[email protected]>
List-Unsubscribe: <mailto:unsub+00ef1b3813ab5dc38ed8907c9191e4cce50652038950964c92cf000000011691442e92a169ce07469957@reply.github.com>,
<https://github.com/notifications/unsubscribe/AO8bOEVZkaox4EnLHPELXkShSz8CPaLoks5tSCgugaJpZM4G02X5>
X-Auto-Response-Suppress: All
X-GitHub-Recipient-Address: [email protected]
X-SG-EID: 92ws1MVnlto3blxqXlf5goB0ee0kdDGWR6vcWx8d649O6Uddx1jSEGqJxEO8qd+Li9h0k99QNeYSKb
uYLitfUtDYiDW3fn2S2CLtg1RicXg5D5tmkkBOwcyML0EWY/hwhp2TVJt3AXlmB3C2z/qYSq9vUMaO
L4VVabcR4dlTNkChtYIt7TnUAqxr0NBHDwoMgzB0MGesPjT/DbGUOSO+cz37rWEhIJoOW8w/Pqndl/
I=
X-Spam-Status: No, score=-1.9
X-Spam-Score: -18
X-Spam-Bar: -
X-Ham-Report: Spam detection software, running on the system "box1177.bluehost.com",
has NOT identified this incoming email as spam. The original
message has been attached to this so you can view it or label
similar future email. If you have any questions, see
root\@localhost for details.
Content preview: Good Morning! We're closing this issue here on GitHub, as
part of our migration to [UserVoice](https://aws.uservoice.com/forums/598381-aws-command-line-interface)
for feature requests involving the AWS CLI. [...]
Content analysis details: (-1.9 points, 5.0 required)
pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: github.com]
-0.5 SPF_PASS SPF: sender matches SPF record
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.8 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3)
[167.89.101.198 listed in wl.mailspike.net]
0.0 HTML_MESSAGE BODY: HTML included in message
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.8 RCVD_IN_MSPIKE_WL Mailspike good senders
0.2 AWL AWL: Adjusted score from AWL reputation of From: address
X-Spam-Flag: NO
----==_mimepart_5a79822e9d70e_8393fbb60110f34565610
Content-Type: text/plain;
charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Good Morning!
We're closing this issue here on GitHub, as part of our migration to [UserV=
oice](https://aws.uservoice.com/forums/598381-aws-command-line-interface) f=
or feature requests involving the AWS CLI.
This will let us get the most important features to you, by making it easie=
r to search for and show support for the features you care the most about, =
without diluting the conversation with bug reports.
As a quick UserVoice primer (if not already familiar): after an idea is pos=
ted, people can vote on the ideas, and the product team will be responding =
directly to the most popular suggestions.
We=E2=80=99ve imported existing feature requests from GitHub - Search for t=
his issue there!
And don't worry, this issue will still exist on GitHub for posterity's sake=
. As it=E2=80=99s a text-only import of the original post into UserVoice, =
we=E2=80=99ll still be keeping in mind the comments and discussion that alr=
eady exist here on the GitHub issue.
GitHub will remain the channel for reporting bugs.=20=20
Once again, this issue can now be found by searching for the title on: http=
s://aws.uservoice.com/forums/598381-aws-command-line-interface=20
-The AWS SDKs & Tools Team
--=20
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
#1678 (comment)=
----==_mimepart_5a79822e9d70e_8393fbb60110f34565610
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<p>Good Morning!</p>
<p>We're closing this issue here on GitHub, as part of our migration to <a =
href=3D"https://aws.uservoice.com/forums/598381-aws-command-line-interface"=
rel=3D"nofollow">UserVoice</a> for feature requests involving the AWS CLI.=
</p>
<p>This will let us get the most important features to you, by making it ea=
sier to search for and show support for the features you care the most abou=
t, without diluting the conversation with bug reports.</p>
<p>As a quick UserVoice primer (if not already familiar): after an idea is =
posted, people can vote on the ideas, and the product team will be respondi=
ng directly to the most popular suggestions.</p>
<p>We=E2=80=99ve imported existing feature requests from GitHub - Search fo=
r this issue there!</p>
<p>And don't worry, this issue will still exist on GitHub for posterity's s=
ake. As it=E2=80=99s a text-only import of the original post into UserVoic=
e, we=E2=80=99ll still be keeping in mind the comments and discussion that =
already exist here on the GitHub issue.</p>
<p>GitHub will remain the channel for reporting bugs.</p>
<p>Once again, this issue can now be found by searching for the title on: <=
a href=3D"https://aws.uservoice.com/forums/598381-aws-command-line-interfac=
e" rel=3D"nofollow">https://aws.uservoice.com/forums/598381-aws-command-lin=
e-interface</a></p>
<p>-The AWS SDKs & Tools Team</p>
<p style=3D"font-size:small;-webkit-text-size-adjust:none;color:#666;">&mda=
sh;<br />You are receiving this because you are subscribed to this thread.<=
br />Reply to this email directly, <a href=3D"https://github.com/aws/aws-cl=
i/issues/1678#issuecomment-363378055">view it on GitHub</a>, or <a href=3D"=
https://github.com/notifications/unsubscribe-auth/AO8bOFpeuLXpSkINU2oE16w4N=
Is_ZD_Tks5tSCgugaJpZM4G02X5">mute the thread</a>.<img alt=3D"" height=3D"1"=
src=3D"https://github.com/notifications/beacon/AO8bOIY2b_R4aDnuHBRobKQcXqb=
tvuRfks5tSCgugaJpZM4G02X5.gif" width=3D"1" /></p>
<div itemscope itemtype=3D"http://schema.org/EmailMessage">
<div itemprop=3D"action" itemscope itemtype=3D"http://schema.org/ViewAction=
">
<link itemprop=3D"url" href=3D"#1678=
#issuecomment-363378055"></link>
<meta itemprop=3D"name" content=3D"View Issue"></meta>
</div>
<meta itemprop=3D"description" content=3D"View this Issue on GitHub"></meta>
</div>
<script type=3D"application/json" data-scope=3D"inboxmarkup">{"api_version"=
:"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"Gi=
tHub"},"entity":{"external_key":"github/aws/aws-cli","title":"aws/aws-cli",=
"subtitle":"GitHub repository","main_image_url":"https://cloud.githubuserco=
ntent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png",=
"avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842=
166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in Git=
Hub","url":"https://github.com/aws/aws-cli"}},"updates":{"snippets":[{"icon=
":"PERSON","message":"@ASayre in #1678: Good Morning!\r\n\r\nWe're closing =
this issue here on GitHub, as part of our migration to [UserVoice](https://=
aws.uservoice.com/forums/598381-aws-command-line-interface) for feature req=
uests involving the AWS CLI.\r\n\r\nThis will let us get the most important=
features to y
|
This message was created automatically by mail delivery software.
A message that you sent could not be delivered to one or more of its
recipients. This is a temporary error. The following address(es) deferred:
[email protected]
Domain salmanwaheed.info has exceeded the max emails per hour (165/150 (110%)) allowed. Message will be reattempted later
…------- This is a copy of the message, including all the headers. ------
Received: from o7.sgmail.github.com ([167.89.101.198]:3453)
by box1177.bluehost.com with esmtps (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128)
(Exim 4.89_1)
(envelope-from <[email protected]>)
id 1ej0Pr-001asE-4n
for [email protected]; Tue, 06 Feb 2018 03:23:56 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=github.com;
h=from:reply-to:to:cc:in-reply-to:references:subject:mime-version:content-type:content-transfer-encoding:list-id:list-archive:list-post:list-unsubscribe;
s=s20150108; bh=+79mOvxe4t9wKQZm1rRoR4rwjOI=; b=SMP2UH2+1UxjNpol
9wPdkc5bYY0r3+2YDyllyR1c2a+V+ryNvRRIB2zfMybruoAoHw07ze57dTWLLEwR
6EY9w2VHFRolvlWFKS81eDmJyVFDhcZbGZNKUnw+JEjm88aeL2S+bUk6h5GAH+sO
NGPdhRnH2e2xqvKDirsR930LBgE=
Received: by filter0095p1las1.sendgrid.net with SMTP id filter0095p1las1-19416-5A79822D-20
2018-02-06 10:23:41.94005158 +0000 UTC
Received: from github-smtp2a-ext-cp1-prd.iad.github.net (github-smtp2a-ext-cp1-prd.iad.github.net [192.30.253.16])
by ismtpd0021p1iad2.sendgrid.net (SG) with ESMTP id dnB2IJG1TwC8ALFYamZEuA
for <[email protected]>; Tue, 06 Feb 2018 10:23:41.892 +0000 (UTC)
Date: Tue, 06 Feb 2018 10:23:41 +0000 (UTC)
From: Andre Sayre <[email protected]>
Reply-To: aws/aws-cli <[email protected]>
To: aws/aws-cli <[email protected]>
Cc: Subscribed <[email protected]>
Message-ID: <aws/aws-cli/issue/1678/issue_event/[email protected]>
In-Reply-To: <aws/aws-cli/issues/[email protected]>
References: <aws/aws-cli/issues/[email protected]>
Subject: Re: [aws/aws-cli] aws emr create-cluster --configurations and web
console settings are inconsistent (#1678)
Mime-Version: 1.0
Content-Type: multipart/alternative;
boundary="--==_mimepart_5a79822db8f8d_51be2ab9506aaed01274d4";
charset=UTF-8
Content-Transfer-Encoding: 7bit
Precedence: list
X-GitHub-Sender: ASayre
X-GitHub-Recipient: salmanwaheed
X-GitHub-Reason: subscribed
List-ID: aws/aws-cli <aws-cli.aws.github.com>
List-Archive: https://github.com/aws/aws-cli
List-Post: <mailto:[email protected]>
List-Unsubscribe: <mailto:unsub+00ef1b3804bef637a33a0f6bf6c1a8fb436b395a2a95ae7992cf000000011691442d92a169ce07469957@reply.github.com>,
<https://github.com/notifications/unsubscribe/AO8bOGsm8WEbYnor0euntYrqCT9r-t72ks5tSCgtgaJpZM4G02X5>
X-Auto-Response-Suppress: All
X-GitHub-Recipient-Address: [email protected]
X-SG-EID: 92ws1MVnlto3blxqXlf5goB0ee0kdDGWR6vcWx8d649pamzigO4J7bL8Vge1TY55ZXhVLhPapmh6LY
Iw5TsPjoxYopTJSG6t3DdIeVkMpWKmsSmTUAr8Xa66p4jalrderIOw5uuWrpRExtCtdH4oNt5B5GtN
AA3HOZy2zgNQwdHWQ0iAIId2vxWZjK/EfknoiF1VT4znDazU5vk29vuO2+WUVgADkhJMzW/EstjZo6
4=
X-Spam-Status: No, score=-0.3
X-Spam-Score: -2
X-Spam-Bar: /
X-Ham-Report: Spam detection software, running on the system "box1177.bluehost.com",
has NOT identified this incoming email as spam. The original
message has been attached to this so you can view it or label
similar future email. If you have any questions, see
root\@localhost for details.
Content preview: Closed #1678. -- You are receiving this because you are subscribed
to this thread. Reply to this email directly or view it on GitHub: #1678 (comment)
Closed #1678. [...]
Content analysis details: (-0.3 points, 5.0 required)
pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: github.com]
-0.8 RCVD_IN_MSPIKE_H3 RBL: Good reputation (+3)
[167.89.101.198 listed in wl.mailspike.net]
-0.5 SPF_PASS SPF: sender matches SPF record
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
0.0 HTML_MESSAGE BODY: HTML included in message
0.7 HTML_IMAGE_ONLY_20 BODY: HTML: images with 1600-2000 bytes of words
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature
2.5 DCC_CHECK No description available.
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.8 RCVD_IN_MSPIKE_WL Mailspike good senders
-1.4 AWL AWL: Adjusted score from AWL reputation of From: address
X-Spam-Flag: NO
----==_mimepart_5a79822db8f8d_51be2ab9506aaed01274d4
Content-Type: text/plain;
charset=UTF-8
Content-Transfer-Encoding: 7bit
Closed #1678.
--
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
#1678 (comment)
----==_mimepart_5a79822db8f8d_51be2ab9506aaed01274d4
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: 7bit
<p>Closed <a href="#1678" class="issue-link js-issue-link" data-error-text="Failed to load issue title" data-id="122067287" data-permission-text="Issue title is private" data-url="#1678">#1678</a>.</p>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br />You are receiving this because you are subscribed to this thread.<br />Reply to this email directly, <a href="#1678 (comment)">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/AO8bOJQiRQs_yCA7HrnX3IxTunzg2cJEks5tSCgtgaJpZM4G02X5">mute the thread</a>.<img alt="" height="1" src="https://github.com/notifications/beacon/AO8bOAkAGvBGDUhdBEnGTBIcQgdnwO1Fks5tSCgtgaJpZM4G02X5.gif" width="1" /></p>
<div itemscope itemtype="http://schema.org/EmailMessage">
<div itemprop="action" itemscope itemtype="http://schema.org/ViewAction">
<link itemprop="url" href="#1678 (comment)"></link>
<meta itemprop="name" content="View Issue"></meta>
</div>
<meta itemprop="description" content="View this Issue on GitHub"></meta>
</div>
<script type="application/json" data-scope="inboxmarkup">{"api_version":"1.0","publisher":{"api_key":"05dde50f1d1a384dd78767c55493e4bb","name":"GitHub"},"entity":{"external_key":"github/aws/aws-cli","title":"aws/aws-cli","subtitle":"GitHub repository","main_image_url":"https://cloud.githubusercontent.com/assets/143418/17495839/a5054eac-5d88-11e6-95fc-7290892c7bb5.png","avatar_image_url":"https://cloud.githubusercontent.com/assets/143418/15842166/7c72db34-2c0b-11e6-9aed-b52498112777.png","action":{"name":"Open in GitHub","url":"https://github.com/aws/aws-cli"}},"updates":{"snippets":[{"icon":"DESCRIPTION","message":"Closed #1678."}],"action":{"name":"View Issue","url":"#1678 (comment)"}}}</script>
----==_mimepart_5a79822db8f8d_51be2ab9506aaed01274d4--
|
Based on community feedback, we have decided to return feature requests to GitHub issues. |
Addresses several issues around IDE init as well as Windows init. With this change, the `sam init` command will clone the app templates repo automatically (with shell notifications), and uses a two-step update process so that the existing app templates copy on a user's machine is not deleted unless we have already successfully downloaded a replacement.
Checking in as this issue hasn't been active in a while. According to this page in the EMR documentation it is now possible to set a |
I have not used EMR in many years. Feel free to close this bug. |
|
When creating a new EMR cluster on the cli, the emr commandline insists that the protocol for the configurations either being
file://
ofhttp(s)://
. Usings3://
will not work. The web-console on the other hand demands that the protocol has to bes3://
. That is inconsistent and confusing.The text was updated successfully, but these errors were encountered: