Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chart repository not reachable (DNS Issue) #13313

Closed
arsenetar opened this issue Nov 2, 2022 · 23 comments
Closed

Chart repository not reachable (DNS Issue) #13313

arsenetar opened this issue Nov 2, 2022 · 23 comments
Assignees
Labels
solved tech-issues The user has a technical issue about an application triage Triage is needed

Comments

@arsenetar
Copy link

Name and Version

All Charts

What steps will reproduce the bug?

  1. Try loading https://charts.bitnami.com/bitnami
  2. Observe DNS error

Are you using any custom parameters or values?

No

What is the expected behavior?

Chart repository is reachable at https://charts.bitnami.com/bitnami

What do you see instead?

In browser DNS_PROBE_FINISHED_NXDOMAIN, in helm dial tcp: lookup charts.bitnami.com on ... : no such host

Additional information

nslookup gives the following:
charts.bitnami.com canonical name = d1xe8nqhpmcyfh.cloudfront.net.

@arsenetar arsenetar added the tech-issues The user has a technical issue about an application label Nov 2, 2022
@github-actions github-actions bot added the triage Triage is needed label Nov 2, 2022
@theyough
Copy link

theyough commented Nov 2, 2022

same issue

@dalbani
Copy link
Contributor

dalbani commented Nov 2, 2022

Does Bitnami provide some kind of status page by the way?
I googled for something like that but couldn't find anything.

@aarnaud
Copy link

aarnaud commented Nov 2, 2022

Seem fix now : http://dns.squish.net/traverses/958c5af6fa063f7bb00db86b71aecb18

But CNAME are in cache for 2h

new one is "dqk9m89za31r9.cloudfront.net"

@arsenetar
Copy link
Author

I can confirm I am now getting good DNS lookups from some locations.

@tigrantovmasyan
Copy link

Screen Shot 2022-11-02 at 7 53 28 PM

@vinoth-kumar-k
Copy link

I am still hitting errors too.

│ Error: looks like "https://charts.bitnami.com/bitnami" is not a valid chart repository or cannot be reached: Get "https://charts.bitnami.com/bitnami/index.yaml": dial tcp: lookup charts.bitnami.com on [fe80::1%en0]:53: no such host

@Bjego
Copy link

Bjego commented Nov 2, 2022

Yes - you have to flush DNS. Then the issue should be solved. Having the same issue..

@PallidPajeet
Copy link

hello sir when will the issue be of the fix sir? my koobyneet is now in the broke??

@WarheadsSE
Copy link
Contributor

WarheadsSE commented Nov 2, 2022

Recommendation: LOCK, and add comment from maintainers.

DNS is repopulating, and the issue is resolved.

Flush your caches, if necessary. For confirmation, use dig pointed at a an upstream core provider.

$ dig @8.8.4.4 charts.bitnami.com

; <<>> DiG 9.18.7 <<>> @8.8.4.4 charts.bitnami.com
; (1 server found)
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 37738
;; flags: qr rd ra; QUERY: 1, ANSWER: 5, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;charts.bitnami.com.            IN      A

;; ANSWER SECTION:
charts.bitnami.com.     6       IN      CNAME   dqk9m89za31r9.cloudfront.net.
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.99
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.117
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.114
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.119

;; Query time: 26 msec
;; SERVER: 8.8.4.4#53(8.8.4.4) (UDP)
;; WHEN: Wed Nov 02 12:03:43 EDT 2022
;; MSG SIZE  rcvd: 153

$ dig @8.8.4.4 dqk9m89za31r9.cloudfront.net.

; <<>> DiG 9.18.7 <<>> @8.8.4.4 dqk9m89za31r9.cloudfront.net.
; (1 server found)
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 53639
;; flags: qr rd ra; QUERY: 1, ANSWER: 4, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;dqk9m89za31r9.cloudfront.net.  IN      A

;; ANSWER SECTION:
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.117
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.99
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.119
dqk9m89za31r9.cloudfront.net. 60 IN     A       52.84.52.114

;; Query time: 26 msec
;; SERVER: 8.8.4.4#53(8.8.4.4) (UDP)
;; WHEN: Wed Nov 02 12:03:51 EDT 2022
;; MSG SIZE  rcvd: 121
``

@hunj
Copy link

hunj commented Nov 2, 2022

Had to re-run the command a few times to have the DNS propagate to the new URL, but yeah it seems fixed.

@vinoth-kumar-k
Copy link

my DNS was still hitting old distribution. Updating the nameserver to 8.8.4.4 did the trick for me. thanks, guys.

@tigrantovmasyan
Copy link

When is this going to be solved?

@carrodher
Copy link
Member

Thanks for reporting this issue. It was a problem in the CloudFront distribution that we used for the Charts repository.

The problem is that terraform recreated the CloudFront collection, creating a new DNS endpoint that needed to replicate globally. A small number of DNS are still resolving the old CloudFront collection name, but for the most part, the issue should be fixed shortly.

@dishi-github
Copy link

I ran the following commands but still got the same issue. Am I missing anything?

dig @8.8.4.4 charts.bitnami.com
helm fetch bitnami/keycloak

I ran the commands multiple times/ fresh session.

@moeketsichristopher
Copy link

@codablock I can resolve the host:

charts.bitnami.com	canonical name = dqk9m89za31r9.cloudfront.net.
Name:	dqk9m89za31r9.cloudfront.net
Address: 13.224.222.45
Name:	dqk9m89za31r9.cloudfront.net
Address: 13.224.222.114
Name:	dqk9m89za31r9.cloudfront.net
Address: 13.224.222.14
Name:	dqk9m89za31r9.cloudfront.net
Address: 13.224.222.43

but this is what I a getting now:

This XML file does not appear to have any style information associated with it. The document tree is shown below.
<Error>
<Code>AccessDenied</Code>
<Message>Access Denied</Message>
<RequestId>HHMZQEDQG4YQYWYN</RequestId>
<HostId>DlkCXrmgUG/XbFqq5S2pGyUULA3Q3vAYKRyzRmFLO6EkSe+btS4dA9aRlpyb2m+bivvsoy9unSU=</HostId>
</Error>

I am not sure if this is a new issue.

@sumesh-aot
Copy link

Same issue here:

Getting updates for unmanaged Helm repositories...
...Unable to get an update from the "https://charts.bitnami.com/bitnami/postgresql" chart repository:
	failed to fetch https://charts.bitnami.com/bitnami/postgresql/index.yaml : 403 Forbidden

@aarnaud
Copy link

aarnaud commented Nov 3, 2022

Same issue here:

Getting updates for unmanaged Helm repositories...
...Unable to get an update from the "https://charts.bitnami.com/bitnami/postgresql" chart repository:
	failed to fetch https://charts.bitnami.com/bitnami/postgresql/index.yaml : 403 Forbidden

not related, 403 Forbidden mean your reach the endpoint.

this issue was about DNS issues not permissions.

@sumesh-aot
Copy link

sumesh-aot commented Nov 3, 2022

Same issue here:

Getting updates for unmanaged Helm repositories...
...Unable to get an update from the "https://charts.bitnami.com/bitnami/postgresql" chart repository:
	failed to fetch https://charts.bitnami.com/bitnami/postgresql/index.yaml : 403 Forbidden

not related, 403 Forbidden mean your reach the endpoint.

this issue was about DNS issues not permissions.

Thanks. Thought it is related, charts were working few days back. We are using postgres chart as a dependency. I will see if there is another ticket, or will report one for 403.

@julien-michaud
Copy link

getting the same error as @sumesh-aot with the prestashop chart, nothing has changed on our end and since this morning I im getting 403

@tal-ayalon
Copy link

Getting error:
image

@carrodher
Copy link
Member

Getting error: image

You are missing the /bitnami at the end of the URL, the proper command should be:

$ helm repo add bitnami https://charts.bitnami.com/bitnami
"bitnami" has been added to your repositories

@tal-ayalon
Copy link

@carrodher Still getting errors:
image
If I'm using the --insecure-skip-tls-verify flag than it will work

@oomgomgxx
Copy link

The problem still exists

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved tech-issues The user has a technical issue about an application triage Triage is needed
Projects
None yet
Development

No branches or pull requests