[Feature] Publish images to alternative registry

[anishasthana]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

DockerHub allows you to pull only 100 images per 6 hour window[1], which isn't a lot. This results in the following error occurring fairly frequently.

Failed to pull image "kuberay/operator:v0.3.0": rpc error: code = Unknown desc = initializing source docker://kuberay/operator:v0.3.0: reading manifest v0.3.0 in docker.io/kuberay/operator: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

There are other container registries such as quay.io we could push images to instead (or as well) so as to get around the rate limit issues.

[1] https://docs.docker.com/docker-hub/download-rate-limit/

Use case

Reduce instances of rate limit errors when pulling images from DockerHub.

Related issues

#829
opendatahub-io/distributed-workloads#47

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[nvtkaszpir]

you can always make your own registry and pull/push images there.

[anishasthana]

Yep, that's what we're currently doing -- we just copied images over into our own registry. That being said, it's just another point of friction for new users, so in an ideal world we lower the bar to entry for anyone.

[kevin85421]

@anishasthana Do you have any recommendation for this issue? Thanks!

[anishasthana]

My recommendation would be:

1. Create a KubeRay organization on quay.io
2. Create a robot account which we can use for image pushes
3. Update https://github.com/ray-project/kuberay/blob/master/.github/workflows/image-release.yaml#L66-L70 and https://github.com/ray-project/kuberay/blob/master/.github/workflows/image-release.yaml#L124-L128 to push the images to quay. We would need to add corresponding log-in steps too

I'm happy to assist on any of this -- I'm quite familiar with quay.
We are actually primarily using quay.io for Project CodeFlare (the organization under which MCAD resides).

[Jeffwan]

@kevin85421 Can anyscale offer some premium plans for dockerhub kuberay? or just host kuberay under dockerhub ray-project?

[anishasthana]

The issue would be on the pulling side -- anyone wanting to pull images would also need a premium plan with dockerhub to not be rate-limited.

[kevin85421]

Thank you, @anishasthana, for the insightful suggestion! We will discuss this internally to determine if there is an existing solution in Ray or not, and we will get back to you as soon as possible.

[kevin85421]

This issue can be closed by #1307. Thank @anishasthana for the guidance! The next step is to update the doc and may be change the default image registry to Quay.