[feature] S3 Integration for Artifact Storage (IRSA)

[ryansteakley]

S3 Integration for Artifact Storage (IRSA)

As of Kubeflow pipelines 2.0-alpha6 release, using IRSA for artifact storage in S3 is not fully supported(details later in the doc). There has been a long-running thread with high-interest for this functionality in the kubeflow pipelines github. These proposal aims to address it.

To support using IRSA with S3, we want to add the AWS JS SDK credentials module to the frontend container image and update the aws-helper to use credentialProviderChain function from the AWS JS SDK.

Please read the following design document to better understand the reasoning and use-case behind this feature.

---

/area frontend
Love this idea? Give it a 👍.

[surajkota]

Hi @zijianjoy @jlyaoyuli Can you please tag Jo Li/people from frontend side to review this proposal

cc @chensun, @james-jwu

[surajkota]

@jlyaoyuli

[surajkota]

Hi @gkcalat, I believe @ryansteakley is interested to contribute this functionality. Shall we go ahead with the PR?
@jlyaoyuli let us know if you have any comments

[gkcalat]

/assign @chensun

[ryansteakley]

resolved by #8651 merged, thanks everyone!