Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

README note on Scorecard tests #143

Merged
merged 1 commit into from
Apr 25, 2024

Conversation

razo7
Copy link
Member

@razo7 razo7 commented Apr 16, 2024

Why we need this PR

Include how to easily use scorecard testing to validate the operator bundle directory. Follow up to #141

Changes made

  • Add a new subsection in README for how to use Scorecard testing.

Which issue(s) this PR fixes

Test plan

Include how to easily use scorecard testing to validate the operator bundle directory
Copy link
Contributor

openshift-ci bot commented Apr 16, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: razo7

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@clobrano
Copy link
Contributor

/lgtm

@razo7
Copy link
Member Author

razo7 commented Apr 16, 2024

/override 4.15-openshift-e2e

Copy link
Contributor

openshift-ci bot commented Apr 16, 2024

@razo7: /override requires failed status contexts, check run or a prowjob name to operate on.
The following unknown contexts/checkruns were given:

  • 4.15-openshift-e2e

Only the following failed contexts/checkruns were expected:

  • Test and build PRs
  • ci/prow/4.12-ci-bundle-my-bundle
  • ci/prow/4.12-images
  • ci/prow/4.12-openshift-e2e
  • ci/prow/4.12-test
  • ci/prow/4.13-ci-bundle-my-bundle
  • ci/prow/4.13-images
  • ci/prow/4.13-openshift-e2e
  • ci/prow/4.13-test
  • ci/prow/4.14-ci-bundle-my-bundle
  • ci/prow/4.14-images
  • ci/prow/4.14-openshift-e2e
  • ci/prow/4.14-test
  • ci/prow/4.15-ci-bundle-my-bundle
  • ci/prow/4.15-images
  • ci/prow/4.15-openshift-e2e
  • ci/prow/4.15-test
  • ci/prow/4.16-ci-bundle-my-bundle
  • ci/prow/4.16-images
  • ci/prow/4.16-openshift-e2e
  • ci/prow/4.16-test
  • pull-ci-medik8s-fence-agents-remediation-main-4.12-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.12-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.13-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.13-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.14-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.14-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.15-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.15-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.16-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.16-images

If you are trying to override a checkrun that has a space in it, you must put a double quote on the context.

In response to this:

/override 4.15-openshift-e2e

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@razo7
Copy link
Member Author

razo7 commented Apr 16, 2024

/override ci/prow/4.15-openshift-e2e

Copy link
Contributor

openshift-ci bot commented Apr 16, 2024

@razo7: Overrode contexts on behalf of razo7: ci/prow/4.15-openshift-e2e

In response to this:

/override ci/prow/4.15-openshift-e2e

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@razo7
Copy link
Member Author

razo7 commented Apr 16, 2024

/override 4.12-openshift-e2e
/override 4.13-openshift-e2e
/override 4.14-openshift-e2e
/override 4.16-openshift-e2e

Copy link
Contributor

openshift-ci bot commented Apr 16, 2024

@razo7: /override requires failed status contexts, check run or a prowjob name to operate on.
The following unknown contexts/checkruns were given:

  • 4.12-openshift-e2e
  • 4.13-openshift-e2e
  • 4.14-openshift-e2e
  • 4.16-openshift-e2e

Only the following failed contexts/checkruns were expected:

  • Test and build PRs
  • ci/prow/4.12-ci-bundle-my-bundle
  • ci/prow/4.12-images
  • ci/prow/4.12-openshift-e2e
  • ci/prow/4.12-test
  • ci/prow/4.13-ci-bundle-my-bundle
  • ci/prow/4.13-images
  • ci/prow/4.13-openshift-e2e
  • ci/prow/4.13-test
  • ci/prow/4.14-ci-bundle-my-bundle
  • ci/prow/4.14-images
  • ci/prow/4.14-openshift-e2e
  • ci/prow/4.14-test
  • ci/prow/4.15-ci-bundle-my-bundle
  • ci/prow/4.15-images
  • ci/prow/4.15-openshift-e2e
  • ci/prow/4.15-test
  • ci/prow/4.16-ci-bundle-my-bundle
  • ci/prow/4.16-images
  • ci/prow/4.16-openshift-e2e
  • ci/prow/4.16-test
  • pull-ci-medik8s-fence-agents-remediation-main-4.12-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.12-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.13-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.13-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.14-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.14-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.15-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.15-images
  • pull-ci-medik8s-fence-agents-remediation-main-4.16-ci-bundle-my-bundle
  • pull-ci-medik8s-fence-agents-remediation-main-4.16-images

If you are trying to override a checkrun that has a space in it, you must put a double quote on the context.

In response to this:

/override 4.12-openshift-e2e
/override 4.13-openshift-e2e
/override 4.14-openshift-e2e
/override 4.16-openshift-e2e

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@razo7
Copy link
Member Author

razo7 commented Apr 16, 2024

/override ci/prow/4.12-openshift-e2e
/override ci/prow/4.13-openshift-e2e
/override ci/prow/4.14-openshift-e2e
/override ci/prow/4.16-openshift-e2e

Copy link
Contributor

openshift-ci bot commented Apr 16, 2024

@razo7: Overrode contexts on behalf of razo7: ci/prow/4.12-openshift-e2e, ci/prow/4.13-openshift-e2e, ci/prow/4.14-openshift-e2e, ci/prow/4.16-openshift-e2e

In response to this:

/override ci/prow/4.12-openshift-e2e
/override ci/prow/4.13-openshift-e2e
/override ci/prow/4.14-openshift-e2e
/override ci/prow/4.16-openshift-e2e

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@razo7
Copy link
Member Author

razo7 commented Apr 16, 2024

/override ci/prow/4.12-test
/override ci/prow/4.13-test
/override ci/prow/4.14-test
/override ci/prow/4.15-test
/override ci/prow/4.16-test

Overriding the required tests that are skipped in docs only changes

Copy link
Contributor

openshift-ci bot commented Apr 16, 2024

@razo7: Overrode contexts on behalf of razo7: ci/prow/4.12-test, ci/prow/4.13-test, ci/prow/4.14-test, ci/prow/4.15-test, ci/prow/4.16-test

In response to this:

/override ci/prow/4.12-test
/override ci/prow/4.13-test
/override ci/prow/4.14-test
/override ci/prow/4.15-test
/override ci/prow/4.16-test

Overriding the required tests that are skipped in docs only changes

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@@ -235,6 +235,10 @@ Run `make test`
3. Export the operator installed namespace (e.g., *openshift-workload-availability*) before running the e2e test:
`export OPERATOR_NS=openshift-workload-availability && make test-e2e`

### Run Scorecard tests

Run `make test-scorecard` on a running Kubernetes cluster to statically validate the operator bundle directory using [Scorecard](https://sdk.operatorframework.io/docs/testing-operators/scorecard/).
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how do you run that command "on a cluster"?

@openshift-merge-bot openshift-merge-bot bot merged commit 83e25ea into medik8s:main Apr 25, 2024
23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants