Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.21+: Policy check summary not shown outside of "Show Output" details #2756

Closed
DanielCastronovo opened this issue Dec 6, 2022 · 10 comments · Fixed by #2837
Closed

v0.21+: Policy check summary not shown outside of "Show Output" details #2756

DanielCastronovo opened this issue Dec 6, 2022 · 10 comments · Fixed by #2837
Labels
bug Something isn't working regression Bug introduced in a new version

Comments

@DanielCastronovo
Copy link

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request. Searching for pre-existing feature requests helps us consolidate datapoints for identical requirements into a single place, thank you!
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request.
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment.

Overview of the Issue

#2452

Reproduction Steps

Launch a plan and viewed the result for security steps.

Logs

image

Environment details

  • Atlantis version: 0.21.0

Additional Context

We doesn't view the summary on a security checks.
Related to this PR #2452

@DanielCastronovo DanielCastronovo added the bug Something isn't working label Dec 6, 2022
@nitrocode
Copy link
Member

@DanielCastronovo perhaps your output is not matching the regex expected for opa/conftest?

Could you add more details? What policy are you running? Example of the hcl file? What does the policy run output show locally?

@tlorreyte since you proposed PR #2452 in case you have some thoughts on this.

@nitrocode nitrocode changed the title Policy check summary Policy check summary is empty in 0.21.0 Dec 6, 2022
@tlorreyte
Copy link
Contributor

@nitrocode I know @DanielCastronovo 's context. If this has not changed, a custom workflow is used for security checks.
The regex does not match the conftest output? or is it only in the case of a custom message?

@nitrocode
Copy link
Member

Unsure, but from the screenshot posted above, it appears that the policy summary is empty

@DanielCastronovo
Copy link
Author

DanielCastronovo commented Dec 6, 2022

The summary is correctly fill, see the details in this screenshot.
The regex seems to be good.

image
image

@nitrocode
Copy link
Member

@DanielCastronovo i don't understand the problem

@DanielCastronovo
Copy link
Author

Regarding the description of the PR :

Currently the only way to get a summary of the Conftest output (ie the last line) is to expand the comment.

When the security check comment is very long, it could be annoying to scroll down until find the summary line (v tests, w passed, x warnings, y failures, z exceptions).

Like the Terraform plan output, it might be interesting to have the summary of the Conftest result in the reduced comment

It should display the summary on the comment, without needing to be expended.
Like this :
image

@nitrocode nitrocode changed the title Policy check summary is empty in 0.21.0 Policy check summary is no longer shown outside of "Shown Output" details tab in v0.21.0 Dec 7, 2022
@nitrocode nitrocode changed the title Policy check summary is no longer shown outside of "Shown Output" details tab in v0.21.0 Policy check summary is no longer shown outside of "Show Output" details tab in v0.21.0 Dec 7, 2022
@nitrocode
Copy link
Member

Ah ok, I understand the problem now. So the policy check summary is no longer shown outside of the "show output" detail drop down

cc: @tlorreyte

@tlorreyte
Copy link
Contributor

It's due to a conflict with #2647 imho. The new wrapped template file doesn't have {{.PolicyCheckSummary}}. I'll open a pr

@DanielCastronovo
Copy link
Author

Many thanks @tlorreyte ❤️

@nitrocode
Copy link
Member

@tlorreyte friendly ping before the holidays :)

@nitrocode nitrocode changed the title Policy check summary is no longer shown outside of "Show Output" details tab in v0.21.0 v0.21+: Policy check summary not shown outside of "Show Output" details Dec 19, 2022
@nitrocode nitrocode added the regression Bug introduced in a new version label Dec 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working regression Bug introduced in a new version
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants