Skip to content
This repository has been archived by the owner on Apr 1, 2024. It is now read-only.

ISSUE-16736: CI: Replace current GitHub Actions test reporting solution with less verbose solution #4602

Open
sijie opened this issue Jul 22, 2022 · 0 comments

Comments

@sijie
Copy link
Member

sijie commented Jul 22, 2022

Original Issue: apache#16736


Is your enhancement request related to a problem? Please describe.

We are currently using a test reporting solution based on https://github.com/dorny/test-reporter and there's a copy of this action in https://github.com/apache/pulsar-test-infra/tree/master/test-reporter .

The problem with this solution is that the test reporting is very verbose since it creates new check runs for the PR.
When there are failed tests, the PR will be marked failing even in cases where the tests pass in a later retry.

Describe the solution you'd like

There's an alternative solution in https://github.com/mikepenz/action-junit-report which is actively maintained.
It's possible to use this action with annotate_only: 'true' so that check runs aren't created at all. This is to mitigate the gap in GitHub Actions solution that check results cannot target a specific workflow when there are multiple active ones (more details in mikepenz/action-junit-report#40 (comment)).
The action will create a report for each build job using a new method available in GitHub Actions. example: https://github.com/mikepenz/action-junit-report/actions/runs/2717236074#summary-7464569272

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant