Script to convert TAP to GHA workflow commands

[richvdh]

I plan to wire this into the github actions workflow, to make it easier to see
what broke.

[callahad]

I wonder if we should look for GITHUB_ACTIONS being set in the environment, and if so, log the error in a format that it will detect?

E.g., print ("::error::#$number: $description\n");

[richvdh]

Ahh I looked for a document like that, and failed to find one.

I think it makes sense for this to be GHA-specific, rather that having magic based on the environment. I'll have a go at this.

[callahad]

Output looks good to me. Wonder if this should live here or in Synapse where it's easier to iterate on, but 🤷.

Wonder if the grouping is strictly necessary, but it doesn't hurt.

I have a stripped down PR running at matrix-org/synapse#10090 which I'll re-start until it naturally hits a failure just so we can have a "real" example of how this script behaves.

[anoadragon453]

Wonder if this should live here or in Synapse where it's easier to iterate on, but shrug.

It can be useful for other homeserver implementations, so should probably live in the Sytest repo.

[callahad]

Actually, one requested change: could this return a non-0 exit code when failures are detected?

[callahad]

For context, this is what the output from this script looks like 🎉

[richvdh]

Wonder if this should live here or in Synapse where it's easier to iterate on, but shrug.

It can be useful for other homeserver implementations, so should probably live in the Sytest repo.

Yup absolutely this. Likewise, I can't see other test frameworks being silly enough to write TAP output.

[richvdh]

Actually, one requested change: could this return a non-0 exit code when failures are detected?

your wish is my command. If you're happy with this can you mash the merge button?