gh-110276: No longer ignore PROFILE_TASK failure silently

[vstinner]

• Issue: test_unicode always fails during a PGO-optimised build (because it does not exist) #110276

---

📚 Documentation preview 📚: https://cpython-previews--110295.org.readthedocs.build/

[AlexWaygood]

This PR only touches the Makefile but, as I said in #110276 (comment), the problem also exists on Windows: I found locally that the test would fail but the build would still succeed. Windows builds don't use the Makefile.

[vstinner]

This PR only touches the Makefile but, as I said in #110276 (comment), the problem also exists on Windows: I found locally that the test would fail but the build would still succeed. Windows builds don't use the Makefile.

PCbuild doesn't use Makefile nor PROFILE_TASK. If you consider that PCbuild also deserves a fix, please go ahead :-) I'm not comfortable to touch PCbuild/ directory.

[vstinner]

I suppose that the Windows code path is this line of PCbuild\build.bat:

    call "%dir%\..\python.bat" %pgo_job%

No idea how to catch an error in BATCH :-)

[vstinner]

!buildbot PGO

[bedevere-bot]

🤖 New build scheduled with the buildbot fleet by @vstinner for commit a26ba58 🤖

The command will test the builders whose names match following regular expression: PGO

The builders matched are:

• s390x RHEL8 LTO + PGO PR
• PPC64LE RHEL8 LTO + PGO PR
• PPC64LE Fedora Stable LTO + PGO PR
• aarch64 Debian Clang LTO + PGO PR
• AMD64 Debian PGO PR
• AMD64 Fedora Stable LTO + PGO PR
• aarch64 Fedora Stable LTO + PGO PR
• s390x Fedora LTO + PGO PR
• PPC64LE RHEL7 LTO + PGO PR
• s390x RHEL7 LTO + PGO PR
• aarch64 RHEL8 LTO + PGO PR
• AMD64 RHEL8 LTO + PGO PR
• AMD64 RHEL7 LTO + PGO PR

[vstinner]

AMD64 RHEL8 LTO + PGO PR failed: https://buildbot.python.org/all/#/builders/378/builds/1199

FAIL: test_selflink (test.test_glob.SymlinkLoopGlobTests.test_selflink)

It's an unrelated failure: #109959

[mdboom]

This seems like it may have broken PGO on macOS: #110313

[vstinner]

This seems like it may have broken PGO on macOS: #110313

Aha, interesting bug.

[bedevere-app]

GH-111950 is a backport of this pull request to the 3.12 branch.

[JacobHenner]

Now that test failures are no longer ignored, Python 3.13 builds on Rocky Linux 8 are now failing: #125067