DRAFT: Run main_tests only on various versions of macOS

[cclauss]

DRAFT: Experimental... No review is required.

Related to:

• python setup.py and the use of setup.py as a command line tool are deprecated #473
• ci.yml: Upgrade some jobs to run on macos-latest #467
• Test upgrade to macos-12. #392

macOS 11 on Intel

============================= test session starts ==============================
platform darwin -- Python 3.10.13, pytest-8.0.0, pluggy-1.4.0
rootdir: /Users/runner/work/hpy/hpy
plugins: xdist-3.5.0
created: 3/3 workers
3 workers [1175 items]

........................................................................ [  6%]
........................................................................ [ 12%]
........................................................................ [ 18%]
........................................................................ [ 24%]
........................................................................ [ 30%]
........................................................................ [ 36%]
........................................................................ [ 42%]
........................................................................ [ 49%]
...............s........................................................ [ 55%]
........................................................................ [ 61%]
........................................................................ [ 67%]
........................................................................ [ 73%]
.....ss................................................................. [ 79%]
........................................................................ [ 85%]
........................................................................ [ 91%]
........................................................................ [ 98%]
.......................                                                  [100%]
=============================== warnings summary ===============================
test/test_importing.py::TestImporting::test_importing_attributes[universal]
  /Users/runner/work/hpy/hpy/.tmpdir/popen-gw1/test_importing_attributes_univ0/mytest.py:9: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    from pkg_resources import resource_filename
[ ... ]
============ 1172 passed, 3 skipped, 1 warning in 219.66s (0:03:39) ============

macOS 12 on Intel

============================= test session starts ==============================
platform darwin -- Python 3.10.13, pytest-8.0.0, pluggy-1.4.0
rootdir: /Users/runner/work/hpy/hpy
plugins: xdist-3.5.0
created: 3/3 workers
3 workers [1175 items]

........................................................................ [  6%]
........................................................................ [ 12%]
........................................................................ [ 18%]
........................................................................ [ 24%]
........................................................................ [ 30%]
.............................................F.......................... [ 36%]
........................................................................ [ 42%]
........................................F............................... [ 49%]
........................................................................ [ 55%]
........................................................................ [ 61%]
...........ss........................................................... [ 67%]
........................................................................ [ 73%]
........................................................................ [ 79%]
......................................F................................. [ 85%]
..............................FF...FFFs................................. [ 91%]
........................................................................ [ 98%]
.......................                                                  [100%]
=================================== FAILURES ===================================
[ ... ]
======= 8 failed, 1164 passed, 3 skipped, 1 warning in 648.41s (0:10:48) =======

macOS 13 on Intel

============================= test session starts ==============================
platform darwin -- Python 3.10.13, pytest-8.0.0, pluggy-1.4.0
rootdir: /Users/runner/work/hpy/hpy
plugins: xdist-3.5.0
created: 4/4 workers
4 workers [1175 items]

........................................................................ [  6%]
........................................................................ [ 12%]
........................................................................ [ 18%]
........................................................................ [ 24%]
........................................................................ [ 30%]
........................................................................ [ 36%]
........................................................................ [ 42%]
........................................................................ [ 49%]
.............F.......................................................... [ 55%]
........................................................................ [ 61%]
........................................................................ [ 67%]
.........ss.......................................................F..... [ 73%]
........................................................................ [ 79%]
........................................................................ [ 85%]
..................................................................FFF... [ 91%]
FFFs.................................................................... [ 98%]
.......................                                                  [100%]
=================================== FAILURES ===================================
[ ... ]
======= 8 failed, 1164 passed, 3 skipped, 1 warning in 574.12s (0:09:34) =======

macOS 14 on M1

============================= test session starts ==============================
platform darwin -- Python 3.10.11, pytest-8.0.0, pluggy-1.4.0
rootdir: /Users/runner/work/hpy/hpy
plugins: xdist-3.5.0
created: 3/3 workers
3 workers [1175 items]

........................................................................ [  6%]
........................................................................ [ 12%]
.....................................................EEEE.EEE.E.EEEE.E.E [ 18%]
.EEE.E.................................................................. [ 24%]
........................................................................ [ 30%]
........................................................................ [ 36%]
......................................................................... [ 42%]
........................................................................ [ 49%]
........................................................................ [ 55%]
........................................................................ [ 61%]
........................................................................ [ 67%]
........................................................................ [ 73%]
.........................................ss............................. [ 79%]
........................................................................ [ 85%]
........................................................................ [ 92%]
........................................................................ [ 98%]
......................                                                   [100%]
==================================== ERRORS ====================================
[ ... ]
======= 1155 passed, 2 skipped, 1 warning, 18 errors in 81.51s (0:01:21) =======

[cclauss]

https://github.blog/changelog/2024-04-01-macos-14-sonoma-is-generally-available-and-the-latest-macos-runner-image