pip, wheel, setuptools: Make wheels available in SAGE_SPKG_WHEELS

[mkoeppe]

From #30913:

Currently, pip, wheel, and setuptools are installed without making wheels available in SAGE_SPKG_WHEELS.

In this ticket, we make wheels available in SAGE_SPKG_WHEELS. For the case of setuptools, we create a new spkg setuptools_wheel that takes care of it (it depends on wheel).

This is so that after installation, we have a complete set of wheels for all Python packages installed by the Sage distribution. This allows users to create a venv by installing a compatible set of wheels (whose compiled extensions use the configured libraries in SAGE_LOCAL and the system). The most robust way of doing so is by disabling the use of PyPI (pip install --no-index) so that no incompatible wheels can leak in. (This can be tested using #30913.)

As PEP 517 packages (packages with a pyproject.toml, such as pplpy) are built using build isolation (without access to already installed packages), they need access to their build system packages such as wheel and setuptools. When use of PyPI is disabled, this relies on distributions (either source or wheel) to be available otherwise. On this ticket, we make them available as wheels. (We make pip available as a wheel for completeness.)

CC: @videlec @tobiasdiez @jhpalmieri @kliem

Component: build

Author: Matthias Koeppe

Branch/Commit: 1d19802

Reviewer: John Palmieri

Issue created by migration from https://trac.sagemath.org/ticket/31045

[mkoeppe]

Branch: u/mkoeppe/pip__wheel__setuptools__make_wheels_or_source_archives_available_in_sage_spkg_wheels

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

New commits:

1d19802

Build and store wheels for setuptools, pip, wheel

[mkoeppe]

Commit: 1d19802

[tobiasdiez]

comment:4

Just out of interest, what is the use case behind "when we don't allow use of PyPI.", i.e. why would you want to do this?

[mkoeppe]

comment:5

Mainly it's a way to guarantee a fully functional build using only the given version constraints (in install-requires and pyprojects.toml).

[mkoeppe]

comment:6

Critical for completing the goal of user-defined venvs in Sage 9.3.

[mkoeppe]

comment:9

Expanded the description, needs review

[jhpalmieri]

Reviewer: John Palmieri

[jhpalmieri]

comment:10

This looks okay to me.

[mkoeppe]

comment:11

Thank you!

[vbraun]

Changed branch from u/mkoeppe/pip__wheel__setuptools__make_wheels_or_source_archives_available_in_sage_spkg_wheels to 1d19802