Meta-ticket: Make sagelib pip-installable in a conda environment

[mkoeppe]

The goal of this ticket is to make sagelib (i.e., subdirectory SAGEROOT/src) pip-installable when all required packages are provided by the conda distribution -- just through SAGEROOT/src/setup.py and completely bypassing all sage-the-distribution scripts (top-level SAGEROOT/Makefile and SAGEROOT/build.

In Sage 9.2, this already works after ./configure.

Tickets merged in Sage 9.2 or earlier:

• Install src/bin scripts by sagelib's setup.py, not make #21559: Move sage-the-distribution scripts from src/bin to build/bin
• Install src/bin/* scripts via setup.py (scripts, console_scripts) #21569: Install src/bin/* scripts via setup.py (scripts, console_scripts)
• Install SAGE_SRC/ext/ in package data of sage package by setup.py, not SAGE_LOCAL/share/sage/ext/ by build/make/Makefile #21785: Installation of SAGE_SRC/ext/ in SAGE_LOCAL/share/sage/ext/ should be done by setup.py, not build/make/Makefile

Additional steps for Sage 9.3:

• Add SAGE_ROOT/environment.yml for "conda env create -f". #28745: Add SAGEROOT/src/environment.yml - describes all conda packages needed for installing sagelib for doing sagelib development (this is a superset of SAGEROOT/environment.yml, also introduced in Add SAGE_ROOT/environment.yml for "conda env create -f". #28745)
• Fixes for the conda-for-Sage-developers installation method, add GH Actions workflow #30845 GH Actions: Add test for conda without SPKG
• Install sage-env-config as part of sage_conf #29850 Install sage-env-config as part of sage_conf; make sage-env-config optional
• Meta-ticket: Split sage-env into 5 to clean up sage configuration #21707: Meta-ticket: Split sage-env into 5 to clean up sage configuration

Optional steps:

• Move non-scripts of src/bin/ elsewhere (and also move their install location) #21570: Move non-scripts of src/bin/ elsewhere (and also move their install location)
• Make sure src/setup.py respects --prefix, --install-base, --root, --user #21573: Make sure src/setup.py respects --install-base and --root
• src/setup.py: Disentangle cleaning of stale installed files in build directory and in install directory #21654: src/setup.py: Disentangle cleaning of stale installed files in build directory and in install directory
• Testsuite for src/setup.py #21678: Testsuite for src/setup.py
• Support package_data-like of non-Python resource files in Python packages #22655: Support package_data-like of non-Python resource files in Python packages
• Rename SAGE_ROOT/build to SAGE_ROOT/sage-distro, SAGE_ROOT/src to SAGE_ROOT/sagelib #23747: Rename SAGE_ROOT/build to SAGE_ROOT/sage-distro, SAGE_ROOT/src to SAGE_ROOT/sagelib

(see also earlier task ticket #21507: Make sagelib a pip-installable Python source package, listed on PyPI.)

Depends on #28745

CC: @isuruf @saraedum @dimpase @embray @timokau @tscrim

Component: build

Keywords: conda, sd111

Issue created by migration from https://trac.sagemath.org/ticket/28752

[embray]

comment:2

Ticket retargeted after milestone closed

[mkoeppe]

Changed keywords from none to Anaconda

[mkoeppe]

Changed keywords from Anaconda to Anaconda, conda

[mkoeppe]

Changed keywords from Anaconda, conda to conda

[mkoeppe]

comment:7

This might work already with the pip-installable tarball generated by ./sage -sh -c build/pkgs/sagelib/spkg-src in #29950

[mkoeppe]

Changed keywords from conda to conda, sd111

[mkoeppe]

comment:16

Hoping we can make progress on this ticket this week - https://wiki.sagemath.org/days111

[mkoeppe]

As of 9.8, this works.
https://doc.sagemath.org/html/en/installation/conda.html#using-conda-to-provide-all-dependencies-for-the-sage-library-experimental