Add support for Python 3.11

[parasj]

Changes:

• Update Dockerfile to Python 3.11
• Test pytest on CI with Python 3.11
• Move development dependencies to separate file to improve compatibility

[phi-line]

what about:

poetry install --only dev

[parasj]

We have an issue that Poetry requires Python version compliance with all dev dependencies and will not allow specification of a different Python version.

There's an in progress PR to add support for this, but it won't be production-ready for a while: python-poetry/poetry#5740

Several dev dependencies have not been updated for Python 3.11, most notably pytype which requires python >=3.7.1<3.11.

Until that PR lands, an alternative solution is to extract development CLI dependencies into another file. Thoughts?

[phi-line]

I'm a little confused with the use of poetry in this project. I would opt for maintaining the pyproject.toml with groups for dev and gateway instead of using a combination of poetry, pip, and requirements.txts.

[parasj]

Package management is a bit confusing:

• docs/requirements.txt must exist for ReadTheDocs to install requirements in their build server
• scripts/requirements-gateway.txt contains a stripped down set of dependencies for the Docker image build, specifically ignoring CLI/API dependencies which would bloat the Docker package size. If I can only install the gateway dependencies without the base dependencies, this could move to only use poetry
• pip install -e . is used for development to install in editable mode. This is not supported by Poetry so a placeholder setup.py links pyproject.toml to pip. We may be able to remove setup.py with a newer poetry-core version, see [draft] Remove setup.py with editable support #640.
• pyproject.toml is the canonical source of build dependencies. We moved to poetry to improve the release process.

[phi-line]

Package management is a bit confusing

Thanks for the explanation!

[parasj]

@phi-line Thanks for the details feedback on these PRs. I just added you as a contributor to the project. Are you on the Skyplane Slack? https://join.slack.com/t/skyplaneworkspace/shared_invite/zt-1cxmedcuc-GwIXLGyHTyOYELq7KoOl6Q