[ci][python3.11] Wheel build

[rickyyx]

What happened + What you expected to happen

Mac and Windows wheels for python3.11 are not supported yet:

• Mac: CI machines don't have python 3.11 installed
• Windows: Conda channels not supported.

Versions / Dependencies

master

Reproduction script

NA

Issue Severity

None

[rickyyx]

Looks like conda (which ray depends on for wheel building process) will be officially supportinh 3.11 in its up coming release. Will try to make ray work on 3.11 for non-linux once the conda release is out.

conda/conda#11170 (comment)

[ddelange]

just out of curiosity and willingness to help:

• is there a particular reason to use conda to build wheels?
• could you point me to the code?
• i set up a build with cibuildwheel before, did you also consider it? (it's from the python packaging authority and builds PEP conform on the official manylinux images)
  • the resulting wheels will cover mostly any machine and will have the widest possible compatibility (although being built on the most recent OS versions)

[rickyyx]

just out of curiosity and willingness to help:

• is there a particular reason to use conda to build wheels?

• could you point me to the code?

• i set up a build with cibuildwheel before, did you also consider it? (it's from the python packaging authority and builds PEP conform on the official manylinux images)

  • the resulting wheels will cover mostly any machine and will have the widest possible compatibility (although being built on the most recent OS versions)

I think it was more of a historical reason - I don't think it's a must-have dependency.

I believe the entry point for wheel building is here:

ray/.buildkite/pipeline.build.yml

Line 7 in 81a4a5e

- label: ":ferris_wheel: Wheels and Jars"

[ddelange]

Looks like conda (which ray depends on for wheel building process) will be officially supportinh 3.11 in its up coming release. Will try to make ray work on 3.11 for non-linux once the conda release is out.

conda/conda#11170 (comment)

@rickyyx support is released conda/conda@7ec97d6 🚀

[ddelange]

Hi @rickyyx 👋

I saw ray 2.5.0 just landed, still without win and mac wheels. Is there manual intervention needed from your side for this ticket?

[rickyyx]

Yes, @ddelange we are looking into this now. Should be able to support both win + mac and potentially docker images from Ray for python 3.11 in 2.6.

[ddelange]

for future reference the corresponding mac PR: #36185