-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Python updates with openssl300 #996
base: master
Are you sure you want to change the base?
Conversation
@dmacks concerning #920 (comment), which would obviously be superseded by this, the builds are using identical flags and order whether set up with
just as noted in #918 (comment). |
Test-building as we speak. Tools/Scripts/pathfix.py is a script that can fix all the #! lines. And it's written in python, so it's a nice Debian's got some useful-looking patches for py311 (I looked only at that one because it's a totally new package). Especially |
python39 throws warnings python39 and python310 (all I've tested so far) fail a self-test on 10.13:
which looks like python/cpython/issues/85326. Is it passing for you? Are you on a APFS disk rather than my HFS+? If so, then just need to have that test get skipped. Update: For this test, 311 also fails, 38 is clean. |
python38 looks good. In fact, the current (3.8.13-2) failed .deb validation:
which is resolved in this update. There are a bunch of |
Data point: 3.8-3.10 pass on 10.14.6. 3.11 hung on test_socket. When I disabled that test, 3.11 passed everything else |
I see some SyntaxError messages while byte-compiling. For python311:
For python310, the same one as python311, and also:
For python39, the same maintest.py and hello.py as python310, but test_foo.py is instead:
test2to3 is removed altogether as of 311ish (python/cpython/pull/26981) so we can ignore those (or maybe we should even nuke it?) |
Debian has an interesting packaging approach, where they move the tkinter component (and a few others) to a separately-built package (https://packages.debian.org/source/sid/python3-stdlib-extensions). That gets a heavy dependency (tcltk) out of the main pythonXX package, which can both help resolve some dep-cycles. And it also makes the python-interp package lighter, which is important if we are increasing our reliance on it as a build-tool for other packages. That shouldn't hold up things here, but it could be helpful in the future, and the jump to a new pythonXX is a cleaner time to start doing it than simply a new version or revision once we already have a given XX. I'll send it to Issues once this PR closes, but it relates to existing Debian patches, something already mentioned here. |
Yes, those are obviously not meant to be called directly without running them to
And even a |
On 12.6
|
The syntax error in _delim.py in 3.10 and 3.11 is python/cpython/issues/102033 |
Is this python/cpython/issues/97897 (whicih would specifcally affect OS X 12.x when using OS X 13.x SDK?) that seems like upstream fixes with 6d0a0191a4e5477bd843e62c24d7f3bcad4fd5fc ? |
Yes, that looks like the bug. Unfortunately, it hasn't been ported back to the 3.8 branch, and the patch doesn't apply cleanly (a lot of the |
On my 10.13:
It sounds like the problem is autoconf is detecting (for you) something that exists but doesn't actually work, whereas for me it isn't even detected and so the source does something else. Adding
|
I tried to hack the upstream mkfifoat patch to work on the 3.8 branch. The test still fails.
Adding For CompileScript:
$DIST_CONFIG_PARAMS exists, but is not defined anywhere. Would be interesting to see if macOS 11 has this issue to modify the conditional. |
That wouldn't be the first time I've seen XCode SDK at some point start defaulting to "next higher version" According to the bug-report, there's confusion when it builds for what appears to be available but then tries to run with (obviously) the current version. The advance here is that at least there was a compile-time warning about it, albeit one that didn't seem as dire as it actually is. |
DIST_CONFIG_PARAMS is used in some pythonXX builds, and I guess sits there inertly for when what it implemented was no longer needed. See ecbc060 |
The minimal fix for the _delim.py syntax-error in python310 and python311 is sobolevn/cpython@a930d37 (thanks upstream!) |
This PR is dragging out a bit, so I'm forking the python311 portion to #1002, where we can work on splitting off tk before this new lang-version package lands in public repo. Please do not merge the py11 packages of this PR. |
3.8 needs just I can cherry pick the individual commits from here, add the changes described. @dhomeier: thoughts? |
Co-authored by: Hanspeter Niederstrasser <[email protected]>
Co-authored by: Daniel Macks <[email protected]>
Thanks all for looking into the failures! I have tested all on 12.6; pushing the corresponding 3.11 fixes here as well so they may be later applied to #1002. |
@@ -37,7 +37,7 @@ BuildDepends: << | |||
readline8, | |||
sqlite3-dev (>= 3.30.1-1), | |||
openssl300-dev (>= 3.0.1-1), | |||
pkgconfig (>= 0.9.0-1), | |||
pkgconf, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ppkg-config? And fix $PKG_CONFIG down below to match?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have not tested this, but python310
did not report any errors of the kind in #996 (comment), so it's probably safe to switch as well.
pkg-config is fixed now, the issue was glib2 which I fixed a while back. |
So no more circular deps?? |
Getting a test failure in test_xml_etree, even bumping to latest 3.10.13:
Wonder if it's related to a libxml2 change (haven't looked yet). |
Or new expat (per https://www.linuxfromscratch.org/blfs/view/svn/general/python3.html) |
Python-upstream confirms there are test-failures due to the just-released expat-2.6.0 and has fixes. python/cpython#115133 |
What's left here (apart from expat fixes which are available 3.8-3.12 from upstream and python3.11 getting its own PR for Tk-icide) ? Some of pythons here use pkgconf (3.8, 3.9, 3.11) and others use ppkg-config (3.10). I never followed the discussion as to which was less dep heavy or what, but #923 suggests that others are moving towards pkgconf. |
Offloaded a separate tracking ticket for the expat issue (which also ponders what versions of pythonXX we should continue to support at all). |
The (mostly) current Python versions have not been updated for about a year; upgrading to the current patch/security releases and switching from openssl110 to openssl300. Also fixes a number of utility scripts to use the correct Fink python-pyNN. Builds tested with both pkgconfig and pkgconf; a number of network tests are hanging (as with earlier releases) on 10.14.6; on 13.2 everything building cleanly for arm64 and x86_64.
As 3.10 is also already on the second-to-last regular release, adding python311 as current version.