-
-
Notifications
You must be signed in to change notification settings - Fork 30k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
gh-85160: Optimized singledispatchmethod access (noticeable improvement). #23213
Conversation
Thanks for taking this up! |
This PR is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 5 days |
Comment to avoid closure |
This PR is stale because it has been open for 30 days with no activity. |
@rhettinger sorry for bothering you but do you have enough bandwidth to review this or can you defer to someone else? |
Not sure if there is anything we should do to allow this to be reviewed |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
On my slow system more modest, but an improvement:
11.24
2.27
to
5.83
3.54
I not that this is built on 3.10.0a2+ so there maybe further speed improvements when 3.11/3.12 is released. So a worthwhile change.
Since this is something that’ll have observable effects on objects, should this be documented? If you’re introspecting your objects, or are say concerned about memory usage it might be surprising behaviour. |
@mental32 @AlexWaygood By accident I created an independent implementation of the singledispatchmethod improvement. In #106448 I added a performance comparison of this PR and the other one. I also added a test for the case of a class with slots (commit 4e068d4). Feel free to pull that one into this branch. Both branches give a performance improvement over current main. Hopefully one of them gets accepted. |
if self.attrname is not None: | ||
attrname = self.attrname | ||
|
||
try: | ||
obj.__dict__[attrname] = _method | ||
except AttributeError: | ||
pass # not all objects have __dict__ (e.g. class defines slots) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if self.attrname is not None: | |
attrname = self.attrname | |
try: | |
obj.__dict__[attrname] = _method | |
except AttributeError: | |
pass # not all objects have __dict__ (e.g. class defines slots) | |
if self.attrname is not None: | |
try: | |
obj.__dict__[self.attrname] = _method | |
except AttributeError: | |
pass # not all objects have __dict__ (e.g. class defines slots) |
@eendebakpt thank you for continuing with this! for any changes or merging that you would like to see done is it okay for me to say "do whatever you need to do :)" and defer to you? (including closing this PR if the other one is sufficient in perf improvements) I don't think I have the time to pay attention to this is all |
Closing in favour of #107148 (in which you have been listed as a co-author :) |
I benchmarked using the following code:
And got the following output:
I'm still curious if access could be further optimized clueless when it comes to ideas 😅
https://bugs.python.org/issue40988