-
Notifications
You must be signed in to change notification settings - Fork 22.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update sparse semi-structured linear operator #104608
Conversation
[ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/104608
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 58206bc: This comment was automatically generated by Dr. CI and updates every 15 minutes. |
ghstack-source-id: 379592d0bd623e5406e3b323b76ad1053103c7cd Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
Just removed the code doing dense->(sparse,meta) conversion, thus sparse semi-structured linear operator simplified (renamed, for consistency, too). |
ghstack-source-id: 8129f2aaefe68e8b8d20f90c2a7df87e187c4454 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: 0f87cf5922e7c4b1fe733f50cbd627d072f0ea11 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: 64542b7286697baff825977c941db833ab9219f9 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: 21c50a18fea6990437f99a4f0b2aba1cb7532a80 Pull Request resolved: #104608
ghstack-source-id: 21c50a18fea6990437f99a4f0b2aba1cb7532a80 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: ce61dc5e4f111301db1307528d8e4488afd80112 Pull Request resolved: #104608
ghstack-source-id: ce61dc5e4f111301db1307528d8e4488afd80112 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: f5f44ede724d761a608a736e84934ae64467e683 Pull Request resolved: #104608
ghstack-source-id: f5f44ede724d761a608a736e84934ae64467e683 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: f6305175b1584807988dc4fd3ac9b60d0dd8cabb Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: cff55ce35a9967f05ef0229d876db0ab364bd1ab Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
@@ -300,7 +300,7 @@ To use these ops, simply pass the output of ``to_sparse_semi_structured(tensor)` | |||
>>> torch.allclose(c, torch.mm(a_sparse, b)) | |||
True | |||
|
|||
Under the hood, SparseSemiStructuredTensor will call ``torch._structured_sparse_linear`` for accelerated inference using CUTLASS sparse kernels. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can remove this entirely. We don't document private functions.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixed.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
See small comments, otherwise this is fine.
ghstack-source-id: 0f3a2b6620a2fcd5652828e48a5e086bfeb7b519 Pull Request resolved: #104608
cc nikitaved pearu cpuhrsch amjames bhosmer [ghstack-poisoned]
ghstack-source-id: c3eb18fd8c02210f308fc3bd948bb74ce6ba79b1 Pull Request resolved: #104608
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Stack from ghstack (oldest at bottom):
cc @nikitaved @pearu @cpuhrsch @amjames @bhosmer