Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[transform] tow level tilings for m dimension in large k schedule #970

Merged
merged 1 commit into from
Jan 19, 2023

Conversation

wyzero
Copy link
Collaborator

@wyzero wyzero commented Jan 18, 2023

some performance numbers (on aliyun g6r ECS instance, single thread):

shape (M,N,K) ACL(ms) small k schedule large k schedule(ms) transform/ACL
(24,768,3072) 2.83 3.96 2.97 95.3%
(128,768,3072) 14.5 17.4 15.1 96.0%
(256,768,3072) 28.9 34.2 30.1 96.0%
(512,768,3072) 57.7 67.9 60.1 96.0%
(1024,768,3072) 116.8 136.3 122.1 95.7%
(2048,768,3072) 235.6 270.6 245.3 96.0%
(24,3072, 768) 2.85 3.45 3.02 94.4%
(512,3072, 768) 57.7 62.3 60.5 95.4%
(24,2304, 768) 2.12 2.55 2.29 92.6%
(512,2304, 768) 43.4 46.9 45.3 95.8%
(24,768, 768) 0.725 0.846 0.736 98.5%
(512,768, 768) 14.5 15.7 15.1 96.0%
(24,1024, 1024) 1.30 1.35 1.33 97.7%
(1024,1024, 1024) 52.3 55.8 54.2 96.5%

to #787

@wyzero wyzero requested a review from qiuxiafei January 18, 2023 08:13
Copy link
Collaborator

@qiuxiafei qiuxiafei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good job! We seem close to acl.

@wyzero wyzero merged commit a21c0f7 into alibaba:main Jan 19, 2023
@wyzero wyzero deleted the features/wenyi_fix branch January 19, 2023 01:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants