Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Qingtaoli/dsl kernel #1

Open
wants to merge 49 commits into
base: dsl_kernel
Choose a base branch
from
Open

Qingtaoli/dsl kernel #1

wants to merge 49 commits into from

Conversation

QingtaoLi1
Copy link
Owner

Just for looking.

@QingtaoLi1
Comment out dup init func. Remove a magic path.
c27d587
@QingtaoLi1
Fix an error and add arch param.
3ffbe55
@QingtaoLi1
Results correct for matmul and fused linear.
3b5907a
@QingtaoLi1
Add LlamaRMSNorm (with compiler error).
ba12c4a
@QingtaoLi1
Update some examples.
ecd2726
@QingtaoLi1
Add rotary embedding.
4c77d32
@QingtaoLi1
Mix some forward expressions.
671823d
@QingtaoLi1
Make rmsnorm roughly correct (precision to be checked).
88a1f71
@QingtaoLi1
Fix LlamaRMSNorm precision.
00d529c
@QingtaoLi1
Complete validity and efficiency tests.
62396bd
@QingtaoLi1
Compute hashkey by not only ir.
998cf2f
@QingtaoLi1
Add warmup steps.
af5f5b0
@QingtaoLi1
Mix some kernels to speedup.
2d58ac1
@QingtaoLi1
Add RotaryEmbedding and check correct and precision.
1454a56
@QingtaoLi1
Add a separated code set to run without compiling.
9bae404
@QingtaoLi1
.
19f7be5
@QingtaoLi1
Add a new directory to make pip package. Test successfully.
5271065
@QingtaoLi1
Update param.
ee7323f
@QingtaoLi1
Add V100 kernels.
ef292c3
@QingtaoLi1
Add V100 (1024, 4096/8192).
2d91b0f
@QingtaoLi1
.
7509311
@QingtaoLi1
Add __init__ in V100 kernel.
6f4f669
@QingtaoLi1
Add A6000.
f01225d
@QingtaoLi1
Add A100 (1024,).
1de25cc
@QingtaoLi1
Update pip package.
77be7a7
@QingtaoLi1
Add a shell file to instruct how to completely install the package.
7fe0314
@QingtaoLi1
Update test.py.
7d74177
@QingtaoLi1
Update test.py.
a61ed9e
@QingtaoLi1
Add wheel file.
c6eb73e
@QingtaoLi1
Adjust rmsnorm input order.
b36dfec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@QingtaoLi1