Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding XeTLA FA implementation for all variants mentioned in the FA paper #2179

Closed
ESI-SYD opened this issue Sep 10, 2024 · 1 comment · Fixed by #2309, #2357 or #2367
Closed

Adding XeTLA FA implementation for all variants mentioned in the FA paper #2179

ESI-SYD opened this issue Sep 10, 2024 · 1 comment · Fixed by #2309, #2357 or #2367
Assignees
@ESI-SYD
Labels
codegen: attention enhancement New feature or request performance
Milestone
4.3 [Performance]...

Comments

@ESI-SYD
Copy link
Contributor

ESI-SYD commented Sep 10, 2024

  1. More shapes support.
  2. More causal support.
  3. Backward support.
@ESI-SYD ESI-SYD self-assigned this Sep 10, 2024
@ESI-SYD ESI-SYD linked a pull request Sep 23, 2024 that will close this issue
[Benchmarks] Add more variants in XeTLA FA implementation #2309
Merged
@ESI-SYD
Copy link
Contributor Author

ESI-SYD commented Sep 23, 2024

Item 1 & 2: PR under review.
Item 3: TBD.

@ESI-SYD ESI-SYD reopened this Sep 24, 2024
@ESI-SYD ESI-SYD mentioned this issue Sep 26, 2024
Merged
@vlad-penkin vlad-penkin linked a pull request Sep 26, 2024 that will close this issue
Add causal variant in fa benchmark #2357
Merged
whitneywhtsang pushed a commit that referenced this issue Sep 26, 2024
@ESI-SYD
Add causal variant in fa benchmark (#2357)
3f4b713 
Releated:
#2179

CI:
https://github.com/intel/intel-xpu-backend-for-triton/actions/runs/11047304993
@ESI-SYD ESI-SYD linked a pull request Sep 27, 2024 that will close this issue
Add XeTLA FA backward implementation to benchmark #2367
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ESI-SYD ESI-SYD

Labels
codegen: attention enhancement New feature or request performance
Projects
None yet
Milestone
4.3 [Performance] Tracking
3 participants
@whitneywhtsang @ESI-SYD @vlad-penkin