-
Notifications
You must be signed in to change notification settings - Fork 321
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update FE to 1.5.2 and miscellaneous fixes (#975)
* update FE to 1.5.2 Signed-off-by: Charlene Yang <[email protected]> * enable unfused attn for cross attn Signed-off-by: Charlene Yang <[email protected]> * unify logging info Signed-off-by: Charlene Yang <[email protected]> * omit cudnn 9.1.1 and 9.2.1 due to bugs Signed-off-by: Charlene Yang <[email protected]> * set cu_seqlens_padded to cu_seqlens by default Signed-off-by: Charlene Yang <[email protected]> * replace variable name with ctx.variable Signed-off-by: Charlene Yang <[email protected]> * Revert "enable unfused attn for cross attn" This reverts commit bc49f14. Signed-off-by: Charlene Yang <[email protected]> * restrict cudnn version for fp8 tests Signed-off-by: Charlene Yang <[email protected]> * remove mha_fill for FP8 Signed-off-by: Charlene Yang <[email protected]> * Revert "remove mha_fill for FP8" This reverts commit 83ffc44114dc6eb3d426d742b6c5a4d34805ec04. Signed-off-by: Charlene Yang <[email protected]> * lower cudnn version to >=9.2.1 Signed-off-by: Charlene Yang <[email protected]> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Charlene Yang <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
- Loading branch information
1 parent
7326af9
commit 67b6743
Showing
8 changed files
with
66 additions
and
32 deletions.
There are no files selected for viewing
Submodule cudnn-frontend
updated
113 files
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters