Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add FlashAttention #24

Merged
merged 25 commits into from
Mar 8, 2023
Merged

Add FlashAttention #24

merged 25 commits into from
Mar 8, 2023

Commits on Mar 8, 2023

  1. try install flash-attn

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    3a0f6f2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into flash-attn

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    2fe4a2a View commit details
    Browse the repository at this point in the history

  3. install from whl directly

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    887992d View commit details
    Browse the repository at this point in the history

  4. use prebuilt wheel

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    1600f53 View commit details
    Browse the repository at this point in the history

  5. add triton

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    3ccb0ca View commit details
    Browse the repository at this point in the history

  6. implement it

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    407829a View commit details
    Browse the repository at this point in the history

  7. add test

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    0ce8744 View commit details
    Browse the repository at this point in the history

  8. fix

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    d36750f View commit details
    Browse the repository at this point in the history

  9. fix

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    a3b1de7 View commit details
    Browse the repository at this point in the history

  10. fixes

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    4d0c3df View commit details
    Browse the repository at this point in the history

  11. more fixes

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    624ba7f View commit details
    Browse the repository at this point in the history

  12. fix another

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    3c0f637 View commit details
    Browse the repository at this point in the history

  13. fix

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    926afc5 View commit details
    Browse the repository at this point in the history

  14. updates

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    1dadafb View commit details
    Browse the repository at this point in the history

  15. try float16

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    1beb2aa View commit details
    Browse the repository at this point in the history

  16. try bf16

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    b2e953e View commit details
    Browse the repository at this point in the history

  17. downgrade triton

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    a58e59c View commit details
    Browse the repository at this point in the history

  18. fix docker images

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    c992064 View commit details
    Browse the repository at this point in the history

  19. CHANGELOG

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    4adf6bc View commit details
    Browse the repository at this point in the history

  20. adjust atol, rtol

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    3deaa40 View commit details
    Browse the repository at this point in the history

  21. restrict clusters

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    c8e8259 View commit details
    Browse the repository at this point in the history

  22. fix

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    1ca1782 View commit details
    Browse the repository at this point in the history

  23. add more GPU tests

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    771ce77 View commit details
    Browse the repository at this point in the history

  24. try on a100s only

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    e0e4d36 View commit details
    Browse the repository at this point in the history

  25. skip on the fly when no A100

    @epwalsh
    epwalsh committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    a3597cc View commit details
    Browse the repository at this point in the history