Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Add FA2 for all Bart-like #26722

Closed
wants to merge 31 commits into from
Closed

[WIP] Add FA2 for all Bart-like #26722

wants to merge 31 commits into from

Commits on Oct 10, 2023

  1. [FA2] Bart-like models

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    fbc715a View commit details
    Browse the repository at this point in the history

  2. make tests work

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    ce43f2a View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review

    @patrickvonplaten
    patrickvonplaten authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    2b79352 View commit details
    Browse the repository at this point in the history

  4. Apply suggestions from code review

    @patrickvonplaten
    patrickvonplaten authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    a70f9cf View commit details
    Browse the repository at this point in the history

  5. improve

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    be48a5c View commit details
    Browse the repository at this point in the history

  6. Merge branch 'add_fa2_bart' of https://github.com/huggingface/transfo… 

    …rmers into add_fa2_bart
    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    22b3e2e View commit details
    Browse the repository at this point in the history

  7. Update examples/research_projects/jax-projects/big_bird/bigbird_flax.py

    @patrickvonplaten
    patrickvonplaten authored Oct 10, 2023
    Configuration menu
    Copy the full SHA
    8e344ee View commit details
    Browse the repository at this point in the history

  8. improve further

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    8e35ac9 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'add_fa2_bart' of https://github.com/huggingface/transfo… 

    …rmers into add_fa2_bart
    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    7c66a63 View commit details
    Browse the repository at this point in the history

  10. fix bart

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    a070445 View commit details
    Browse the repository at this point in the history

  11. add FA to whisper

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    341b7c9 View commit details
    Browse the repository at this point in the history

  12. make fix copies whisper

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    cdf2190 View commit details
    Browse the repository at this point in the history

  13. correct more

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    ddad165 View commit details
    Browse the repository at this point in the history

  14. more

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    045f183 View commit details
    Browse the repository at this point in the history

  15. improve bart

    @patrickvonplaten
    patrickvonplaten committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    5a82297 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. merge conflicts

    @patrickvonplaten
    patrickvonplaten committed Oct 11, 2023
    Configuration menu
    Copy the full SHA
    3126d2f View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Merge branch 'main' of https://github.com/huggingface/transformers in… 

    …to add_fa2_bart
    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    b86528d View commit details
    Browse the repository at this point in the history

  2. improve flash attention

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    39f820d View commit details
    Browse the repository at this point in the history

  3. fix more

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    c4517f3 View commit details
    Browse the repository at this point in the history

  4. fix attn mask bug

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    f195c15 View commit details
    Browse the repository at this point in the history

  5. Fix all

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    c4488b9 View commit details
    Browse the repository at this point in the history

  6. rename to converter

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    2f99cea View commit details
    Browse the repository at this point in the history

  7. fix whisper

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d8ae461 View commit details
    Browse the repository at this point in the history

  8. Apply suggestions from code review

    @patrickvonplaten
    patrickvonplaten authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    c4fa0c9 View commit details
    Browse the repository at this point in the history

  9. add spec decoding

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    1ee2b6d View commit details
    Browse the repository at this point in the history

  10. Merge branch 'add_fa2_bart' of https://github.com/huggingface/transfo… 

    …rmers into add_fa2_bart
    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    fd880c9 View commit details
    Browse the repository at this point in the history

  11. Update src/transformers/models/bart/modeling_bart.py

    @patrickvonplaten
    patrickvonplaten authored Oct 24, 2023
    Configuration menu
    Copy the full SHA
    53f7700 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'add_fa2_bart' of https://github.com/huggingface/transfo… 

    …rmers into add_fa2_bart
    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    21a9735 View commit details
    Browse the repository at this point in the history

  13. correct more

    @patrickvonplaten
    patrickvonplaten committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    d16fde8 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Add all

    @patrickvonplaten
    patrickvonplaten committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    b6d2b65 View commit details
    Browse the repository at this point in the history

  2. get spec dec batch working

    @patrickvonplaten
    patrickvonplaten committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    b944f25 View commit details
    Browse the repository at this point in the history