-
Notifications
You must be signed in to change notification settings - Fork 26.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[core
] Integrate Flash attention 2 in most used models
#25598
[core
] Integrate Flash attention 2 in most used models
#25598
Commits on Aug 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8bb77a1 - Browse repository at this point
Copy the full SHA 8bb77a1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e18421 - Browse repository at this point
Copy the full SHA 2e18421View commit details -
Configuration menu - View commit details
-
Copy full SHA for fe5795e - Browse repository at this point
Copy the full SHA fe5795eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bd15e2 - Browse repository at this point
Copy the full SHA 4bd15e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 49fe318 - Browse repository at this point
Copy the full SHA 49fe318View commit details -
Merge branch 'add-flash-attn-2' of https://github.com/younesbelkada/t…
…ransformers into HEAD
Configuration menu - View commit details
-
Copy full SHA for f5d440b - Browse repository at this point
Copy the full SHA f5d440bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 50491e8 - Browse repository at this point
Copy the full SHA 50491e8View commit details
Commits on Aug 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7df78c0 - Browse repository at this point
Copy the full SHA 7df78c0View commit details
Commits on Aug 23, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0e30d13 - Browse repository at this point
Copy the full SHA 0e30d13View commit details -
Configuration menu - View commit details
-
Copy full SHA for ad8b905 - Browse repository at this point
Copy the full SHA ad8b905View commit details
Commits on Sep 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 3c31f10 - Browse repository at this point
Copy the full SHA 3c31f10View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2628bf3 - Browse repository at this point
Copy the full SHA 2628bf3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 56d0b49 - Browse repository at this point
Copy the full SHA 56d0b49View commit details -
Configuration menu - View commit details
-
Copy full SHA for 20d1b37 - Browse repository at this point
Copy the full SHA 20d1b37View commit details -
Configuration menu - View commit details
-
Copy full SHA for a82f1ca - Browse repository at this point
Copy the full SHA a82f1caView commit details -
Configuration menu - View commit details
-
Copy full SHA for c72e8ff - Browse repository at this point
Copy the full SHA c72e8ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 66823f9 - Browse repository at this point
Copy the full SHA 66823f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41f8f3d - Browse repository at this point
Copy the full SHA 41f8f3dView commit details -
Configuration menu - View commit details
-
Copy full SHA for a64a1a9 - Browse repository at this point
Copy the full SHA a64a1a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 67e3fc2 - Browse repository at this point
Copy the full SHA 67e3fc2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8444ab6 - Browse repository at this point
Copy the full SHA 8444ab6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b1c2df - Browse repository at this point
Copy the full SHA 8b1c2dfView commit details -
Configuration menu - View commit details
-
Copy full SHA for c3ebcd2 - Browse repository at this point
Copy the full SHA c3ebcd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c212d8 - Browse repository at this point
Copy the full SHA 1c212d8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4618701 - Browse repository at this point
Copy the full SHA 4618701View commit details -
Configuration menu - View commit details
-
Copy full SHA for 85ec946 - Browse repository at this point
Copy the full SHA 85ec946View commit details -
Merge branch 'add-flash-attn-2' of https://github.com/younesbelkada/t…
…ransformers into add-flash-attn-2
Configuration menu - View commit details
-
Copy full SHA for 2248f20 - Browse repository at this point
Copy the full SHA 2248f20View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0881ced - Browse repository at this point
Copy the full SHA 0881cedView commit details -
Merge branch 'add-flash-attn-2' of https://github.com/younesbelkada/t…
…ransformers into HEAD
Configuration menu - View commit details
-
Copy full SHA for a8a1b2d - Browse repository at this point
Copy the full SHA a8a1b2dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2be3e03 - Browse repository at this point
Copy the full SHA 2be3e03View commit details -
Configuration menu - View commit details
-
Copy full SHA for b6d3e58 - Browse repository at this point
Copy the full SHA b6d3e58View commit details -
Configuration menu - View commit details
-
Copy full SHA for b47e85c - Browse repository at this point
Copy the full SHA b47e85cView commit details -
Configuration menu - View commit details
-
Copy full SHA for db8bd64 - Browse repository at this point
Copy the full SHA db8bd64View commit details
Commits on Sep 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 58848ab - Browse repository at this point
Copy the full SHA 58848abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3f73557 - Browse repository at this point
Copy the full SHA 3f73557View commit details -
Update src/transformers/modeling_utils.py
Co-authored-by: Patrick von Platen <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for baae736 - Browse repository at this point
Copy the full SHA baae736View commit details -
Configuration menu - View commit details
-
Copy full SHA for 55f6140 - Browse repository at this point
Copy the full SHA 55f6140View commit details -
Configuration menu - View commit details
-
Copy full SHA for 10d5c1b - Browse repository at this point
Copy the full SHA 10d5c1bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3fb221a - Browse repository at this point
Copy the full SHA 3fb221aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a931aeb - Browse repository at this point
Copy the full SHA a931aebView commit details -
Configuration menu - View commit details
-
Copy full SHA for 68a1204 - Browse repository at this point
Copy the full SHA 68a1204View commit details -
Configuration menu - View commit details
-
Copy full SHA for 36e0d6e - Browse repository at this point
Copy the full SHA 36e0d6eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2beeb68 - Browse repository at this point
Copy the full SHA 2beeb68View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7b5da2c - Browse repository at this point
Copy the full SHA 7b5da2cView commit details -
Configuration menu - View commit details
-
Copy full SHA for b99a582 - Browse repository at this point
Copy the full SHA b99a582View commit details -
Configuration menu - View commit details
-
Copy full SHA for adaed45 - Browse repository at this point
Copy the full SHA adaed45View commit details
Commits on Sep 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7f06af6 - Browse repository at this point
Copy the full SHA 7f06af6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d36c6f - Browse repository at this point
Copy the full SHA 2d36c6fView commit details -
Configuration menu - View commit details
-
Copy full SHA for a663fa4 - Browse repository at this point
Copy the full SHA a663fa4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9d3693f - Browse repository at this point
Copy the full SHA 9d3693fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 65ae59c - Browse repository at this point
Copy the full SHA 65ae59cView commit details
Commits on Sep 11, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 43185b5 - Browse repository at this point
Copy the full SHA 43185b5View commit details -
Configuration menu - View commit details
-
Copy full SHA for c61157e - Browse repository at this point
Copy the full SHA c61157eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2f17792 - Browse repository at this point
Copy the full SHA 2f17792View commit details -
Configuration menu - View commit details
-
Copy full SHA for 65c3861 - Browse repository at this point
Copy the full SHA 65c3861View commit details -
Configuration menu - View commit details
-
Copy full SHA for 165a503 - Browse repository at this point
Copy the full SHA 165a503View commit details
Commits on Sep 13, 2023
-
Update src/transformers/models/falcon/modeling_falcon.py
Co-authored-by: Arthur <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 5abc702 - Browse repository at this point
Copy the full SHA 5abc702View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5069e4a - Browse repository at this point
Copy the full SHA 5069e4aView commit details -
Merge branch 'add-flash-attn-2' of https://github.com/younesbelkada/t…
…ransformers into add-flash-attn-2
Configuration menu - View commit details
-
Copy full SHA for 11400d8 - Browse repository at this point
Copy the full SHA 11400d8View commit details -
Configuration menu - View commit details
-
Copy full SHA for ace7939 - Browse repository at this point
Copy the full SHA ace7939View commit details -
Configuration menu - View commit details
-
Copy full SHA for fe9b16d - Browse repository at this point
Copy the full SHA fe9b16dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6174c06 - Browse repository at this point
Copy the full SHA 6174c06View commit details -
Configuration menu - View commit details
-
Copy full SHA for acfc954 - Browse repository at this point
Copy the full SHA acfc954View commit details -
Configuration menu - View commit details
-
Copy full SHA for 33a0f62 - Browse repository at this point
Copy the full SHA 33a0f62View commit details -
Configuration menu - View commit details
-
Copy full SHA for ee8ba20 - Browse repository at this point
Copy the full SHA ee8ba20View commit details -
Configuration menu - View commit details
-
Copy full SHA for e28fb0b - Browse repository at this point
Copy the full SHA e28fb0bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 025727c - Browse repository at this point
Copy the full SHA 025727cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8f7e400 - Browse repository at this point
Copy the full SHA 8f7e400View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3259392 - Browse repository at this point
Copy the full SHA 3259392View commit details -
Configuration menu - View commit details
-
Copy full SHA for 57a077b - Browse repository at this point
Copy the full SHA 57a077bView commit details -
Configuration menu - View commit details
-
Copy full SHA for e62b0b8 - Browse repository at this point
Copy the full SHA e62b0b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7419438 - Browse repository at this point
Copy the full SHA 7419438View commit details
Commits on Sep 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 3ba5e98 - Browse repository at this point
Copy the full SHA 3ba5e98View commit details -
Configuration menu - View commit details
-
Copy full SHA for 585e463 - Browse repository at this point
Copy the full SHA 585e463View commit details
Commits on Sep 19, 2023
-
Update docs/source/en/perf_infer_gpu_one.md
Co-authored-by: Arthur <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for ec0f8b9 - Browse repository at this point
Copy the full SHA ec0f8b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e5ea35 - Browse repository at this point
Copy the full SHA 3e5ea35View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4bb1bc5 - Browse repository at this point
Copy the full SHA 4bb1bc5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ea4633 - Browse repository at this point
Copy the full SHA 3ea4633View commit details -
Configuration menu - View commit details
-
Copy full SHA for b67c21e - Browse repository at this point
Copy the full SHA b67c21eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b73557 - Browse repository at this point
Copy the full SHA 5b73557View commit details -
Configuration menu - View commit details
-
Copy full SHA for 48e3bcf - Browse repository at this point
Copy the full SHA 48e3bcfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0461384 - Browse repository at this point
Copy the full SHA 0461384View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d72a66 - Browse repository at this point
Copy the full SHA 8d72a66View commit details -
Revert "revert changes on dockerfile"
This reverts commit 8d72a66.
Configuration menu - View commit details
-
Copy full SHA for 73b2f07 - Browse repository at this point
Copy the full SHA 73b2f07View commit details -
Configuration menu - View commit details
-
Copy full SHA for fb7654c - Browse repository at this point
Copy the full SHA fb7654cView commit details
Commits on Sep 20, 2023
-
Apply suggestions from code review
Co-authored-by: Lysandre Debut <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for a737bde - Browse repository at this point
Copy the full SHA a737bdeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 80951ae - Browse repository at this point
Copy the full SHA 80951aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6f7ff42 - Browse repository at this point
Copy the full SHA 6f7ff42View commit details -
Configuration menu - View commit details
-
Copy full SHA for 257a633 - Browse repository at this point
Copy the full SHA 257a633View commit details -
Update src/transformers/testing_utils.py
Co-authored-by: Lysandre Debut <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 360da70 - Browse repository at this point
Copy the full SHA 360da70View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1d91bc4 - Browse repository at this point
Copy the full SHA 1d91bc4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8ecab97 - Browse repository at this point
Copy the full SHA 8ecab97View commit details
Commits on Sep 21, 2023
-
Apply suggestions from code review
Co-authored-by: Arthur <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 7c5720f - Browse repository at this point
Copy the full SHA 7c5720fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 28b82e2 - Browse repository at this point
Copy the full SHA 28b82e2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 84b5793 - Browse repository at this point
Copy the full SHA 84b5793View commit details -
Configuration menu - View commit details
-
Copy full SHA for 949172f - Browse repository at this point
Copy the full SHA 949172fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 825c7e0 - Browse repository at this point
Copy the full SHA 825c7e0View commit details
Commits on Sep 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 1af232c - Browse repository at this point
Copy the full SHA 1af232cView commit details -
Configuration menu - View commit details
-
Copy full SHA for d7f16c5 - Browse repository at this point
Copy the full SHA d7f16c5View commit details