Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add masking of different samples in a long sequence for flash-attention mechanism #32875

Closed
wants to merge 5 commits into from
Closed

Add masking of different samples in a long sequence for flash-attention mechanism #32875

wants to merge 5 commits into from

Commits on Aug 19, 2024

  1. add masking of different samples in a long sequence for flash-attenti… 

    …on mechanism
    su.zhu committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    6e5f96e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/sz128/transformers

    su.zhu committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    9ad14ff View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. update data_collator

    su.zhu committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    d30b100 View commit details
    Browse the repository at this point in the history

  2. add unittest

    Your Name committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    23d2c69 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'huggingface:main' into mask-samples-in-a-long-sequence

    @sz128
    sz128 authored Aug 21, 2024
    Configuration menu
    Copy the full SHA
    6a64e0b View commit details
    Browse the repository at this point in the history