Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add new meta w2v2-conformer BERT-like model #28165

Merged
merged 77 commits into from
Jan 18, 2024
Merged

Add new meta w2v2-conformer BERT-like model #28165

merged 77 commits into from
Jan 18, 2024

Commits on Dec 19, 2023

  1. first commit

    @ylacombe
    ylacombe committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    96bd9b7 View commit details
    Browse the repository at this point in the history

  2. correct default value non causal

    @ylacombe
    ylacombe committed Dec 19, 2023
    Configuration menu
    Copy the full SHA
    d45e075 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. update config and modeling code

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    35193ab View commit details
    Browse the repository at this point in the history

  2. update converting checkpoint

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    730ee47 View commit details
    Browse the repository at this point in the history

  3. clean modeling and fix tests

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    ad75260 View commit details
    Browse the repository at this point in the history

  4. make style

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    95c6542 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'huggingface:main' into add-w2v2-shaw

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    7f52d83 View commit details
    Browse the repository at this point in the history

  6. add new config parameters to docstring

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    175f4d3 View commit details
    Browse the repository at this point in the history

  7. fix copied from statements

    @ylacombe
    ylacombe committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    40c3357 View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2023

  1. Apply suggestions from code review 

    Co-authored-by: Sanchit Gandhi <[email protected]>
    @ylacombe @sanchit-gandhi
    ylacombe and sanchit-gandhi committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    29e20ea View commit details
    Browse the repository at this point in the history

  2. make position_embeddings_type docstrings clearer

    @ylacombe
    ylacombe committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    07b34ff View commit details
    Browse the repository at this point in the history

  3. clean converting script

    @ylacombe
    ylacombe committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    c1f6ac4 View commit details
    Browse the repository at this point in the history

  4. remove function not used

    @ylacombe
    ylacombe committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    9792399 View commit details
    Browse the repository at this point in the history

  5. clean modeling file

    @ylacombe
    ylacombe committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    d267a7c View commit details
    Browse the repository at this point in the history

  6. apply suggestion for test file + add convert script to not_doctested

    @ylacombe
    ylacombe committed Dec 21, 2023
    Configuration menu
    Copy the full SHA
    d69d850 View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2024

  1. modify tests according to review - cleaner logic and more tests

    @ylacombe
    ylacombe committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    ca23f4e View commit details
    Browse the repository at this point in the history

  2. Apply nit suggestions from code review 

    Co-authored-by: amyeroberts <[email protected]>
    @ylacombe @amyeroberts
    ylacombe and amyeroberts committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    c7550cd View commit details
    Browse the repository at this point in the history

  3. add checker of valid position embeddings type

    @ylacombe
    ylacombe committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    1b132c6 View commit details
    Browse the repository at this point in the history

  4. instantiate new layer norm layer with the right eps

    @ylacombe
    ylacombe committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    e179499 View commit details
    Browse the repository at this point in the history

  5. fix freeze_feature_encoder since it can be None in some cases

    @ylacombe
    ylacombe committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    4848a26 View commit details
    Browse the repository at this point in the history

  6. add test same output in convert script

    @ylacombe
    ylacombe committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    0a8e2a9 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. restore wav2vec2conformer and add new model

    @ylacombe
    ylacombe committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    5d77490 View commit details
    Browse the repository at this point in the history

  2. create processor and FE + clean

    @ylacombe
    ylacombe committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    b5b0bd2 View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. add new model code

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    aecc8fe View commit details
    Browse the repository at this point in the history

  2. fix convert script and set default config parameters

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    1d78100 View commit details
    Browse the repository at this point in the history

  3. correct model id paths

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    f98e5ab View commit details
    Browse the repository at this point in the history

  4. make style

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    b8a386a View commit details
    Browse the repository at this point in the history

  5. make fix-copies and cleaning files

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    580fa3e View commit details
    Browse the repository at this point in the history

  6. fix copied from statements

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    a847b08 View commit details
    Browse the repository at this point in the history

  7. complete .md and fixe copies

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    0ededce View commit details
    Browse the repository at this point in the history

  8. clean convert script argument defaults

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    c0e92e2 View commit details
    Browse the repository at this point in the history

  9. fix config parameters docstrings

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    43dd379 View commit details
    Browse the repository at this point in the history

  10. fix config docstring

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    61162a7 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'huggingface:main' into add-w2v2-shaw

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    ae70620 View commit details
    Browse the repository at this point in the history

  12. add copied from and enrich FE tests

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    ad0b1a9 View commit details
    Browse the repository at this point in the history

  13. fix copied from and repo-consistency

    @ylacombe
    ylacombe committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    1d37cbb View commit details
    Browse the repository at this point in the history

Commits on Jan 5, 2024

  1. add autotokenizer

    @ylacombe
    ylacombe committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    73bf286 View commit details
    Browse the repository at this point in the history

  2. make test input length shorter and change docstring code

    @ylacombe
    ylacombe committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    ca5ec51 View commit details
    Browse the repository at this point in the history

  3. fix docstrings and copied from

    @ylacombe
    ylacombe committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    dbc53ab View commit details
    Browse the repository at this point in the history

  4. add add_adapter to ASR training example

    @ylacombe
    ylacombe committed Jan 5, 2024
    Configuration menu
    Copy the full SHA
    b18ad62 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. make testing of adapters more robust

    @ylacombe
    ylacombe committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    7d85679 View commit details
    Browse the repository at this point in the history

  2. adapt to multi adapter layers

    @ylacombe
    ylacombe committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    2ea024d View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. refactor input_values->input_features and remove w2v2-bert feature ex… 

    …tractor
    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    bcdd067 View commit details
    Browse the repository at this point in the history

  2. remove pretraining model

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    a17d2fa View commit details
    Browse the repository at this point in the history

  3. remove depreciated features and useless lines

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    2e6063d View commit details
    Browse the repository at this point in the history

  4. add copied from and ignore statements to modeling tests

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    78ef614 View commit details
    Browse the repository at this point in the history

  5. remove pretraining model #2

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    8a83831 View commit details
    Browse the repository at this point in the history

  6. change import in convert script

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    22c552f View commit details
    Browse the repository at this point in the history

  7. change default in convert script

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    9115615 View commit details
    Browse the repository at this point in the history

  8. update readme and remove useless line

    @ylacombe
    ylacombe committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    2b57096 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. Update tests/models/wav2vec2_bert/test_processor_wav2vec2_bert.py 

    Co-authored-by: amyeroberts <[email protected]>
    @ylacombe @amyeroberts
    ylacombe and amyeroberts committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    7db6c40 View commit details
    Browse the repository at this point in the history

  2. refactor BERT to Bert for consistency

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    87876a5 View commit details
    Browse the repository at this point in the history

  3. remove useless ignore copy statement

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    aaf64c1 View commit details
    Browse the repository at this point in the history

  4. add persistent to buffer in rotary

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    39b4ef1 View commit details
    Browse the repository at this point in the history

  5. add eps in LayerNorm init and remove copied from

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    7540037 View commit details
    Browse the repository at this point in the history

  6. add adapter activation parameters and add copied from statements

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    14f5fad View commit details
    Browse the repository at this point in the history

  7. Fix copied statements and add unitest.skip reasons

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    85e8865 View commit details
    Browse the repository at this point in the history

  8. add copied statement in test_processor

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    2efa94b View commit details
    Browse the repository at this point in the history

  9. refactor processor

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    42ee5ae View commit details
    Browse the repository at this point in the history

  10. make style

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    f347b14 View commit details
    Browse the repository at this point in the history

  11. replace numpy random by torch rand

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    632272a View commit details
    Browse the repository at this point in the history

  12. remove expected output CTC

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    0876dc9 View commit details
    Browse the repository at this point in the history

  13. Merge branch 'huggingface:main' into add-w2v2-shaw

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    8aa7bdf View commit details
    Browse the repository at this point in the history

  14. improve converting script with processor class

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    2f4cff3 View commit details
    Browse the repository at this point in the history

  15. Apply suggestions from code review 

    Co-authored-by: amyeroberts <[email protected]>
    @ylacombe @amyeroberts
    ylacombe and amyeroberts committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    1856710 View commit details
    Browse the repository at this point in the history

  16. remove gumbel class

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    a0e5ca2 View commit details
    Browse the repository at this point in the history

  17. remove tests related to previously deleted class

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    b5e7d70 View commit details
    Browse the repository at this point in the history

  18. Update src/transformers/models/wav2vec2_bert/configuration_wav2vec2_b… 

    …ert.py

Co-authored-by: amyeroberts <[email protected]>
    @ylacombe @amyeroberts
    ylacombe and amyeroberts committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    fc6dfc2 View commit details
    Browse the repository at this point in the history

  19. correct typos

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    ef1ad91 View commit details
    Browse the repository at this point in the history

  20. remove uused parameters

    @ylacombe
    ylacombe committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    f3d00e6 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. update processor to takes both text and audio

    @ylacombe
    ylacombe committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    849f3f5 View commit details
    Browse the repository at this point in the history

  2. update checkpoints

    @ylacombe
    ylacombe committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    7266710 View commit details
    Browse the repository at this point in the history

  3. update expected output and add ctc expected output

    @ylacombe
    ylacombe committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    07de02e View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. add label_attention_mask

    @ylacombe
    ylacombe committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    37dd941 View commit details
    Browse the repository at this point in the history

  2. replace pt with np in processor tests

    @ylacombe
    ylacombe committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    8b37745 View commit details
    Browse the repository at this point in the history

  3. fix typo

    @ylacombe
    ylacombe committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    7160906 View commit details
    Browse the repository at this point in the history

Commits on Jan 18, 2024

  1. revert to behaviour with labels_attention_mask

    @ylacombe
    ylacombe committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    c6ec6b1 View commit details
    Browse the repository at this point in the history