Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AIR] HuggingFaceTrainer&Predictor implementation #23876

Merged
merged 89 commits into from
Apr 29, 2022
Merged

[AIR] HuggingFaceTrainer&Predictor implementation #23876

merged 89 commits into from
Apr 29, 2022

Commits on Apr 7, 2022

  1. WIP

    @Yard1
    Yard1 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    b72c722 View commit details
    Browse the repository at this point in the history

  2. WIP

    @Yard1
    Yard1 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    9a0b41e View commit details
    Browse the repository at this point in the history

  3. WIP

    @Yard1
    Yard1 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    5ca35b0 View commit details
    Browse the repository at this point in the history

  4. WIP

    @Yard1
    Yard1 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    f8e153a View commit details
    Browse the repository at this point in the history

  5. Make datasets arg mandatory

    @Yard1
    Yard1 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    240e661 View commit details
    Browse the repository at this point in the history

  6. WIP

    @Yard1
    Yard1 committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    196905a View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    d73991e View commit details
    Browse the repository at this point in the history

  2. Add docs

    @Yard1
    Yard1 committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    f6e9daf View commit details
    Browse the repository at this point in the history

  3. WIP

    @Yard1
    Yard1 committed Apr 11, 2022
    Configuration menu
    Copy the full SHA
    55633ef View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    e94d55d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    587f8ad View commit details
    Browse the repository at this point in the history

  3. HuggingFaceTrainer

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    3152272 View commit details
    Browse the repository at this point in the history

  4. Add basic example

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    7b19a01 View commit details
    Browse the repository at this point in the history

  5. Remove notebook

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    0a0223e View commit details
    Browse the repository at this point in the history

  6. Doc

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    ec83f90 View commit details
    Browse the repository at this point in the history

  7. Doc

    @Yard1
    Yard1 committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    66cef4a View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2022

  1. Better example

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    347ba0b View commit details
    Browse the repository at this point in the history

  2. Lint

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    c58ec5f View commit details
    Browse the repository at this point in the history

  3. Typo fix

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    5d252d8 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    22b7812 View commit details
    Browse the repository at this point in the history

  5. _checkpoint_manager_cls

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    0fc3a04 View commit details
    Browse the repository at this point in the history

  6. Improve checkpointing

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    28ae105 View commit details
    Browse the repository at this point in the history

  7. cleanup checkpoint

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    3263bd4 View commit details
    Browse the repository at this point in the history

  8. Sort imports

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    35cc359 View commit details
    Browse the repository at this point in the history

  9. Remove monkey patching for callbacks

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    7920c22 View commit details
    Browse the repository at this point in the history

  10. Move to utils

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    552d0fe View commit details
    Browse the repository at this point in the history

  11. Lint fix, check transformers version

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    ac2bd18 View commit details
    Browse the repository at this point in the history

  12. Bump transformers version in requirements

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    af271cf View commit details
    Browse the repository at this point in the history

  13. Fix checkpoint loading

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    542e007 View commit details
    Browse the repository at this point in the history

  14. Add HuggingFacePredictor

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    04a6d1d View commit details
    Browse the repository at this point in the history

  15. Fix predictor columns

    @Yard1
    Yard1 committed Apr 13, 2022
    Configuration menu
    Copy the full SHA
    d4f98cf View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2022

  1. Address some comments

    @Yard1
    Yard1 committed Apr 14, 2022
    Configuration menu
    Copy the full SHA
    e9ba551 View commit details
    Browse the repository at this point in the history

  2. add tune checkpoint id

    @Yard1
    Yard1 committed Apr 14, 2022
    Configuration menu
    Copy the full SHA
    d55f843 View commit details
    Browse the repository at this point in the history

  3. Update python/ray/ml/utils/huggingface_utils.py

    @Yard1
    Yard1 authored Apr 14, 2022
    Configuration menu
    Copy the full SHA
    e36bfce View commit details
    Browse the repository at this point in the history

  4. Use an external func

    @Yard1
    Yard1 committed Apr 14, 2022
    Configuration menu
    Copy the full SHA
    0d7f14d View commit details
    Browse the repository at this point in the history

  5. Rename huggingface_basic_language_modelling_example.py to huggingface… 

    …_basic_language_modeling_example.py
    @Yard1
    Yard1 authored Apr 14, 2022
    Configuration menu
    Copy the full SHA
    890f84e View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 14, 2022
    Configuration menu
    Copy the full SHA
    aa9e0e2 View commit details
    Browse the repository at this point in the history

  7. Do not override __new__

    @Yard1
    Yard1 committed Apr 14, 2022
    Configuration menu
    Copy the full SHA
    fd815f6 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    3de7302 View commit details
    Browse the repository at this point in the history

  2. HuggingFacePredictor inherits from TorchPredictor

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    d020fca View commit details
    Browse the repository at this point in the history

  3. Move utils to hf folder

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    9cdadb7 View commit details
    Browse the repository at this point in the history

  4. Inheritance tweak

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    13ac55f View commit details
    Browse the repository at this point in the history

  5. Doc fix

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    7f3403a View commit details
    Browse the repository at this point in the history

  6. Improve tensorize

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    c3d8050 View commit details
    Browse the repository at this point in the history

  7. Fix docs

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    d4851e4 View commit details
    Browse the repository at this point in the history

  8. Stack after all

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    3185009 View commit details
    Browse the repository at this point in the history

  9. Add tests, predictor work

    @Yard1
    Yard1 committed Apr 19, 2022
    Configuration menu
    Copy the full SHA
    814b889 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    d49739f View commit details
    Browse the repository at this point in the history

  2. Lint

    @Yard1
    Yard1 committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    25d3bda View commit details
    Browse the repository at this point in the history

  3. Make tests work

    @Yard1
    Yard1 committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    8a74340 View commit details
    Browse the repository at this point in the history

  4. Add n>1 gpus warning

    @Yard1
    Yard1 committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    97d99ac View commit details
    Browse the repository at this point in the history

  5. Raise exception instead of warning

    @Yard1
    Yard1 committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    2188e40 View commit details
    Browse the repository at this point in the history

  6. Add predictor doc

    @Yard1
    Yard1 committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    6028d4f View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    95c792e View commit details
    Browse the repository at this point in the history

  2. Bump train requirements

    @Yard1
    Yard1 committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    7699f79 View commit details
    Browse the repository at this point in the history

  3. Lint

    @Yard1
    Yard1 committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    e852959 View commit details
    Browse the repository at this point in the history

  4. Add more mocks to docs

    @Yard1
    Yard1 committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    a66da31 View commit details
    Browse the repository at this point in the history

  5. Put data into file

    @Yard1
    Yard1 committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    f2627bb View commit details
    Browse the repository at this point in the history

  6. Add predictor test, fix small issues

    @Yard1
    Yard1 committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    5617524 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2022

  1. CI fixes

    @Yard1
    Yard1 committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    5f7fda1 View commit details
    Browse the repository at this point in the history

  2. Fix docs

    @Yard1
    Yard1 committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    bdc7387 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    a948482 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    6302ae4 View commit details
    Browse the repository at this point in the history

  2. Expand predictor

    @Yard1
    Yard1 committed Apr 26, 2022
    Configuration menu
    Copy the full SHA
    3ef8d1b View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review 

    Co-authored-by: Amog Kamsetty <[email protected]>
    @Yard1 @amogkam
    Yard1 and amogkam authored Apr 26, 2022
    Configuration menu
    Copy the full SHA
    c0da17e View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2022

  1. WIP

    @Yard1
    Yard1 committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    8c7a6eb View commit details
    Browse the repository at this point in the history

  2. Complete refactor

    @Yard1
    Yard1 committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    2d5f94e View commit details
    Browse the repository at this point in the history

  3. Clarify

    @Yard1
    Yard1 committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    8f085b4 View commit details
    Browse the repository at this point in the history

  4. Remove shuffle mention from docstring

    @Yard1
    Yard1 committed Apr 27, 2022
    Configuration menu
    Copy the full SHA
    2126556 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2022

  1. Merge branch 'master' into hf_trainer_implementation

    @Yard1
    Yard1 committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    89e5d55 View commit details
    Browse the repository at this point in the history

  2. Doc fix

    @Yard1
    Yard1 committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    0abab40 View commit details
    Browse the repository at this point in the history

  3. Upgrade torch version

    @Yard1
    Yard1 committed Apr 28, 2022
    Configuration menu
    Copy the full SHA
    3c69367 View commit details
    Browse the repository at this point in the history

  4. Update requirements_ml_docker.txt

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    dc4fb41 View commit details
    Browse the repository at this point in the history

  5. Update requirements_dl.txt

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    2c83878 View commit details
    Browse the repository at this point in the history

  6. Revert

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    58d8136 View commit details
    Browse the repository at this point in the history

  7. Revert

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    790a31e View commit details
    Browse the repository at this point in the history

  8. Update huggingface_basic_language_modeling_example.py

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    3ed8551 View commit details
    Browse the repository at this point in the history

  9. Update huggingface_basic_language_modeling_example.py

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    3bc93e4 View commit details
    Browse the repository at this point in the history

  10. Update huggingface_basic_language_modeling_example.py

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    e48794c View commit details
    Browse the repository at this point in the history

  11. Merge branch 'ray-project:master' into hf_trainer_implementation

    @Yard1
    Yard1 authored Apr 28, 2022
    Configuration menu
    Copy the full SHA
    79ad5b4 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2022

  1. Update custom_directives.py

    @Yard1
    Yard1 authored Apr 29, 2022
    Configuration menu
    Copy the full SHA
    42d99dd View commit details
    Browse the repository at this point in the history

  2. Update custom_directives.py

    @Yard1
    Yard1 authored Apr 29, 2022
    Configuration menu
    Copy the full SHA
    cf322b2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'ray-project:master' into hf_trainer_implementation

    @Yard1
    Yard1 authored Apr 29, 2022
    Configuration menu
    Copy the full SHA
    27f1d70 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'ray-project:master' into hf_trainer_implementation

    @Yard1
    Yard1 authored Apr 29, 2022
    Configuration menu
    Copy the full SHA
    1757ff1 View commit details
    Browse the repository at this point in the history

  5. Better checkpoint detection

    @Yard1
    Yard1 committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    71d2f1b View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review 

    Co-authored-by: Amog Kamsetty <[email protected]>
    @Yard1 @amogkam
    Yard1 and amogkam authored Apr 29, 2022
    Configuration menu
    Copy the full SHA
    3b45939 View commit details
    Browse the repository at this point in the history

  7. Add context

    @Yard1
    Yard1 committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    b26f67f View commit details
    Browse the repository at this point in the history

  8. Load huggingface checkpoint to staticmethod

    @Yard1
    Yard1 committed Apr 29, 2022
    Configuration menu
    Copy the full SHA
    2c8f48c View commit details
    Browse the repository at this point in the history

  9. Update python/ray/ml/examples/huggingface/huggingface_basic_language_… 

    …modeling_example.py
    @amogkam
    amogkam authored Apr 29, 2022
    Configuration menu
    Copy the full SHA
    b549dbe View commit details
    Browse the repository at this point in the history