Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ONNX BERT Example and Fixes #4757

Merged
merged 7 commits into from
Aug 11, 2020
Merged

Add ONNX BERT Example and Fixes #4757

merged 7 commits into from
Aug 11, 2020

Commits on Aug 11, 2020

  1. Initial implementation for mixed precision/loss scaler. Untested

    Thiago Crepaldi authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    bb694e9 View commit details
    Browse the repository at this point in the history

  2. Add Mixed precision/LossScaler + several fixes 

    Fix CUDA training
Add optimization_step into TrainStepInfo class
Refactor LRSCheduler to use optimization_step instead of step
Updated several default values at ORTTrainerOptions
Add initial Gradient Accumulation supported. Untested
Fix ONNX model post processing
Refactor unit tests
    Thiago Crepaldi authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    36ed5aa View commit details
    Browse the repository at this point in the history

  3. Add unit test for mixed precision and minor fixes

    Thiago Crepaldi authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    56b55db View commit details
    Browse the repository at this point in the history

  4. bert example amp dtype crash

    Rayan Krishnan authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    92a4eb2 View commit details
    Browse the repository at this point in the history

  5. bert toy example and fixes

    Rayan Krishnan authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    3966eeb View commit details
    Browse the repository at this point in the history

  6. minor refactor

    Rayan Krishnan authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    bdee9c3 View commit details
    Browse the repository at this point in the history

  7. bert test function comments

    Rayan Krishnan authored and Rayan Krishnan committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    7771258 View commit details
    Browse the repository at this point in the history