Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add fused_multi_transformer op to optimize transformer generation performance #41814

Merged
merged 11 commits into from
Apr 26, 2022
Merged

Add fused_multi_transformer op to optimize transformer generation performance #41814

merged 11 commits into from
Apr 26, 2022

Commits on Apr 20, 2022

  1. add fused multi transformer

    @wangxicoding
    wangxicoding committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    8e1d170 View commit details
    Browse the repository at this point in the history

  2. fuse kernel

    @wangxicoding
    wangxicoding committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    ee8d2b5 View commit details
    Browse the repository at this point in the history

  3. add timestep

    @wangxicoding
    wangxicoding committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    1e5ff12 View commit details
    Browse the repository at this point in the history

  4. generation cachekv context

    @wangxicoding
    wangxicoding committed Apr 20, 2022
    Configuration menu
    Copy the full SHA
    31b0cb3 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2022

  1. add fused_multi_transformer to incubate

    @wangxicoding
    wangxicoding committed Apr 21, 2022
    Configuration menu
    Copy the full SHA
    f243fcc View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2022

  1. fix ci, add doc

    @wangxicoding
    wangxicoding committed Apr 22, 2022
    Configuration menu
    Copy the full SHA
    c69e2eb View commit details
    Browse the repository at this point in the history

  2. Fuse layer_norm and add_bias_input between layers (#4)

    @ZzSean
    ZzSean authored Apr 22, 2022
    Configuration menu
    Copy the full SHA
    00fa94c View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2022

  1. tmp fix precison problem

    @wangxicoding
    wangxicoding committed Apr 24, 2022
    Configuration menu
    Copy the full SHA
    6d60346 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2022

  1. add FusedMultiTransformer and add model parallel test

    @wangxicoding
    wangxicoding committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    5466283 View commit details
    Browse the repository at this point in the history

  2. remove attn dropout

    @wangxicoding
    wangxicoding committed Apr 25, 2022
    Configuration menu
    Copy the full SHA
    c2b1d43 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2022

  1. fix doc, fix ci

    @wangxicoding
    wangxicoding committed Apr 26, 2022
    1 Configuration menu
    Copy the full SHA
    e40c080 View commit details
    Browse the repository at this point in the history