Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[LLM] support Qwen2 #8338

Merged
merged 51 commits into from
Jun 11, 2024
Merged

[LLM] support Qwen2 #8338

merged 51 commits into from
Jun 11, 2024

Commits on Apr 17, 2024

  1. add Qwen2Moe

    @DrownFish19
    DrownFish19 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    36ab9a7 View commit details
    Browse the repository at this point in the history

  2. update default config

    @DrownFish19
    DrownFish19 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    3913e11 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'paddlenlp/develop' into dev_add_qwen1.5… 

    …-moe
    @DrownFish19
    DrownFish19 committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    0aa1aca View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. update QWen2Moe modeling

    @DrownFish19
    DrownFish19 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    a29e90d View commit details
    Browse the repository at this point in the history

  2. update modeling

    @DrownFish19
    DrownFish19 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    d514dff View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. update ckpt name

    @DrownFish19
    DrownFish19 committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    1e98323 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored Apr 22, 2024
    Configuration menu
    Copy the full SHA
    f81bb43 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. support same prefix model name for auto modeling

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    37dd2d5 View commit details
    Browse the repository at this point in the history

  2. update qwen2moe testing

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    d12938a View commit details
    Browse the repository at this point in the history

  3. update qwen2moe modeling and config

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    8cc49fc View commit details
    Browse the repository at this point in the history

  4. update qwen2moe import

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    9c8222e View commit details
    Browse the repository at this point in the history

  5. fix mlp hidden_size

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    4d6ff87 View commit details
    Browse the repository at this point in the history

  6. update qkv bias convert

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    f350a2f View commit details
    Browse the repository at this point in the history

  7. update modeling init_weight

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    c53690d View commit details
    Browse the repository at this point in the history

  8. update _get_name_mappings

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    9d12995 View commit details
    Browse the repository at this point in the history

  9. update _get_name_mappings and _init_weight

    @DrownFish19
    DrownFish19 committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    dba0f74 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. add tokenizer

    @DrownFish19
    DrownFish19 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    e487606 View commit details
    Browse the repository at this point in the history

  2. update modeling

    @DrownFish19
    DrownFish19 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    cd9c753 View commit details
    Browse the repository at this point in the history

  3. update modeling

    @DrownFish19
    DrownFish19 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    10407c4 View commit details
    Browse the repository at this point in the history

  4. update tokenizer

    @DrownFish19
    DrownFish19 committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    beb0f4c View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. update modeling and tokenizer

    @DrownFish19
    DrownFish19 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    beefee9 View commit details
    Browse the repository at this point in the history

  2. fix index_add_ error

    @DrownFish19
    DrownFish19 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    82ba345 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored Apr 28, 2024
    Configuration menu
    Copy the full SHA
    d522ee4 View commit details
    Browse the repository at this point in the history

  4. fix

    @DrownFish19
    DrownFish19 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    4a1b2e3 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'dev_add_qwen1.5-moe' of github.com:DrownFish19/PaddleNL… 

    …P into dev_add_qwen1.5-moe
    @DrownFish19
    DrownFish19 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    526a9db View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored May 6, 2024
    Configuration menu
    Copy the full SHA
    0c9d5ec View commit details
    Browse the repository at this point in the history

  2. update comments

    @DrownFish19
    DrownFish19 committed May 6, 2024
    Configuration menu
    Copy the full SHA
    2bb3aba View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. update lora weights

    @DrownFish19
    DrownFish19 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    f203983 View commit details
    Browse the repository at this point in the history

  2. add todo

    @DrownFish19
    DrownFish19 committed May 10, 2024
    Configuration menu
    Copy the full SHA
    58af3ec View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored May 29, 2024
    Configuration menu
    Copy the full SHA
    c766eb5 View commit details
    Browse the repository at this point in the history

  2. update Copyright

    @DrownFish19
    DrownFish19 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    5ddc326 View commit details
    Browse the repository at this point in the history

  3. update Moe to MoE

    @DrownFish19
    DrownFish19 committed May 29, 2024
    Configuration menu
    Copy the full SHA
    de1db67 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored May 30, 2024
    Configuration menu
    Copy the full SHA
    10a194c View commit details
    Browse the repository at this point in the history

  2. update comment

    @DrownFish19
    DrownFish19 committed May 30, 2024
    Configuration menu
    Copy the full SHA
    87f0276 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. update Copyright

    @DrownFish19
    DrownFish19 committed May 31, 2024
    Configuration menu
    Copy the full SHA
    8d9970b View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored Jun 3, 2024
    Configuration menu
    Copy the full SHA
    89994a6 View commit details
    Browse the repository at this point in the history

  2. update readme and json

    @DrownFish19
    DrownFish19 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    d57a5b1 View commit details
    Browse the repository at this point in the history

  3. update __init__.py

    @DrownFish19
    DrownFish19 committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    bfb65a1 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. add qwen-1.5

    @DrownFish19
    DrownFish19 committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    4b96dd0 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. update QWen to Qwen

    @DrownFish19
    DrownFish19 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    b274f12 View commit details
    Browse the repository at this point in the history

  2. update Qwen2MoE to Qwen2Moe

    @DrownFish19
    DrownFish19 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    1054f06 View commit details
    Browse the repository at this point in the history

  3. update readme

    @DrownFish19
    DrownFish19 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    056b04c View commit details
    Browse the repository at this point in the history

  4. update qwen2moe sft and lora json

    @DrownFish19
    DrownFish19 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    ab08c17 View commit details
    Browse the repository at this point in the history

  5. update qwen2moe base name

    @DrownFish19
    DrownFish19 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    ad02fdc View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. update qwen2

    @DrownFish19
    DrownFish19 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    23e39fc View commit details
    Browse the repository at this point in the history

  2. update

    @DrownFish19
    DrownFish19 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    36b3897 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Merge branch 'PaddlePaddle:develop' into dev_add_qwen1.5-moe

    @DrownFish19
    DrownFish19 authored Jun 11, 2024
    Configuration menu
    Copy the full SHA
    6455445 View commit details
    Browse the repository at this point in the history

  2. update readme

    @DrownFish19
    DrownFish19 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    b140df6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev_add_qwen1.5-moe' of github.com:DrownFish19/PaddleNL… 

    …P into dev_add_qwen1.5-moe
    @DrownFish19
    DrownFish19 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    c08c9a6 View commit details
    Browse the repository at this point in the history

  4. update readme

    @DrownFish19
    DrownFish19 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    e6de5f3 View commit details
    Browse the repository at this point in the history

  5. update readme

    @DrownFish19
    DrownFish19 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    48ae2ab View commit details
    Browse the repository at this point in the history