Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Drop interleave placement in QKV matrix #1013

Open
wants to merge 11 commits into
base: main
Choose a base branch
from
Open

Drop interleave placement in QKV matrix #1013

wants to merge 11 commits into from
+455 −312

Commits on Mar 5, 2024

  1. Drop interleaved placement in QKV

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    bff05e4 View commit details
    Browse the repository at this point in the history

  2. Update test for test_llama2_70b_conversion

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    0ed697f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into qkv_drop_interleave_placement

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    8e46dd5 View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Correct shapes for KV-cache

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    b286470 View commit details
    Browse the repository at this point in the history

  2. Always do .repeat_interleave for grouped queries in training mode.

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    60f2c93 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Test_convert_hf_checkpoint: test all branches

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    0f41eb4 View commit details
    Browse the repository at this point in the history

  2. test_convert_lit_checkpoint check all branches

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    e25fb2c View commit details
    Browse the repository at this point in the history

  3. qkv_reassemble instead of qkv_split

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    61c3265 View commit details
    Browse the repository at this point in the history

  4. convert_lit: test for qkv_reassemble

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    0e8b18f View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into qkv_drop_interleave_placement

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    c2323f7 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Merge branch 'main' into qkv_drop_interleave_placement

    @Andrei-Aksionov
    Andrei-Aksionov committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    089fc5c View commit details
    Browse the repository at this point in the history