Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Pipeline inference] Combine kvcache with pipeline inference #4938

Merged
merged 14 commits into from
Oct 27, 2023
Merged

[Pipeline inference] Combine kvcache with pipeline inference #4938

merged 14 commits into from
Oct 27, 2023

Commits on Oct 20, 2023

  1. merge kvcache with pipeline inference and refactor the code structure

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    4ab4520 View commit details
    Browse the repository at this point in the history

  2. support ppsize > 2

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    c63ff2b View commit details
    Browse the repository at this point in the history

  3. refactor pipeline code

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    50979bd View commit details
    Browse the repository at this point in the history

  4. do pre-commit

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    49817d0 View commit details
    Browse the repository at this point in the history

  5. modify benchmark

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    8881c9c View commit details
    Browse the repository at this point in the history

  6. fix bench mark

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    e18cead View commit details
    Browse the repository at this point in the history

  7. polish code

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    5bd9106 View commit details
    Browse the repository at this point in the history

  8. add docstring and update readme

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    bd00085 View commit details
    Browse the repository at this point in the history

  9. refactor the code

    @FoolPlayer
    FoolPlayer committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    64c1f4f View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. fix some logic bug of ppinfer

    @FoolPlayer
    FoolPlayer committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    037bda0 View commit details
    Browse the repository at this point in the history

  2. polish readme

    @FoolPlayer
    FoolPlayer committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    df5f00a View commit details
    Browse the repository at this point in the history

  3. fix typo

    @FoolPlayer
    FoolPlayer committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    85671be View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. skip infer test

    @FoolPlayer
    FoolPlayer committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    c28ee57 View commit details
    Browse the repository at this point in the history

  2. skip infer test

    @FoolPlayer
    FoolPlayer committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    0ef477e View commit details
    Browse the repository at this point in the history