Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path #8378

Merged
merged 5 commits into from
Sep 27, 2024
Merged

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path #8378

merged 5 commits into from
Sep 27, 2024

Commits on Sep 27, 2024

  1. Multi-Step Chunked-Prefill Support

    Varun Sundar Rabindranath committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    e37b9db View commit details
    Browse the repository at this point in the history

  2. review comments

    Varun Sundar Rabindranath committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    89e790c View commit details
    Browse the repository at this point in the history

  3. Update selected_token_indices directly

    Varun Sundar Rabindranath committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    d874ce6 View commit details
    Browse the repository at this point in the history

  4. make can_append_slots assert stronger

    Varun Sundar Rabindranath committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    b4650b6 View commit details
    Browse the repository at this point in the history

  5. format

    Varun Sundar Rabindranath committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7e8f66b View commit details
    Browse the repository at this point in the history