Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Offloading to cpu and disk #77

Merged
merged 4 commits into from
Sep 27, 2023
Merged

Offloading to cpu and disk #77

merged 4 commits into from
Sep 27, 2023

Commits on Sep 26, 2023

  1. Offload to cpu

    @s4rduk4r
    s4rduk4r committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    4f76ecb View commit details
    Browse the repository at this point in the history

  2. Clean

    @s4rduk4r
    s4rduk4r committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    91de3bf View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Rely on accelerate.dispatch_model() only

    @s4rduk4r
    s4rduk4r committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    ffaaa25 View commit details
    Browse the repository at this point in the history

  2. Fix apply_rotary_emb() to have both tensors on the same device

    @s4rduk4r
    s4rduk4r committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    841a231 View commit details
    Browse the repository at this point in the history