Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve cuBLAS performance by using a memory pool #1094

Merged
merged 4 commits into from
Apr 21, 2023
Merged

Improve cuBLAS performance by using a memory pool #1094

merged 4 commits into from
Apr 21, 2023

Commits on Apr 20, 2023

  1. Improve cuBLAS performance by using a memory pool

    @slaren
    slaren committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    e8797a9 View commit details
    Browse the repository at this point in the history

  2. Move cuda specific definitions to ggml-cuda.h/cu

    @slaren
    slaren committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    641e9a0 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. Add CXX flags to nvcc

    @slaren
    slaren committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    c832e7c View commit details
    Browse the repository at this point in the history

  2. Change memory pool synchronization mechanism to a spin lock 

    General code cleanup
    @slaren
    slaren committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    d774e05 View commit details
    Browse the repository at this point in the history