Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ggml : add RPC backend #761

Closed
wants to merge 9 commits into from
Closed

ggml : add RPC backend #761

wants to merge 9 commits into from

Commits on Mar 11, 2024

  1. Add RPC backend 

    The purpose of the RPC backend is to proxy all operations to another
host where they are implemented with one of the existing backends (e.g.
CUDA, Metal, etc.).
    @rgerganov
    rgerganov committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    a066e35 View commit details
    Browse the repository at this point in the history

  2. Support RPC backend in gpt-2

    @rgerganov
    rgerganov committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    3230ca1 View commit details
    Browse the repository at this point in the history

  3. Adress review comments

    @rgerganov
    rgerganov committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    f81b97a View commit details
    Browse the repository at this point in the history

  4. rpc : fix metal build + compile warnings

    @ggerganov
    ggerganov committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    37c50da View commit details
    Browse the repository at this point in the history

  5. Address review comments

    @rgerganov
    rgerganov committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    e29f972 View commit details
    Browse the repository at this point in the history

  6. Serialize tensor->nb

    @rgerganov
    rgerganov committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    b0ba299 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. gitignore : build-rpc

    @ggerganov
    ggerganov committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    89517df View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into HEAD

    @ggerganov
    ggerganov committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    d0f5a7c View commit details
    Browse the repository at this point in the history

  3. rpc : update backend interface changes

    @ggerganov
    ggerganov committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    cef92b4 View commit details
    Browse the repository at this point in the history