Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enhance autogptq backend to support VL models #1860

Merged
merged 7 commits into from
Mar 26, 2024
Merged

Enhance autogptq backend to support VL models #1860

merged 7 commits into from
Mar 26, 2024

Commits on Mar 21, 2024

  1. Enhance autogptq backend to support VL models

    @thiner
    thiner committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    a60642b View commit details
    Browse the repository at this point in the history

  2. update dependencies for autogptq

    @thiner
    thiner committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    7289cb6 View commit details
    Browse the repository at this point in the history

  3. remove redundant auto-gptq dependency

    @thiner
    thiner committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    55edeeb View commit details
    Browse the repository at this point in the history

  4. Convert base64 to image_url for Qwen-VL model

    Binghua Wu committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    e17e819 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. implemented model inference for qwen-vl

    Binghua Wu committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    597d98e View commit details
    Browse the repository at this point in the history

  2. remove user prompt from generated answer

    Binghua Wu committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    30685a6 View commit details
    Browse the repository at this point in the history

  3. fixed write image error

    Binghua Wu committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    afa16d3 View commit details
    Browse the repository at this point in the history