Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Model] Initialize Phi-3-vision support #4986

Merged
merged 38 commits into from
Jun 18, 2024
Merged

[Model] Initialize Phi-3-vision support #4986

merged 38 commits into from
Jun 18, 2024

Commits on May 22, 2024

  1. init phi3v support

    @Isotr0py
    Isotr0py committed May 22, 2024
    Configuration menu
    Copy the full SHA
    251752c View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. make phi3v work

    @Isotr0py
    Isotr0py committed May 23, 2024
    Configuration menu
    Copy the full SHA
    70e7017 View commit details
    Browse the repository at this point in the history

  2. remove debug code

    @Isotr0py
    Isotr0py committed May 23, 2024
    Configuration menu
    Copy the full SHA
    618a2cb View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. remove dropout from Phi3ImageEmbedding

    @Isotr0py
    Isotr0py committed May 24, 2024
    Configuration menu
    Copy the full SHA
    ffb32fb View commit details
    Browse the repository at this point in the history

  2. clean code

    @Isotr0py
    Isotr0py committed May 24, 2024
    Configuration menu
    Copy the full SHA
    76e6f8e View commit details
    Browse the repository at this point in the history

  3. optimize code structure

    @Isotr0py
    Isotr0py committed May 24, 2024
    Configuration menu
    Copy the full SHA
    58330ba View commit details
    Browse the repository at this point in the history

  4. Add Phi3VImagePixelInputs

    @Isotr0py
    Isotr0py committed May 24, 2024
    Configuration menu
    Copy the full SHA
    b61c2be View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. refactor image embedding

    @Isotr0py
    Isotr0py committed May 26, 2024
    Configuration menu
    Copy the full SHA
    1e3e18c View commit details
    Browse the repository at this point in the history

  2. format phi3v_example

    @Isotr0py
    Isotr0py committed May 26, 2024
    Configuration menu
    Copy the full SHA
    591a9b8 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b8599fc View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. refactor phi3v

    @Isotr0py
    Isotr0py committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    2e5dc27 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    e7fe213 View commit details
    Browse the repository at this point in the history

  3. remove phi3v feature inputs

    @Isotr0py
    Isotr0py committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    1b1f3f2 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    1a9e43f View commit details
    Browse the repository at this point in the history

  2. refactor phi3v

    @Isotr0py
    Isotr0py committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    8db0d25 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. deprecate phi3v image_input

    @Isotr0py
    Isotr0py committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    7388bcd View commit details
    Browse the repository at this point in the history

  2. add phi3v test

    @Isotr0py
    Isotr0py committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    3f3d2b8 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. fix phi3v test

    @Isotr0py
    Isotr0py committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    0705a62 View commit details
    Browse the repository at this point in the history

  2. format code

    @Isotr0py
    Isotr0py committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    5f21d3f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    fe4e594 View commit details
    Browse the repository at this point in the history

  4. add phi3_v to get_full_image_text_prompt and test marker

    @Isotr0py
    Isotr0py committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    3b7f86a View commit details
    Browse the repository at this point in the history

  5. add docs

    @Isotr0py
    Isotr0py committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    ced2c3d View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. clear phi3v model implement

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    1d82bb1 View commit details
    Browse the repository at this point in the history

  2. ignore phi3v cpu test

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    4739c45 View commit details
    Browse the repository at this point in the history

  3. fix doc strings

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    59fe2c1 View commit details
    Browse the repository at this point in the history

  4. fix phi3v test flash_attn import

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    38ed4d9 View commit details
    Browse the repository at this point in the history

  5. fix phi3v test

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    d2fbecf View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    d99b684 View commit details
    Browse the repository at this point in the history

  7. add torchvision to requirements-test.txt

    @Isotr0py
    Isotr0py committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    2bbaecd View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. increase phi3v max_model_len to 2048

    @Isotr0py
    Isotr0py committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    ce62fad View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    4b242dd View commit details
    Browse the repository at this point in the history

  3. decrease phi3v max_tokens to 8

    @Isotr0py
    Isotr0py committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    1d78590 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    7a3ba90 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'vllm-project:main' into phi3v

    @Isotr0py
    Isotr0py committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    b95672f View commit details
    Browse the repository at this point in the history

  2. optimize image embedding and update requirements.txt

    @Isotr0py
    Isotr0py committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    da1392c View commit details
    Browse the repository at this point in the history

  3. remove changing input_ids to -1

    @Isotr0py
    Isotr0py committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    9c080be View commit details
    Browse the repository at this point in the history

  4. fix a typo and image embedding

    @Isotr0py
    Isotr0py committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    0cd9d26 View commit details
    Browse the repository at this point in the history

  5. update comment for phi3v

    @Isotr0py
    Isotr0py committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e77bb76 View commit details
    Browse the repository at this point in the history