Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Model] Adding support for MiniCPM-V #4087

Merged
merged 70 commits into from
Jul 25, 2024
Merged

[Model] Adding support for MiniCPM-V #4087

merged 70 commits into from
Jul 25, 2024

Commits on Apr 15, 2024

  1. minicpm-v

    @HwwwwwwwH
    HwwwwwwwH committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    caac38f View commit details
    Browse the repository at this point in the history

  2. fix format

    @HwwwwwwwH
    HwwwwwwwH committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    a619354 View commit details
    Browse the repository at this point in the history

  3. add minicpmv example

    @HwwwwwwwH
    HwwwwwwwH committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    6f7e0ef View commit details
    Browse the repository at this point in the history

  4. fix format

    @HwwwwwwwH
    HwwwwwwwH committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    75c2d31 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. add timm import hints

    @HwwwwwwwH
    HwwwwwwwH committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4b4c7f3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:HwwwwwwwH/vllm

    @HwwwwwwwH
    HwwwwwwwH committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    8e70b68 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    6c953a9 View commit details
    Browse the repository at this point in the history

  4. adapt to new vllm version

    @HwwwwwwwH
    HwwwwwwwH committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    189d28e View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. add timm dependency to requirements-common.txt, change examples/minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    af353f2 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. merge latest main

    @HwwwwwwwH
    HwwwwwwwH committed May 5, 2024
    Configuration menu
    Copy the full SHA
    1e88026 View commit details
    Browse the repository at this point in the history

  2. merge latest main

    @HwwwwwwwH
    HwwwwwwwH committed May 5, 2024
    Configuration menu
    Copy the full SHA
    4204a02 View commit details
    Browse the repository at this point in the history

  3. merge latest main

    @HwwwwwwwH
    HwwwwwwwH committed May 5, 2024
    Configuration menu
    Copy the full SHA
    8b63870 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Merge branch 'main' into minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed May 6, 2024
    Configuration menu
    Copy the full SHA
    cc64a0b View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Merge branch 'main' into minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed May 24, 2024
    Configuration menu
    Copy the full SHA
    0280936 View commit details
    Browse the repository at this point in the history

  2. minicpmv_2 init

    @HwwwwwwwH
    HwwwwwwwH committed May 24, 2024
    Configuration menu
    Copy the full SHA
    b01948c View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Make changes based on the review

    hezhihui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    0b1be33 View commit details
    Browse the repository at this point in the history

  2. Make changes based on the review

    hezhihui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    93bbc4c View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into minicpmv_2

    hezhihui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    a29df42 View commit details
    Browse the repository at this point in the history

  4. fix

    @HwwwwwwwH
    HwwwwwwwH committed May 27, 2024
    Configuration menu
    Copy the full SHA
    7724d0e View commit details
    Browse the repository at this point in the history

  5. fix:get model dtype from default_dtype

    hezhihui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    fe58513 View commit details
    Browse the repository at this point in the history

  6. delete redundant annotations

    hezhihui committed May 27, 2024
    Configuration menu
    Copy the full SHA
    c9aacd8 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Merge branch 'main' into minicpmv

    hezhihui committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    294a989 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. add test for mnicpmv

    hezhihui committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e90c326 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into minicpmv

    hezhihui committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    965829c View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. add minicpmv support in <get_full_image_text_prompt>

    hezhihui committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    51cf257 View commit details
    Browse the repository at this point in the history

  2. add test for minicpmv / fix bug in slice image / add minicpmv in get_… 

    …full_image_text_prompt
    hezhihui committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    fc2dcaf View commit details
    Browse the repository at this point in the history

  3. format for minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    81d4437 View commit details
    Browse the repository at this point in the history

  4. format minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    938a741 View commit details
    Browse the repository at this point in the history

  5. format minicpmv

    @HwwwwwwwH
    HwwwwwwwH committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    ff8499d View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. changed for image processor

    hezhihui committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    123bdf0 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. update processing minicpmv

    hezhihui committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    d9187c8 View commit details
    Browse the repository at this point in the history

  2. update processing minicpmv

    hezhihui committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    da4c965 View commit details
    Browse the repository at this point in the history

  3. merge new main 7.10.17:20

    hezhihui committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    833475b View commit details
    Browse the repository at this point in the history

  4. merge new main 7.10.17:20

    hezhihui committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    3cd25fa View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. complete test minicpmv

    hezhihui committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    3cc2eb7 View commit details
    Browse the repository at this point in the history

  2. update example of minicpmv

    hezhihui committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    976730f View commit details
    Browse the repository at this point in the history

  3. merge main

    hezhihui committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    6152d8e View commit details
    Browse the repository at this point in the history

  4. format

    hezhihui committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    edb98b5 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. add minicpmv2.5

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    69629a8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into minicpmv

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    223cc74 View commit details
    Browse the repository at this point in the history

  3. update example

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    d9e01f9 View commit details
    Browse the repository at this point in the history

  4. update example of minicpmv

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    2d16bbc View commit details
    Browse the repository at this point in the history

  5. update examles

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    4e427a8 View commit details
    Browse the repository at this point in the history

  6. format

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    bcaf90c View commit details
    Browse the repository at this point in the history

  7. add test for minicpmv

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    c13e506 View commit details
    Browse the repository at this point in the history

  8. add test for minicpmv

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    a8274f0 View commit details
    Browse the repository at this point in the history

  9. modify for merge

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    8de6dc8 View commit details
    Browse the repository at this point in the history

  10. delete redundant hints; decrease logprobs in test minicpmv

    hezhihui committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    71698d6 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. fix modelname of test_minicpmv.py

    hezhihui committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    cb6a581 View commit details
    Browse the repository at this point in the history

  2. adjust timm import

    hezhihui committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    a210080 View commit details
    Browse the repository at this point in the history

  3. format

    hezhihui committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    97e5747 View commit details
    Browse the repository at this point in the history

  4. Update minicpmv_example.py

    @HwwwwwwwH
    HwwwwwwwH authored Jul 22, 2024
    Configuration menu
    Copy the full SHA
    4352143 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. Merge branch 'main' into minicpmv

    hezhihui committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    a3de850 View commit details
    Browse the repository at this point in the history

  2. fix cuda memory exceeded while test minicpmv

    hezhihui committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    355ab8c View commit details
    Browse the repository at this point in the history

  3. get version

    hezhihui committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    c6d8ea5 View commit details
    Browse the repository at this point in the history

  4. add version

    hezhihui committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    e469f86 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into minicpmv

    hezhihui committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    8ba9a4b View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. fix test warnings

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    eb46f77 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into minicpmv

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    e8bfeac View commit details
    Browse the repository at this point in the history

  3. add NestedTensors & final

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    dc174d8 View commit details
    Browse the repository at this point in the history

  4. Fix type annotations

    @DarkLight1337
    DarkLight1337 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    f85d168 View commit details
    Browse the repository at this point in the history

  5. Apply patches inside model file to avoid changing existing code

    @DarkLight1337
    DarkLight1337 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    d79284a View commit details
    Browse the repository at this point in the history

  6. Whitespace

    @DarkLight1337
    DarkLight1337 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    107379a View commit details
    Browse the repository at this point in the history

  7. merge

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    7d1f0ff View commit details
    Browse the repository at this point in the history

  8. Merge branch 'minicpmv' of github.com:HwwwwwwwH/vllm into minicpmv

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    e3790d1 View commit details
    Browse the repository at this point in the history

  9. Fix conversion of nested inputs

    @DarkLight1337
    DarkLight1337 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    512a5a5 View commit details
    Browse the repository at this point in the history

  10. lint

    @DarkLight1337
    DarkLight1337 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    279abf8 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'vllm-project:main' into minicpmv

    @HwwwwwwwH
    HwwwwwwwH authored Jul 24, 2024
    Configuration menu
    Copy the full SHA
    feae37a View commit details
    Browse the repository at this point in the history

  12. fix openai server

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    ca9c8e3 View commit details
    Browse the repository at this point in the history

  13. Merge branch 'minicpmv' of github.com:HwwwwwwwH/vllm into minicpmv

    hezhihui committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    3523152 View commit details
    Browse the repository at this point in the history