Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Model] SiglipVisionModel ported from transformers #6942

Merged
merged 24 commits into from
Aug 5, 2024
Merged

[Model] SiglipVisionModel ported from transformers #6942

merged 24 commits into from
Aug 5, 2024

Commits on Jul 30, 2024

  1. feat: initial siglip implementation

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    9222552 View commit details
    Browse the repository at this point in the history

  2. fix: typo fixed

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    5e09410 View commit details
    Browse the repository at this point in the history

  3. fix: change paligemma to use ported siglip

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    8af6456 View commit details
    Browse the repository at this point in the history

  4. fix: style fixed

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    c00edeb View commit details
    Browse the repository at this point in the history

  5. feat: modify paligemma to fully utilize siglip

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    db99a08 View commit details
    Browse the repository at this point in the history

  6. feat: sync model methods for paligemma

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    3e3b032 View commit details
    Browse the repository at this point in the history

  7. fix: style fix

    @ChristopherCho
    ChristopherCho committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    f04da2b View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2024

  1. fix: sync with transformers siglip

    @ChristopherCho
    ChristopherCho committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    b3ccec5 View commit details
    Browse the repository at this point in the history

  2. fix: style fix

    @ChristopherCho
    ChristopherCho committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    106e193 View commit details
    Browse the repository at this point in the history

  3. fix: faulty weight loading logic for vision model

    @ChristopherCho
    ChristopherCho committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    5b9242f View commit details
    Browse the repository at this point in the history

  4. feat: add various attention mechanisms

    @ChristopherCho
    ChristopherCho committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    3dc8ea0 View commit details
    Browse the repository at this point in the history

  5. fix: style update

    @ChristopherCho
    ChristopherCho committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    5afa010 View commit details
    Browse the repository at this point in the history

  6. fix: remove unnecessary comments

    @ChristopherCho
    ChristopherCho committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    7fdb13d View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. fix: remove unrequired docstring 

    Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
    @ChristopherCho @ywang96
    ChristopherCho and ywang96 authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    c47e54a View commit details
    Browse the repository at this point in the history

  2. fix: remove unrequired docstring 

    Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
    @ChristopherCho @ywang96
    ChristopherCho and ywang96 authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    cac1933 View commit details
    Browse the repository at this point in the history

  3. fix: detach vllm attention

    @ChristopherCho
    ChristopherCho committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    2d1aeec View commit details
    Browse the repository at this point in the history

  4. fix: remove vllm attention

    @ChristopherCho
    ChristopherCho committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    bb570c3 View commit details
    Browse the repository at this point in the history

  5. fix: revert vision tower weight loading

    @ChristopherCho
    ChristopherCho committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    dee55d0 View commit details
    Browse the repository at this point in the history

  6. fix: use basic SiglipAttention for now

    @ChristopherCho
    ChristopherCho committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    bffc385 View commit details
    Browse the repository at this point in the history

  7. fix: remove unnecessary weight loading logic

    @ChristopherCho
    ChristopherCho committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    681b36d View commit details
    Browse the repository at this point in the history

  8. cleanup

    @ywang96
    ywang96 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    fb4972d View commit details
    Browse the repository at this point in the history

  9. typing

    @ywang96
    ywang96 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    d15a299 View commit details
    Browse the repository at this point in the history

  10. update

    @ywang96
    ywang96 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    9ef79b9 View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'upstream/main' into siglip-support

    @ywang96
    ywang96 committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    54faf5d View commit details
    Browse the repository at this point in the history