Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add BLIP #20716

Merged
merged 103 commits into from
Dec 21, 2022
Merged

Add BLIP #20716

merged 103 commits into from
Dec 21, 2022

Commits on Dec 8, 2022

  1. add new model like

    @younesbelkada
    younesbelkada committed Dec 8, 2022
    Configuration menu
    Copy the full SHA
    edda537 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2022

  1. add v1

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    afbc3bc View commit details
    Browse the repository at this point in the history

  2. v1

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    d21be07 View commit details
    Browse the repository at this point in the history

  3. v1

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    365fe14 View commit details
    Browse the repository at this point in the history

  4. vision encoder logits match

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    4538c24 View commit details
    Browse the repository at this point in the history

  5. v2

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    d6ff6e0 View commit details
    Browse the repository at this point in the history

  6. fix

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    955d7b5 View commit details
    Browse the repository at this point in the history

  7. add docstring

    @younesbelkada
    younesbelkada committed Dec 9, 2022
    Configuration menu
    Copy the full SHA
    05f1849 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2022

  1. CI tests pass

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    12ffea9 View commit details
    Browse the repository at this point in the history

  2. fix tests

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    5215465 View commit details
    Browse the repository at this point in the history

  3. make fixup

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    da07c0f View commit details
    Browse the repository at this point in the history

  4. add to toctree

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    859158a View commit details
    Browse the repository at this point in the history

  5. fix processors

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    ee56ba0 View commit details
    Browse the repository at this point in the history

  6. fix processors

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    fb45b64 View commit details
    Browse the repository at this point in the history

  7. fix doc

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    d256a0a View commit details
    Browse the repository at this point in the history

  8. fill title

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    980b723 View commit details
    Browse the repository at this point in the history

  9. add content doc

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    e53ad6c View commit details
    Browse the repository at this point in the history

  10. remove from tokenization auto

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    31e4339 View commit details
    Browse the repository at this point in the history

  11. fix config

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    da7f972 View commit details
    Browse the repository at this point in the history

  12. change order

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    2f3b6dd View commit details
    Browse the repository at this point in the history

  13. add # Copied from

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    5a1fd7a View commit details
    Browse the repository at this point in the history

  14. few fixes 

    - add correct license on modeling text
- remove dummy argument
    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    6387aec View commit details
    Browse the repository at this point in the history

  15. Merge remote-tracking branch 'upstream/main' into add-blip

    @younesbelkada
    younesbelkada committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    59d5131 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 12, 2022
    Configuration menu
    Copy the full SHA
    fef5a21 View commit details
    Browse the repository at this point in the history

  2. replace name

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    fb39914 View commit details
    Browse the repository at this point in the history

  3. refactor a bit

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    0516183 View commit details
    Browse the repository at this point in the history

  4. more refactor

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    4166302 View commit details
    Browse the repository at this point in the history

  5. remove unused arg

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    d5073ee View commit details
    Browse the repository at this point in the history

  6. make fixup + remove some # Adapted from ...

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    4dee8fe View commit details
    Browse the repository at this point in the history

  7. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 12, 2022
    Configuration menu
    Copy the full SHA
    ad08646 View commit details
    Browse the repository at this point in the history

  8. more # Copied from

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    194dfa5 View commit details
    Browse the repository at this point in the history

  9. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 12, 2022
    Configuration menu
    Copy the full SHA
    4c9ee7f View commit details
    Browse the repository at this point in the history

  10. now generate supports no prefix

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    96536b3 View commit details
    Browse the repository at this point in the history

  11. remove FeatureExtractor

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    af5848c View commit details
    Browse the repository at this point in the history

  12. fix path

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    62230fc View commit details
    Browse the repository at this point in the history

  13. correct dependency

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    bf089c2 View commit details
    Browse the repository at this point in the history

  14. fix tests

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    3fc2776 View commit details
    Browse the repository at this point in the history

  15. few fixes

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    03ed567 View commit details
    Browse the repository at this point in the history

  16. add integration tests

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    ecf470b View commit details
    Browse the repository at this point in the history

  17. add correct conversion script

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    3dd7034 View commit details
    Browse the repository at this point in the history

  18. Apply suggestions from code review 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @younesbelkada @sgugger
    younesbelkada and sgugger authored Dec 12, 2022
    Configuration menu
    Copy the full SHA
    671c796 View commit details
    Browse the repository at this point in the history

  19. add blip to tokenization auto

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    9afcd0e View commit details
    Browse the repository at this point in the history

  20. Merge branch 'add-blip' of https://github.com/younesbelkada/transformers 

     into add-blip
    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    242b795 View commit details
    Browse the repository at this point in the history

  21. fix docstrings

    @younesbelkada
    younesbelkada committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    829f2b3 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2022

  1. fix test + add image

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    27437be View commit details
    Browse the repository at this point in the history

  2. remove processor from uncorrect place

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    f5978b7 View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    256d02a View commit details
    Browse the repository at this point in the history

  4. clean up a bit

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    0696a41 View commit details
    Browse the repository at this point in the history

  5. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    c5b9251 View commit details
    Browse the repository at this point in the history

  6. clean pixel mask

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    f6636b9 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'add-blip' of https://github.com/younesbelkada/transformers 

     into add-blip
    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    53140f2 View commit details
    Browse the repository at this point in the history

  8. clean pixel mask

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    a69d8bc View commit details
    Browse the repository at this point in the history

  9. fix F

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    7fdf5e4 View commit details
    Browse the repository at this point in the history

  10. Update src/transformers/models/blip/modeling_blip.py 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    e644cb5 View commit details
    Browse the repository at this point in the history

  11. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    537d552 View commit details
    Browse the repository at this point in the history

  12. fix output

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    b9b3d51 View commit details
    Browse the repository at this point in the history

  13. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    e8b6118 View commit details
    Browse the repository at this point in the history

  14. fix pad token id

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    895b072 View commit details
    Browse the repository at this point in the history

  15. remove token_type_ids

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    e018a35 View commit details
    Browse the repository at this point in the history

  16. make fixup

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    2312724 View commit details
    Browse the repository at this point in the history

  17. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    af46d12 View commit details
    Browse the repository at this point in the history

  18. make fixup

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    8b698ff View commit details
    Browse the repository at this point in the history

  19. Apply suggestions from code review 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    2a3e358 View commit details
    Browse the repository at this point in the history

  20. add comments

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    f0e4f79 View commit details
    Browse the repository at this point in the history

  21. Update src/transformers/models/blip/modeling_blip.py 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 13, 2022
    Configuration menu
    Copy the full SHA
    21e4fbc View commit details
    Browse the repository at this point in the history

  22. remove token_type_ids

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    4968a66 View commit details
    Browse the repository at this point in the history

  23. make fixup

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    a5b5cfc View commit details
    Browse the repository at this point in the history

  24. better name

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    57cd75b View commit details
    Browse the repository at this point in the history

  25. replace with image_attention_mask

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    fbd23a4 View commit details
    Browse the repository at this point in the history

  26. refactor

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    fc4b239 View commit details
    Browse the repository at this point in the history

  27. make fixup

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    7151c7f View commit details
    Browse the repository at this point in the history

  28. better docstring

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    1463f2a View commit details
    Browse the repository at this point in the history

  29. replace answer_xx

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    918b5c9 View commit details
    Browse the repository at this point in the history

  30. remove ununsed args

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    7a943b3 View commit details
    Browse the repository at this point in the history

  31. add labels

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    923aa1c View commit details
    Browse the repository at this point in the history

  32. add labels

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    6757711 View commit details
    Browse the repository at this point in the history

  33. fix processing tests

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    d430a58 View commit details
    Browse the repository at this point in the history

  34. make fixup

    @younesbelkada
    younesbelkada committed Dec 13, 2022
    Configuration menu
    Copy the full SHA
    92c69c3 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2022

  1. make fixup

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    519ca81 View commit details
    Browse the repository at this point in the history

  2. put correct repo

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    480b94f View commit details
    Browse the repository at this point in the history

  3. remove pad

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    403d92a View commit details
    Browse the repository at this point in the history

  4. remove crop and center_crop

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    6e9e86f View commit details
    Browse the repository at this point in the history

  5. Update src/transformers/models/blip/image_processing_blip.py 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 14, 2022
    Configuration menu
    Copy the full SHA
    d5115fa View commit details
    Browse the repository at this point in the history

  6. fix

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    5fd122a View commit details
    Browse the repository at this point in the history

  7. Merge branch 'add-blip' of https://github.com/younesbelkada/transformers 

     into add-blip
    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    262b600 View commit details
    Browse the repository at this point in the history

  8. remove size_divisor

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    d4aab89 View commit details
    Browse the repository at this point in the history

  9. fix weights init

    @younesbelkada
    younesbelkada committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    00fd12d View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2022

  1. remove unneeded functions

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    4577db8 View commit details
    Browse the repository at this point in the history

  2. add suggestions

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    8cdc0d9 View commit details
    Browse the repository at this point in the history

  3. minor changes 

    - change slow test output for PT 1.13
- docstring order
    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    b106ef1 View commit details
    Browse the repository at this point in the history

  4. replace feature_extractor by image_processor

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    7ba9cb0 View commit details
    Browse the repository at this point in the history

  5. fix doctests

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    afa4e1e View commit details
    Browse the repository at this point in the history

  6. fix weight init order + add fp16 slow test

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    fae2b2e View commit details
    Browse the repository at this point in the history

  7. add blip to doctest

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    2a3b272 View commit details
    Browse the repository at this point in the history

  8. add correct repo name and fix test

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    f7d7b43 View commit details
    Browse the repository at this point in the history

  9. Update src/transformers/models/blip/processing_blip.py 

    Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
    @younesbelkada @NielsRogge
    younesbelkada and NielsRogge authored Dec 15, 2022
    Configuration menu
    Copy the full SHA
    4daa6c8 View commit details
    Browse the repository at this point in the history

  10. fix tests

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    64762b5 View commit details
    Browse the repository at this point in the history

  11. Merge remote-tracking branch 'upstream/main' into add-blip

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    1f531c3 View commit details
    Browse the repository at this point in the history

  12. use convert_to_rgb from image_transforms

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    aa73960 View commit details
    Browse the repository at this point in the history

  13. make fixup

    @younesbelkada
    younesbelkada committed Dec 15, 2022
    Configuration menu
    Copy the full SHA
    9888c9b View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. fix large loading issue

    @younesbelkada
    younesbelkada committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    a77b52c View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'upstream/main' into add-blip

    @younesbelkada
    younesbelkada committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    d3f03d9 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2022

  1. Merge branch 'main' into add-blip

    @younesbelkada
    younesbelkada authored Dec 19, 2022
    Configuration menu
    Copy the full SHA
    30e8bab View commit details
    Browse the repository at this point in the history