Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LoftQ: Add LoftQ method integrated into LoRA. Add example code for LoftQ usage. #1150

Merged
merged 12 commits into from
Nov 29, 2023
Merged

LoftQ: Add LoftQ method integrated into LoRA. Add example code for LoftQ usage. #1150

merged 12 commits into from
Nov 29, 2023

Commits on Nov 19, 2023

  1. Add LoftQ method ingrated into LoRA. Add example code for LoftQ usage.

    @yxli2123
    yxli2123 committed Nov 19, 2023
    Configuration menu
    Copy the full SHA
    25f015d View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. faster regex

    @yxli2123
    yxli2123 committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    667529a View commit details
    Browse the repository at this point in the history

  2. add scipy to requirements

    @yxli2123
    yxli2123 committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    86ba774 View commit details
    Browse the repository at this point in the history

  3. change to nf4

    @yxli2123
    yxli2123 committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    d01ccfd View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. to float32 when svd 

    change peft model path on HF

auto float16/32 for bnb
    @yxli2123
    yxli2123 committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    e04fab2 View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2023

  1. Update examples/loftq_finetuning/README.md 

    Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
    @yxli2123 @pacman100
    yxli2123 and pacman100 authored Nov 26, 2023
    Configuration menu
    Copy the full SHA
    6aba235 View commit details
    Browse the repository at this point in the history

  2. import scipy at loftq_init

    @yxli2123
    yxli2123 committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    d4523c8 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. Merge branch 'huggingface:main' into loftq

    @yxli2123
    yxli2123 authored Nov 28, 2023
    Configuration menu
    Copy the full SHA
    bcde4c3 View commit details
    Browse the repository at this point in the history

  2. Update examples/loftq_finetuning/README.md 

    Co-authored-by: Benjamin Bossan <BenjaminBossan@users.noreply.github.com>
    @yxli2123 @BenjaminBossan
    yxli2123 and BenjaminBossan authored Nov 28, 2023
    Configuration menu
    Copy the full SHA
    fe9e84a View commit details
    Browse the repository at this point in the history

  3. add license, import scipy at post_init, change assert to ValueError m… 

    …sg, edit example docs
    @yxli2123
    yxli2123 committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    cf68839 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. fix merge conflicts

    @yxli2123
    yxli2123 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    88a90c6 View commit details
    Browse the repository at this point in the history

  2. add loftq to Literal

    @yxli2123
    yxli2123 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    aaff315 View commit details
    Browse the repository at this point in the history