Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Covert a safetensor checkpoint from Hugging Face hub #1662

Merged
merged 32 commits into from
Jun 24, 2024
Merged

Covert a safetensor checkpoint from Hugging Face hub #1662

merged 32 commits into from
Jun 24, 2024

Commits on Jun 5, 2024

  1. chore: adding gemma and llama3

    @ariG23498
    ariG23498 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    72ce619 View commit details
    Browse the repository at this point in the history

  2. chore: adding init

    @ariG23498
    ariG23498 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    8f2fe93 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. chore: removing hard coded values

    @ariG23498
    ariG23498 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    a3fdc06 View commit details
    Browse the repository at this point in the history

  2. chore: using backbone properties

    @ariG23498
    ariG23498 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    3235592 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. chore: reformat

    @ariG23498
    ariG23498 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0bb47ad View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. chore: review changes

    @ariG23498
    ariG23498 committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    4994ca8 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. chore: removing einops with custom np operations

    @ariG23498
    ariG23498 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    606fcd7 View commit details
    Browse the repository at this point in the history

  2. fix: variable name

    @ariG23498
    ariG23498 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    3eec438 View commit details
    Browse the repository at this point in the history

  3. check: none type for reshape and transpose patterns

    @ariG23498
    ariG23498 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    225219b View commit details
    Browse the repository at this point in the history

  4. chore: fixing the nesting of reshape and transpose patterns

    @ariG23498
    ariG23498 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    7f42b2d View commit details
    Browse the repository at this point in the history

  5. fixing nesting of patterns

    @ariG23498
    ariG23498 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    59aeb70 View commit details
    Browse the repository at this point in the history

  6. chore: gemma weight rearrange fix

    @ariG23498
    ariG23498 committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    47c1ea3 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. chore: adding a hook function to reshape and transpose the hf tensors… 

    … to match the keras weights
    @ariG23498
    ariG23498 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    8f90f9b View commit details
    Browse the repository at this point in the history

  2. fix: variable to assign

    @ariG23498
    ariG23498 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    f016fbb View commit details
    Browse the repository at this point in the history

  3. fix: gemma port

    @ariG23498
    ariG23498 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    09d8689 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into aritra/hf-port 

    OK
    @ariG23498
    ariG23498 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    99588a1 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. Merge branch 'master' into aritra/hf-port 

    OK
    @ariG23498
    ariG23498 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    767ee2a View commit details
    Browse the repository at this point in the history

  2. chore: adding tests

    @ariG23498
    ariG23498 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    07183d5 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. review comments

    @ariG23498
    ariG23498 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    cc969bc View commit details
    Browse the repository at this point in the history

  2. adding safetensors as a dep

    @ariG23498
    ariG23498 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    56e0dfc View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Merge branch 'master' into aritra/hf-port 

    OK
    @ariG23498
    ariG23498 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    57a3d33 View commit details
    Browse the repository at this point in the history

  2. chore: adding jax memory cleanup

    @ariG23498
    ariG23498 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    22109a2 View commit details
    Browse the repository at this point in the history

  3. utf 8 encoding

    @ariG23498
    ariG23498 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    e021465 View commit details
    Browse the repository at this point in the history

  4. chore: changing tests

    @ariG23498
    ariG23498 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    7d0cfad View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. chore: fixing tests

    @ariG23498
    ariG23498 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    e99f98e View commit details
    Browse the repository at this point in the history

  2. fix tests

    @ariG23498
    ariG23498 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    f61a9fa View commit details
    Browse the repository at this point in the history

  3. chore: adding guard rails for None types

    @ariG23498
    ariG23498 committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    5a29dc0 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merge branch 'master' into aritra/hf-port 

    OK
    @ariG23498
    ariG23498 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    85c2586 View commit details
    Browse the repository at this point in the history

  2. Trigger Build

    @ariG23498
    ariG23498 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    c34241b View commit details
    Browse the repository at this point in the history

  3. review suggestions

    @ariG23498
    ariG23498 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    851fd69 View commit details
    Browse the repository at this point in the history

  4. fix raising ValueError

    @ariG23498
    ariG23498 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    cf1ff29 View commit details
    Browse the repository at this point in the history

  5. fix error message

    @ariG23498
    ariG23498 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    b06c6e4 View commit details
    Browse the repository at this point in the history