Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(llama.cpp): guess model defaults from file #2522

Merged
merged 6 commits into from
Jun 8, 2024
Merged

feat(llama.cpp): guess model defaults from file #2522

merged 6 commits into from
Jun 8, 2024

Commits on Jun 8, 2024

  1. wip: guess informations from gguf file 

    Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
    @mudler
    mudler committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    8c18997 View commit details
    Browse the repository at this point in the history

  2. update go mod 

    Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
    @mudler
    mudler committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    218649b View commit details
    Browse the repository at this point in the history

  3. Small fixups 

    Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
    @mudler
    mudler committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    884ee8b View commit details
    Browse the repository at this point in the history

  4. Identify llama3 

    Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
    @mudler
    mudler committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    61c1a43 View commit details
    Browse the repository at this point in the history

  5. Do not try to guess the name, as reading gguf files can be expensive 

    Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
    @mudler
    mudler committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    1220bf6 View commit details
    Browse the repository at this point in the history

  6. Allow to disable guessing 

    Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
    @mudler
    mudler committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    edbc171 View commit details
    Browse the repository at this point in the history