Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

⬆️ Update ggerganov/llama.cpp #1642

Merged
merged 1 commit into from
Jan 24, 2024

Conversation

localai-bot
Copy link
Contributor

Bump of ggerganov/llama.cpp version

Signed-off-by: GitHub <noreply@github.com>
Copy link

netlify bot commented Jan 24, 2024

Deploy Preview for localai ready!

Name Link
🔨 Latest commit add19a0
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/65b16d9f71847700089a5ba5
😎 Deploy Preview https://deploy-preview-1642--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@mudler mudler merged commit 3733250 into mudler:master Jan 24, 2024
18 checks passed
truecharts-admin referenced this pull request in truecharts/public Jan 29, 2024
….0@b689c91 by renovate (#17756)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
| [docker.io/localai/localai](https://github.com/mudler/LocalAI) |
minor | `v2.6.1` -> `v2.7.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>mudler/LocalAI (docker.io/localai/localai)</summary>

### [`v2.7.0`](https://github.com/mudler/LocalAI/releases/tag/v2.7.0)

[Compare
Source](https://github.com/mudler/LocalAI/compare/v2.6.1...v2.7.0)

<!-- Release notes generated using configuration in .github/release.yml
at master -->

This release adds support to the transformer backend for LLM as well!

For now instance you can run codellama-7b with transformers with:

docker run -ti -p 8080:8080 --gpus all
localai/localai:v2.7.0-cublas-cuda12 codellama-7b

In the quickstart there are more examples available
https://localai.io/basics/getting_started/#running-models.

Note: As llama.cpp is ongoing with changes that could possible cause
breakage, this release does not includes changes from
[ggerganov/llama.cpp#5138
(the future versions will).

#### What's Changed

##### Bug fixes 🐛

- fix(paths): automatically create paths by
[@&#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1650](https://github.com/mudler/LocalAI/pull/1650)

##### Exciting New Features 🎉

- feat(transformers): support also text generation by
[@&#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1630](https://github.com/mudler/LocalAI/pull/1630)
- transformers: correctly load automodels by
[@&#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1643](https://github.com/mudler/LocalAI/pull/1643)
- feat(startup): fetch model definition remotely by
[@&#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1654](https://github.com/mudler/LocalAI/pull/1654)

##### 👒 Dependencies

- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1642](https://github.com/mudler/LocalAI/pull/1642)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1644](https://github.com/mudler/LocalAI/pull/1644)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1652](https://github.com/mudler/LocalAI/pull/1652)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1655](https://github.com/mudler/LocalAI/pull/1655)

##### Other Changes

- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1632](https://github.com/mudler/LocalAI/pull/1632)
- ⬆️ Update docs version mudler/LocalAI by
[@&#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1631](https://github.com/mudler/LocalAI/pull/1631)

**Full Changelog**:
mudler/LocalAI@v2.6.1...v2.6.2

</details>

---

### Configuration

📅 **Schedule**: Branch creation - "before 10pm on monday" in timezone
Europe/Amsterdam, Automerge - At any time (no schedule defined).

🚦 **Automerge**: Enabled.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://github.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4xNTYuNCIsInVwZGF0ZWRJblZlciI6IjM3LjE1Ni40IiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIn0=-->
GabrielBarzen referenced this pull request in GabrielBarzen/charts Feb 2, 2024
….0@b689c91 by renovate (truecharts#17756)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
| [docker.io/localai/localai](https://github.com/mudler/LocalAI) |
minor | `v2.6.1` -> `v2.7.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>mudler/LocalAI (docker.io/localai/localai)</summary>

### [`v2.7.0`](https://github.com/mudler/LocalAI/releases/tag/v2.7.0)

[Compare
Source](https://github.com/mudler/LocalAI/compare/v2.6.1...v2.7.0)

<!-- Release notes generated using configuration in .github/release.yml
at master -->

This release adds support to the transformer backend for LLM as well!

For now instance you can run codellama-7b with transformers with:

docker run -ti -p 8080:8080 --gpus all
localai/localai:v2.7.0-cublas-cuda12 codellama-7b

In the quickstart there are more examples available
https://localai.io/basics/getting_started/#running-models.

Note: As llama.cpp is ongoing with changes that could possible cause
breakage, this release does not includes changes from
[ggerganov/llama.cpp#5138
(the future versions will).

#### What's Changed

##### Bug fixes 🐛

- fix(paths): automatically create paths by
[@&truecharts#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1650](https://github.com/mudler/LocalAI/pull/1650)

##### Exciting New Features 🎉

- feat(transformers): support also text generation by
[@&truecharts#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1630](https://github.com/mudler/LocalAI/pull/1630)
- transformers: correctly load automodels by
[@&truecharts#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1643](https://github.com/mudler/LocalAI/pull/1643)
- feat(startup): fetch model definition remotely by
[@&truecharts#8203;mudler](https://github.com/mudler) in
[https://github.com/mudler/LocalAI/pull/1654](https://github.com/mudler/LocalAI/pull/1654)

##### 👒 Dependencies

- ⬆️ Update ggerganov/llama.cpp by
[@&truecharts#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1642](https://github.com/mudler/LocalAI/pull/1642)
- ⬆️ Update ggerganov/llama.cpp by
[@&truecharts#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1644](https://github.com/mudler/LocalAI/pull/1644)
- ⬆️ Update ggerganov/llama.cpp by
[@&truecharts#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1652](https://github.com/mudler/LocalAI/pull/1652)
- ⬆️ Update ggerganov/llama.cpp by
[@&truecharts#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1655](https://github.com/mudler/LocalAI/pull/1655)

##### Other Changes

- ⬆️ Update ggerganov/llama.cpp by
[@&truecharts#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1632](https://github.com/mudler/LocalAI/pull/1632)
- ⬆️ Update docs version mudler/LocalAI by
[@&truecharts#8203;localai-bot](https://github.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1631](https://github.com/mudler/LocalAI/pull/1631)

**Full Changelog**:
mudler/LocalAI@v2.6.1...v2.6.2

</details>

---

### Configuration

📅 **Schedule**: Branch creation - "before 10pm on monday" in timezone
Europe/Amsterdam, Automerge - At any time (no schedule defined).

🚦 **Automerge**: Enabled.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://github.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4xNTYuNCIsInVwZGF0ZWRJblZlciI6IjM3LjE1Ni40IiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIn0=-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants