Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(container): update image localai/localai to v2.23.0 #287

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

feat(container): update image localai/localai to v2.23.0 #287

wants to merge 1 commit into from

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Apr 28, 2024 •
edited
Loading

This PR contains the following updates:

Package Update Change
localai/localai minor v2.13.0-cublas-cuda12-ffmpeg -> v2.23.0-cublas-cuda12-ffmpeg

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

Release Notes

mudler/LocalAI (localai/localai)

v2.23.0

Compare Source

What's Changed

Breaking Changes 🛠
Bug fixes 🐛
Exciting New Features 🎉
🧠 Models
📖 Documentation and examples
👒 Dependencies
Other Changes

New Contributors

Full Changelog: mudler/LocalAI@v2.22.1...v2.23.0

v2.22.1

Compare Source

What's Changed

Bug fixes 🐛
Exciting New Features 🎉
🧠 Models
👒 Dependencies
Other Changes

New Contributors

Full Changelog: mudler/LocalAI@v2.22.0...v2.22.1

v2.22.0

Compare Source

LocalAI v2.22.0 is out 🥳

💡 Highlights

  • Image-to-Text and Video-to-Text Support: The VLLM backend now supports both image-to-text and video-to-text processing.
  • Enhanced Multimodal Support: Template placeholders are now available, offering more flexibility in multimodal applications
  • Model Management Made Easy: List all your loaded models directly via the /system endpoint for seamless management.
  • Various bugfixes and improvements: Fixed issues with dangling processes to ensure proper resource management and resolved channel closure issues in the base GRPC server.
🖼️ Multimodal vLLM

To use multimodal models with vLLM simply specify the model in the YAML file. Models however can differ if support multiple images or single images, along how they process internally placeholders for images.

Some models/libraries have different way to express images, videos or audio placeholders. For example, llama.cpp backend expects images within an [img-ID] tag, but other backends/models (e.g. vLLM) use a different notation ( <|image_|>).

For example, to override defaults, now it is possible to set in the model configuration the following:

template:
  video: "<|video_{{.ID}}|> {{.Text}}"
  image: "<|image_{{.ID}}|> {{.Text}}"
  audio: "<|audio_{{.ID}}|> {{.Text}}"
📹 Video and Audio understanding

Some libraries might support both Video and Audio. Currently only vLLM supports Video understanding, and can be used in the API by "extending" the OpenAI API with audio and video type along images:

curl http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o",
    "messages": [
      {
        "role": "user",
        "content": [
          {
            "type": "text",
            "text": "What'\''s in this video?"
          },
          {
            "type": "video_url",
            "video_url": {
              "url": "https://video-image-url"
            }
          }
        ]
      }
    ],
    "max_tokens": 300
  }'
🧑‍🏭 Work in progress

What's Changed

Bug fixes 🐛
Exciting New Features 🎉
🧠 Models

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot changed the title feat(container): update image localai/localai to v2.13.0 feat(container): update image localai/localai to v2.13.0 - autoclosed Apr 28, 2024
@renovate renovate bot closed this Apr 28, 2024
@renovate renovate bot deleted the renovate/localai-localai-2.x branch April 28, 2024 22:37
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.13.0 - autoclosed feat(container): update image localai/localai to v2.13.0 Apr 29, 2024
@renovate renovate bot reopened this Apr 29, 2024
@renovate renovate bot restored the renovate/localai-localai-2.x branch April 29, 2024 03:19
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from ae30562 to 4b29c54 Compare April 29, 2024 03:19
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.13.0 feat(container): update image localai/localai to v2.13.0 - autoclosed Apr 29, 2024
@renovate renovate bot closed this Apr 29, 2024
@renovate renovate bot deleted the renovate/localai-localai-2.x branch April 29, 2024 09:44
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.13.0 - autoclosed feat(container): update image localai/localai to v2.13.0 May 3, 2024
@renovate renovate bot restored the renovate/localai-localai-2.x branch May 3, 2024 12:34
@renovate renovate bot reopened this May 3, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 4b29c54 to 598c84d Compare May 3, 2024 12:34
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.13.0 feat(container): update image localai/localai to v2.14.0 May 3, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch 3 times, most recently from 3320f04 to facb0b6 Compare May 9, 2024 22:35
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.14.0 feat(container): update image localai/localai to v2.15.0 May 9, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from facb0b6 to 31e1c75 Compare May 24, 2024 22:00
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.15.0 feat(container): update image localai/localai to v2.16.0 May 24, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 31e1c75 to 6cb8ef3 Compare June 18, 2024 03:24
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.16.0 feat(container): update image localai/localai to v2.17.0 Jun 18, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 6cb8ef3 to 1cda5c7 Compare June 19, 2024 17:21
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.17.0 feat(container): update image localai/localai to v2.17.1 Jun 19, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 1cda5c7 to 1162001 Compare June 28, 2024 20:05
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.17.1 feat(container): update image localai/localai to v2.18.0 Jun 28, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 1162001 to 3bc7bf7 Compare July 2, 2024 10:10
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.18.0 feat(container): update image localai/localai to v2.18.1 Jul 2, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 3bc7bf7 to 3016186 Compare July 19, 2024 21:52
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.18.1 feat(container): update image localai/localai to v2.19.0 Jul 19, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 3016186 to 74662ed Compare July 20, 2024 14:30
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.19.0 feat(container): update image localai/localai to v2.19.1 Jul 20, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 74662ed to 1195861 Compare July 24, 2024 23:05
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.19.1 feat(container): update image localai/localai to v2.19.2 Jul 24, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 1195861 to 99b4ea2 Compare July 28, 2024 15:48
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.19.2 feat(container): update image localai/localai to v2.19.3 Jul 28, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 99b4ea2 to 9033f91 Compare August 1, 2024 12:17
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.19.3 feat(container): update image localai/localai to v2.19.4 Aug 1, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 9033f91 to 9a7c13d Compare August 22, 2024 22:48
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.19.4 feat(container): update image localai/localai to v2.20.0 Aug 22, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 9a7c13d to 7879586 Compare August 23, 2024 12:15
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.20.0 feat(container): update image localai/localai to v2.20.1 Aug 23, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 7879586 to 5fec887 Compare September 24, 2024 18:20
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.20.1 feat(container): update image localai/localai to v2.21.0 Sep 24, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 5fec887 to eccc4e3 Compare September 25, 2024 17:15
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.21.0 feat(container): update image localai/localai to v2.21.1 Sep 25, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from eccc4e3 to 7baf2ce Compare October 12, 2024 22:04
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.21.1 feat(container): update image localai/localai to v2.22.0 Oct 12, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 7baf2ce to 44ed747 Compare October 21, 2024 16:59
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.22.0 feat(container): update image localai/localai to v2.22.1 Oct 21, 2024
@renovate renovate bot force-pushed the renovate/localai-localai-2.x branch from 44ed747 to 747a9b1 Compare November 10, 2024 22:27
@renovate renovate bot changed the title feat(container): update image localai/localai to v2.22.1 feat(container): update image localai/localai to v2.23.0 Nov 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
renovate/container type/minor
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
0 participants