Skip to content

Releases: sozercan/aikit

v0.14.0

27 Sep 03:50
@github-actions github-actions
v0.14.0
9fa9ac1
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.14.0 Latest
Latest

Notable Changes

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.13.0

07 Sep 20:35
@github-actions github-actions
v0.13.0
97c114e
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.13.0

Notable Changes

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.12.2

03 Aug 23:18
@github-actions github-actions
v0.12.2
43058b2
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.12.2

Notable Changes

Chores

Assets 2
Loading

v0.12.1

03 Aug 20:26
@github-actions github-actions
v0.12.1
69284c6
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.12.1

Notable Changes

Chores

Assets 2
Loading

v0.12.0

28 Jul 05:56
@github-actions github-actions
v0.12.0
767888a
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.12.0

Notable Changes

Deprecation

Features

Bug Fixes

Documentation

Tests

Continuous Integration

Chores

Assets 2
Loading

v0.11.1

13 Jun 05:44
@github-actions github-actions
v0.11.1
abf1ef4
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.11.1

Notable Changes

  • 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
  • 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
    --build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

docker run -d --rm -p 8080:8080 my-model

curl http://localhost:8080/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama3",
        "messages": [
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'
  • ⎈ Helm chart security hardening with restricted pod security admission

Chores

Commits

Assets 2
Loading

v0.11.0

13 Jun 03:49
@github-actions github-actions
v0.11.0
8f80515
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.11.0

Notable Changes

  • 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
  • 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
    --build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

docker run -d --rm -p 8080:8080 my-model

curl http://localhost:8080/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama3",
        "messages": [
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'
  • ⎈ Helm chart security hardening with restricted pod security admission

Features

Documentation

Continuous Integration

Chores

Assets 2
Loading

v0.10.0

06 Jun 11:11
@github-actions github-actions
v0.10.0
0eb9597
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.10.0

Notable changes

⚡️ Quick start to create custom images using models from Hugging Face 🤗 without creating an aikitfile

Example:

docker buildx build -t my-model --load \
    --build-arg="model=huggingface://TheBloke/Llama-2-7B-Chat-GGUF/llama-2-7b-chat.Q4_K_M.gguf" \
    "https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"

Features

Bug Fixes

Documentation

Tests

Continuous Integration

Chores

Assets 2
Loading

v0.9.0

30 May 21:53
@github-actions github-actions
v0.9.0
36d6cd4
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.0

Notable Changes

  • 🕵️ Auto runtime detection: AIKit will now automatically check your CPU and GPU capabilities, and automatically choose the most optimized runtime. With this change, there is no differentiation for runtimes avx, avx2, and avx512. They can still be used to skip installing the cuda runtime libraries for slimmer images.
  • 💿 Pre-made models will now include CUDA libraries by default, and CUDA specific images will not be updated anymore. Thanks to auto runtime detection if a compatible GPU is not found, it will fallback to the most optimized CPU runtime.
  • ⎈ Helm chart for Kubernetes is now available!
  • 🚀 New pre-made models are now available: Gemma 1.1 2B Instruct and Codestral 22B.
  • ✨ Updated LocalAI to v2.16.0.
  • 🦥 Updated Unsloth to May 2024 release.

Features

Bug Fixes

Documentation

Continuous Integration

Chores

Reverts

Assets 2
Loading

v0.8.0

22 Apr 16:59
@github-actions github-actions
v0.8.0
6ca2c63
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.8.0

Notable Changes

Features

Documentation

Tests

Continuous Integration

Chores

Assets 2
Loading