Merge branch 'develop' into feature/OSS-2584-artifact-loading-current…

…-stack-only

README.md

@@ -89,7 +89,7 @@
     <a href="https://www.zenml.io/company#team">Meet the Team</a>
     <br />
     <br />
-    🎉 Version 0.45.6 is out. Check out the release notes
+    🎉 Version 0.46.0 is out. Check out the release notes
     <a href="https://github.com/zenml-io/zenml/releases">here</a>.
     <br />
     <br />

RELEASE_NOTES.md

@@ -1,4 +1,36 @@
 <!-- markdown-link-check-disable -->
+# 0.46.0
+
+This release brings some upgrades, documentation updates and bug fixes. Notably,
+our `langchain` integration now supports more modern versions and has been
+upgraded to a new version at the lower edge of supported packages on account of
+a security vulnerability.
+
+Other fixes related to the Model Control Plane which was updated to support the
+deletion of model versions via the CLI, for example.
+
+## Breaking Change
+
+We removed the `llama_index` integration in this release. This related to
+unsolvable dependency clashes that relate to `sqlmodel` and our database. We
+expect these clashes to be resolved in the future and then we will add our
+integration back in. If you were using the `llama_index` materializer that was
+part of the integration, you will have to use a custom materializer in the
+meanwhile. We apologize for the inconvenience.
+
+## What's Changed
+* MCP-driven E2E template by @avishniakov in https://github.com/zenml-io/zenml/pull/2004
+* Model scoped endpoints by @avishniakov in https://github.com/zenml-io/zenml/pull/2003
+* Delete model version in cli by @avishniakov in https://github.com/zenml-io/zenml/pull/2006
+* Add latest version to model list response by @avishniakov in https://github.com/zenml-io/zenml/pull/2007
+* Fix `gcs bucket` docs error message by @safoinme in https://github.com/zenml-io/zenml/pull/2018
+* Fix `Skypilot` docs configuration by @safoinme in https://github.com/zenml-io/zenml/pull/2017
+* Bump `langchain`, disable `llama_index`, and fix Vector Store materializer by @strickvl in https://github.com/zenml-io/zenml/pull/2013
+* Fix Build Options of `GCPImageBuilder` by @fa9r in https://github.com/zenml-io/zenml/pull/1992
+* Fix the stack component describe CLI output by @stefannica in https://github.com/zenml-io/zenml/pull/2001
+
+
+**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.45.6...0.46.0
 
 # 0.45.6
 

docs/book/user-guide/advanced-guide/environment-management/use-the-hub.md

@@ -7,7 +7,7 @@ description: Collaborating with the ZenML community.
 The ZenML Hub is a central platform that enables our users to search, share and discover community-contributed code, such as flavors, materializers, and steps, that can be used across organizations. The goal is to allow our users to extend their ZenML experience by leveraging the community's diverse range of implementations.
 
 {% hint style="info" %}
-If you're interested in learning more about our motivation for implementing the ZenML Hub and our plans for its future, we invite you to read [our new blog post](https://blog.zenml.io/zenml-hub-launch). In addition to this technical documentation, the blog post provides a comprehensive overview of the ZenML Hub's goals and objectives, as well as the features that we plan to introduce in the future.
+If you're interested in learning more about our motivation for implementing the ZenML Hub and our plans for its future, we invite you to read [our blog post](https://blog.zenml.io/zenml-hub-launch). In addition to this technical documentation, the blog post provides a comprehensive overview of the ZenML Hub's goals and objectives, as well as the features that we plan to introduce in the future.
 {% endhint %}
 
 ### Plugins <a href="#plugins" id="plugins"></a>
@@ -23,7 +23,7 @@ Users can create a ZenML Hub account to contribute, rate, and star these plugins
 
 ### What is already built in? <a href="#what-is-already-built-in" id="what-is-already-built-in"></a>
 
-With the release of ZenML version 0.38.0, the ZenML Hub will make its first appearance and be equipped with a set of plugins that feature ZenML-verified steps (with a heavy emphasis on data loader steps). In future iterations, the ZenML team is actively working on expanding the Hub's capabilities and plans to introduce additional entities, such as materializers and flavors.
+The ZenML Hub has been available since the release of version 0.38.0, and is equipped with a set of plugins that feature ZenML-verified steps (with a heavy emphasis on data-loader steps). In future iterations, the ZenML team is actively working on expanding the Hub's capabilities and plans to introduce additional entities, such as materializers and flavors.
 
 ## How do I use it?
 
@@ -81,7 +81,7 @@ You should see a table similar to:
 In order to create your own plugin and submit it to the ZenML hub, you need to first log in. In the first version, authentication is only possible through GitHub.
 
 {% hint style="info" %}
-If you haven't used the ZenML Hub before, this process will create a ZenML Hub account that shares the same username as your GitHub account. It will also associate your current ZenML user with this newly generated ZenML Hub account.
+If you haven't used the ZenML Hub before, this process will create a ZenML Hub account that shares the same username as your GitHub account. It will also associate your current ZenML user with this newly-generated ZenML Hub account.
 {% endhint %}
 
 {% tabs %}

pyproject.toml

@@ -1,6 +1,6 @@
 [tool.poetry]
 name = "zenml"
-version = "0.45.6"
+version = "0.46.0"
 packages = [{ include = "zenml", from = "src" }]
 description = "ZenML: Write production-ready ML code."
 authors = ["ZenML GmbH <info@zenml.io>"]
@@ -162,7 +162,7 @@ types-psutil = { version = "^5.8.13", optional = true }
 types-passlib = { version = "^1.7.7", optional = true }
 
 # mlstacks dependencies
-mlstacks = { version = "0.7.3", optional = true }
+mlstacks = { version = "0.7.8", optional = true }
 
 [tool.poetry.extras]
 server = [

src/zenml/VERSION

@@ -1 +1 @@
-0.45.6
+0.46.0

src/zenml/cli/stack_components.py

@@ -142,12 +142,12 @@ def describe_stack_component_command(name_id_or_prefix: str) -> None:
             if active_components:
                 active_component_id = active_components[0].id
 
-                cli_utils.print_stack_component_configuration(
-                    component=component_,
-                    active_status=component_.id == active_component_id,
-                )
+            cli_utils.print_stack_component_configuration(
+                component=component_,
+                active_status=component_.id == active_component_id,
+            )
 
-                print_model_url(get_component_url(active_components[0]))
+            print_model_url(get_component_url(component_))
 
     return describe_stack_component_command
 

src/zenml/integrations/gitlab/code_repositories/gitlab_code_repository.py

@@ -16,8 +16,8 @@
 import re
 from typing import Optional
 
-from gitlab import Gitlab  # type: ignore
-from gitlab.v4.objects import Project  # type: ignore
+from gitlab import Gitlab
+from gitlab.v4.objects import Project
 
 from zenml.code_repositories import (
     BaseCodeRepository,

src/zenml/integrations/openai/__init__.py

@@ -21,7 +21,7 @@ class OpenAIIntegration(Integration):
     """Definition of OpenAI integration for ZenML."""
 
     NAME = OPEN_AI
-    REQUIREMENTS = ["openai>=0.27.0"]
+    REQUIREMENTS = ["openai>=0.27.0,<1.0.0"]
 
 
 OpenAIIntegration.check_installation()

src/zenml/integrations/openai/hooks/open_ai_failure_hook.py

@@ -62,7 +62,7 @@ def openai_alerter_failure_hook_helper(
         sys.stdout = original_stdout
         rich_traceback = output_captured.getvalue()
 
-        response = openai.ChatCompletion.create(  # type: ignore[no-untyped-call]
+        response = openai.ChatCompletion.create(  # type: ignore
             model=model_name,
             messages=[
                 {

src/zenml/zen_server/deploy/helm/Chart.yaml

@@ -1,6 +1,6 @@
 apiVersion: v2
 name: zenml
-version: "0.45.6"
+version: "0.46.0"
 description: Open source MLOps framework for portable production ready ML pipelines
 keywords:
 - mlops

src/zenml/zen_server/deploy/helm/README.md

@@ -20,8 +20,8 @@ ZenML is an open-source MLOps framework designed to help you create robust, main
 To install the ZenML chart directly from Amazon ECR, use the following command:
 
 ```bash
-# example command for version 0.45.6
-helm install my-zenml oci://public.ecr.aws/zenml/zenml --version 0.45.6
+# example command for version 0.46.0
+helm install my-zenml oci://public.ecr.aws/zenml/zenml --version 0.46.0
 ```
 
 Note: Ensure you have OCI support enabled in your Helm client and that you are authenticated with Amazon ECR.

src/zenml/zen_stores/migrations/versions/0.46.0_release.py

@@ -0,0 +1,24 @@
+"""Release [0.46.0].
+
+Revision ID: 0.46.0
+Revises: 0.45.6
+Create Date: 2023-11-06 10:59:18.298042
+
+"""
+
+
+# revision identifiers, used by Alembic.
+revision = "0.46.0"
+down_revision = "0.45.6"
+branch_labels = None
+depends_on = None
+
+
+def upgrade() -> None:
+    """Upgrade database schema and/or data, creating a new revision."""
+    pass
+
+
+def downgrade() -> None:
+    """Downgrade database schema and/or data back to the previous revision."""
+    pass

tests/integration/functional/zen_stores/test_zen_store.py

@@ -2435,6 +2435,7 @@ def test_connector_validation():
 
 
 class TestModel:
+    @pytest.mark.skip("TODO: Fix to come from Andrei")
     def test_latest_version_properly_fetched(self):
         """Test that latest version can be properly fetched."""
         with ModelVersionContext() as model: