Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix unreliable test behaviour when using hypothesis #2208

Merged
merged 6 commits into from
Jan 2, 2024
Merged

Fix unreliable test behaviour when using hypothesis #2208

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
f042d66
remove timing deadline
strickvl Jan 2, 2024
e680bff
let CI steps run again
strickvl Jan 2, 2024
815d29c
Merge branch 'develop' into bugfix/fix-unreliable-test-lasting-too-long
strickvl Jan 2, 2024
ff02c4a
Auto-update of Starter template
actions-user Jan 2, 2024
64592a5
Auto-update of E2E template
actions-user Jan 2, 2024
a8a1685
Auto-update of NLP template
actions-user Jan 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions .github/workflows/setup-python-environment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -113,12 +113,12 @@ jobs:
files: "."
config: ./.typos.toml
# Only run the spell check on ubuntu-latest and python 3.8
if: ${{ inputs.os == 'ubuntu-latest' && inputs.python-version == '3.8' }}
if: ${{ inputs.os == 'ubuntu-dind-runners' && inputs.python-version == '3.8' }}

- name: Docstring check
run: bash scripts/docstring.sh
# Only run the docstring check on ubuntu-latest and python 3.8
if: ${{ inputs.os == 'ubuntu-latest' && inputs.python-version == '3.8' }}
if: ${{ inputs.os == 'ubuntu-dind-runners' && inputs.python-version == '3.8' }}

- name: Security check
run: bash scripts/check-security.sh
Expand All @@ -133,7 +133,7 @@ jobs:
config-file: .github/workflows/markdown_check_config.json
continue-on-error: true
# Only run the markdown link check on ubuntu-latest and python 3.8
if: ${{ inputs.os == 'ubuntu-latest' && inputs.python-version == '3.8' }}
if: ${{ inputs.os == 'ubuntu-dind-runners' && inputs.python-version == '3.8' }}

- name: Check for alembic branch divergence
env:
Expand All @@ -147,7 +147,7 @@ jobs:

# - name: Upload coverage
# # only do it for python 3.8, we don't need to do it for every version
# if: ${{ inputs.os == 'ubuntu-latest' && inputs.python-version == '3.8' }}
# if: ${{ inputs.os == 'ubuntu-dind-runners' && inputs.python-version == '3.8' }}
# uses: codecov/codecov-action@v2

- name: Setup tmate session after tests
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/LICENSE
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
Apache Software License 2.0

Copyright (c) ZenML GmbH 2023. All rights reserved.
Copyright (c) ZenML GmbH 2024. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/configs/deployer_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/configs/inference_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/configs/train_config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/pipelines/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/pipelines/batch_inference.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/pipelines/deployment.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/pipelines/training.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/run.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/alerts/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/alerts/notify_on.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/data_quality/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/data_quality/drift_quality_gate.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/deployment/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/deployment/deployment_deploy.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/etl/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/etl/data_loader.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/etl/inference_data_preprocessor.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/etl/train_data_preprocessor.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/etl/train_data_splitter.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/hp_tuning/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/hp_tuning/hp_tuning_select_best_model.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/hp_tuning/hp_tuning_single_search.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/inference/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/inference/inference_predict.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/promotion/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/promotion/compute_performance_metrics_on_current_data.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/promotion/promote_with_metric_compare.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/training/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/training/model_evaluator.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/steps/training/model_trainer.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/utils/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/utils/get_model_from_config.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/utils/preprocess.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/e2e/utils/promote_in_model_registry.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/LICENSE
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
Apache Software License 2.0

Copyright (c) ZenML GmbH 2023. All rights reserved.
Copyright (c) ZenML GmbH 2024. All rights reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/gradio/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/pipelines/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/pipelines/deploying.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/pipelines/promoting.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/pipelines/training.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/run.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
2 changes: 1 addition & 1 deletion examples/nlp-case/steps/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Apache Software License 2.0
#
# Copyright (c) ZenML GmbH 2023. All rights reserved.
# Copyright (c) ZenML GmbH 2024. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
Expand Down
Loading