Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Optimize build + test pipeline #3300

Merged
merged 31 commits into from
Jul 3, 2023
Merged
Show file tree
Hide file tree
Changes from 29 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
272c3ba
tests: Uncomment failing tests
frascuchon Jun 30, 2023
556d88c
chore: Remove empty test files
frascuchon Jun 30, 2023
e392bec
chore: ignore all training tests
frascuchon Jun 30, 2023
701c26f
chore: Running only tests for server
frascuchon Jun 30, 2023
bd4328e
revert: remove alembic upgrade command for tests
frascuchon Jun 30, 2023
e6767fb
ci: remove test open search (will be unified in one single job)
frascuchon Jun 30, 2023
3680297
ci: extract 'run tests' into a separate workflow
frascuchon Jun 30, 2023
9cdf906
ci: Set optional subworkflow inputs
frascuchon Jun 30, 2023
9550d1b
ci: Remove secrets
frascuchon Jun 30, 2023
42013d9
ci: Select tests to launch
frascuchon Jun 30, 2023
ff21cf4
chore: ignore more tests
frascuchon Jun 30, 2023
1c3344e
chore: Remove all skipped tests
frascuchon Jul 2, 2023
b252a01
ci: Running client side tests
frascuchon Jul 2, 2023
de5d908
ci: Configure tests selection
frascuchon Jul 2, 2023
13ed3a6
ci: Externalize repo files checking
frascuchon Jul 2, 2023
efb6cd1
ci: Config base tests job
frascuchon Jul 2, 2023
7a79df3
ci: fix check cache condition
frascuchon Jul 2, 2023
65ce55c
ci: single line input config
frascuchon Jul 2, 2023
374b6a4
ci: Update cache action version
frascuchon Jul 2, 2023
cc25c2d
ci: Multiline pytest arg config
frascuchon Jul 2, 2023
b3fbe4a
chore: improve check repo files outputs
frascuchon Jul 2, 2023
fb3e63b
ci: Add test training tests step
frascuchon Jul 2, 2023
d3cc01f
ci: Add listener and monitoring tests
frascuchon Jul 2, 2023
aadbd66
ci: externalize build python package as a separate workflow
frascuchon Jul 2, 2023
4c2f6c6
ci: Parameterize search engines
frascuchon Jul 2, 2023
a004642
ci: Test env check
frascuchon Jul 2, 2023
c8cd903
ci: Better env check
frascuchon Jul 2, 2023
339204f
Align default engines
frascuchon Jul 2, 2023
c921eeb
ci: Upgrade actions
frascuchon Jul 3, 2023
66a831d
ci: Add TODO
frascuchon Jul 3, 2023
5bb2dff
Separate coverage report per tests action
frascuchon Jul 3, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions .github/workflows/build-python-package.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: Build Argilla package

on:
workflow_call:

jobs:
build:
name: Build the python package
runs-on: ubuntu-latest
steps:
- name: Checkout Code 🛎
uses: actions/checkout@v2
- name: Cache pip 👜
uses: actions/cache@v3
env:
# Increase this value to reset cache if pyproject.toml has not changed
CACHE_NUMBER: 0
with:
path: ~/.cache/pip
key: ${{ runner.os }}-pip-${{ env.CACHE_NUMBER }}-${{ hashFiles('pyproject.toml') }}
- name: Setup Node.js
uses: actions/setup-node@v3
with:
node-version: "14"
- name: Build Package 🍟
run: |
pip install -U build
scripts/build_distribution.sh
- name: Upload package artifact
uses: actions/upload-artifact@v3
with:
name: python-package
path: dist
39 changes: 39 additions & 0 deletions .github/workflows/check-repo-files.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
name: Check repository files

on:
workflow_call:
outputs:
pythonChanges:
description: "True if some files in python code have changed"
value: ${{ jobs.check-repo-files.outputs.pythonChanges }}
buildChanges:
description: "True if some files affecting the build have changed"
value: ${{ jobs.check-repo-files.outputs.pythonChanges }}

jobs:
check-repo-files:
name: Check repo files
runs-on: ubuntu-latest
outputs:
pythonChanges: ${{ steps.path_filter.outputs.pythonChanges }}
buildChanges: ${{ steps.path_filter.outputs.buildChanges }}
steps:
- name: Checkout Code 🛎
uses: actions/checkout@v2
- name: Check affected files
uses: dorny/paths-filter@v2
id: path_filter
with:
filters: |
pythonChanges:
- 'src/**'
- 'tests/**'
- 'pyproject.toml'
- 'setup.py'
buildChanges:
- 'src/**'
- 'frontend/**'
- 'pyproject.toml'
- 'setup.py'
- 'docker/**'
- '.dockerignore'
Loading