Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable the pg_regress tests on staging for PG17 #9978

Merged
merged 67 commits into from
Dec 9, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
6a6c819
Add an initial support for v17
a-masterov Nov 27, 2024
745c2ea
Do not fail fast
a-masterov Nov 27, 2024
409ac69
Fix a stupid error
a-masterov Nov 27, 2024
5104196
The next iteration
a-masterov Nov 28, 2024
4412afb
The next iteration
a-masterov Nov 28, 2024
231b6ba
The next iteration
a-masterov Nov 28, 2024
c6588a8
The next iteration
a-masterov Nov 28, 2024
648e5ec
Merge branch 'refs/heads/amasterov/regress-staging-17' into amasterov…
a-masterov Nov 28, 2024
23a3e3e
Merge branch 'main' into amasterov/regress-staging-17
a-masterov Dec 3, 2024
b50f5f1
Change the approach to branch-based
a-masterov Nov 28, 2024
8ef7957
Configure the new endpoint
a-masterov Dec 3, 2024
a9d45a5
Add debug
a-masterov Dec 3, 2024
2631f43
Move branch instead of configuring it
a-masterov Dec 4, 2024
0b634e3
Disable pooled
a-masterov Dec 4, 2024
05d0866
Move the branch creation from Python to workflow
a-masterov Dec 4, 2024
4fa436c
jq issue
a-masterov Dec 5, 2024
30deaeb
add debug
a-masterov Dec 5, 2024
9a7d1f2
Fix a typo
a-masterov Dec 5, 2024
4339421
Fix a typo
a-masterov Dec 5, 2024
d564a77
Fix a typo
a-masterov Dec 5, 2024
07c6388
Add forgotten inputs.
a-masterov Dec 5, 2024
27a8980
x
a-masterov Dec 5, 2024
8527c75
Fix a bash error
a-masterov Dec 5, 2024
d35e450
Fix
a-masterov Dec 5, 2024
00b60f3
Debug
a-masterov Dec 5, 2024
76fe1d6
Debug
a-masterov Dec 5, 2024
043b5ae
Debug
a-masterov Dec 5, 2024
0a3aa6e
Debug
a-masterov Dec 5, 2024
9e8a4bf
Debug
a-masterov Dec 5, 2024
3ed9c0a
Refactoring
a-masterov Dec 5, 2024
72b497f
fix
a-masterov Dec 5, 2024
b3b2260
fix
a-masterov Dec 5, 2024
0ae13bb
Refactor
a-masterov Dec 5, 2024
bc30dc4
Refactor
a-masterov Dec 5, 2024
9c0c810
Fix
a-masterov Dec 5, 2024
03b904e
Change the order
a-masterov Dec 5, 2024
47cac9d
debug
a-masterov Dec 5, 2024
32c173d
debug
a-masterov Dec 5, 2024
58397c4
Move
a-masterov Dec 5, 2024
590581c
Fix the error in output's name
a-masterov Dec 5, 2024
8dd7c4f
Use pretty-print output
a-masterov Dec 5, 2024
4cc719b
Change the branch to delete
a-masterov Dec 5, 2024
8ed4ae8
Fix the branch id to delete
a-masterov Dec 6, 2024
4640e99
Wait operations to finish
a-masterov Dec 6, 2024
6046c2a
Fix for compatibility with jq 1.6
a-masterov Dec 6, 2024
a98c182
Fix an error
a-masterov Dec 6, 2024
451d502
Fix an error
a-masterov Dec 6, 2024
dbe9145
add a limit
a-masterov Dec 6, 2024
51339f6
Merge branch 'refs/heads/main' into amasterov/use-branches-in-regress…
a-masterov Dec 6, 2024
de6aaa1
Roll back changes to python fixtures
a-masterov Dec 6, 2024
0bdb2b1
Fix ruff warnings
a-masterov Dec 6, 2024
82fd651
Merge branch 'main' into amasterov/regress-staging-17
a-masterov Dec 6, 2024
e34c7fc
Merge yml
a-masterov Dec 6, 2024
cd42cb5
Merge branch 'refs/heads/amasterov/use-branches-in-regression-tests' …
a-masterov Dec 6, 2024
53b2299
Fix name
a-masterov Dec 6, 2024
2c32f6b
Fix project-id
a-masterov Dec 6, 2024
8223f40
Fix project-id
a-masterov Dec 6, 2024
a25ba0a
Fix project-id
a-masterov Dec 6, 2024
387a2c2
Remove redundant matrix elem
a-masterov Dec 6, 2024
e1abc73
Merge branch 'main' into amasterov/regress-staging-17
a-masterov Dec 6, 2024
9c80bb3
Remove project-id from the matrix
a-masterov Dec 6, 2024
fd712e1
Add README.md
a-masterov Dec 9, 2024
61bddc0
Do not reattach the endpoint, use default settings instead
a-masterov Dec 9, 2024
6a6a29b
Add a note about PG_VERSION
a-masterov Dec 9, 2024
7bbd26f
Merge branch 'main' into amasterov/regress-staging-17
a-masterov Dec 9, 2024
73bcfda
Use dsn from the `create-branch` action
a-masterov Dec 9, 2024
427a573
Delete unneeded file
a-masterov Dec 9, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/actionlint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,3 +21,5 @@ config-variables:
- SLACK_UPCOMING_RELEASE_CHANNEL_ID
- DEV_AWS_OIDC_ROLE_ARN
- BENCHMARK_INGEST_TARGET_PROJECTID
- PGREGRESS_PG16_PROJECT_ID
- PGREGRESS_PG17_PROJECT_ID
32 changes: 26 additions & 6 deletions .github/workflows/cloud-regress.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,11 +23,14 @@ jobs:
regress:
env:
POSTGRES_DISTRIB_DIR: /tmp/neon/pg_install
DEFAULT_PG_VERSION: 16
TEST_OUTPUT: /tmp/test_output
BUILD_TYPE: remote
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_DEV }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_KEY_DEV }}
strategy:
fail-fast: false
matrix:
pg-version: [16, 17]

runs-on: us-east-2
container:
Expand All @@ -40,9 +43,11 @@ jobs:
submodules: true

- name: Patch the test
env:
PG_VERSION: ${{matrix.pg-version}}
run: |
cd "vendor/postgres-v${DEFAULT_PG_VERSION}"
patch -p1 < "../../compute/patches/cloud_regress_pg${DEFAULT_PG_VERSION}.patch"
cd "vendor/postgres-v${PG_VERSION}"
patch -p1 < "../../compute/patches/cloud_regress_pg${PG_VERSION}.patch"

- name: Generate a random password
id: pwgen
Expand All @@ -55,8 +60,9 @@ jobs:
- name: Change tests according to the generated password
env:
DBPASS: ${{ steps.pwgen.outputs.DBPASS }}
PG_VERSION: ${{matrix.pg-version}}
run: |
cd vendor/postgres-v"${DEFAULT_PG_VERSION}"/src/test/regress
cd vendor/postgres-v"${PG_VERSION}"/src/test/regress
for fname in sql/*.sql expected/*.out; do
sed -i.bak s/NEON_PASSWORD_PLACEHOLDER/"'${DBPASS}'"/ "${fname}"
done
Expand All @@ -73,15 +79,29 @@ jobs:
path: /tmp/neon/
prefix: latest

- name: Create a new branch
id: create-branch
uses: ./.github/actions/neon-branch-create
with:
api_key: ${{ secrets.NEON_STAGING_API_KEY }}
project_id: ${{ vars[format('PGREGRESS_PG{0}_PROJECT_ID', matrix.pg-version)] }}
a-masterov marked this conversation as resolved.
Show resolved Hide resolved

- name: Run the regression tests
uses: ./.github/actions/run-python-test-set
with:
build_type: ${{ env.BUILD_TYPE }}
test_selection: cloud_regress
pg_version: ${{ env.DEFAULT_PG_VERSION }}
pg_version: ${{matrix.pg-version}}
extra_params: -m remote_cluster
env:
BENCHMARK_CONNSTR: ${{ secrets.PG_REGRESS_CONNSTR }}
BENCHMARK_CONNSTR: ${{steps.create-branch.outputs.dsn}}

- name: Delete branch
a-masterov marked this conversation as resolved.
Show resolved Hide resolved
uses: ./.github/actions/neon-branch-delete
with:
api_key: ${{ secrets.NEON_STAGING_API_KEY }}
project_id: ${{ vars[format('PGREGRESS_PG{0}_PROJECT_ID', matrix.pg-version)] }}
branch_id: ${{steps.create-branch.outputs.branch_id}}

- name: Create Allure report
id: create-allure-report
Expand Down
Loading
Loading