Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump AWS Integration tests to later Python #1816

Merged

Conversation

tremble
Copy link
Contributor

@tremble tremble commented Aug 11, 2023

The AWS Integration tests run against Ansible "milestone". The milestone release has been updated and dropped support for Python 3.9 on controllers, and as such we need to bump the version we're running integration tests against.

@softwarefactory-project-zuul
Copy link
Contributor

Build succeeded.
https://ansible.softwarefactory-project.io/zuul/buildset/ac82bfab3e6247a2b8cfb31d3d4f633e

✔️ ansible-tox-linters SUCCESS in 10m 38s
✔️ ansible-tox-py38 SUCCESS in 12m 12s
✔️ ansible-tox-py39 SUCCESS in 11m 11s
✔️ ansible-tox-py310 SUCCESS in 11m 25s

@felixfontein
Copy link
Contributor

It now stops a bit later, complaining that there are no selinux bindings for Python 3.11:

2023-08-11 18:01:42.310442 | TASK [deploy-artifacts : Install require-project collection using ansible-galaxy]
2023-08-11 18:01:42.778275 | controller | Traceback (most recent call last):
2023-08-11 18:01:42.778311 | controller |   File "/home/zuul/venv/bin/ansible-galaxy", line 5, in <module>
2023-08-11 18:01:42.778319 | controller |     from ansible.cli.galaxy import main
2023-08-11 18:01:42.778345 | controller |   File "/home/zuul/venv/lib/python3.11/site-packages/ansible/cli/__init__.py", line 102, in <module>
2023-08-11 18:01:42.778395 | controller |     from ansible.module_utils.common.file import is_executable
2023-08-11 18:01:42.778416 | controller |   File "/home/zuul/venv/lib/python3.11/site-packages/ansible/module_utils/common/file.py", line 12, in <module>
2023-08-11 18:01:42.778449 | controller |     import selinux  # pylint: disable=unused-import
2023-08-11 18:01:42.778456 | controller |     ^^^^^^^^^^^^^^
2023-08-11 18:01:42.778461 | controller |   File "/home/zuul/venv/lib/python3.11/site-packages/selinux/__init__.py", line 106, in <module>
2023-08-11 18:01:42.778508 | controller |     check_system_sitepackages()
2023-08-11 18:01:42.778527 | controller |   File "/home/zuul/venv/lib/python3.11/site-packages/selinux/__init__.py", line 102, in check_system_sitepackages
2023-08-11 18:01:42.778569 | controller |     raise Exception(
2023-08-11 18:01:42.778578 | controller | Exception: Failed to detect selinux python bindings at ['/usr/local/lib64/python3.11/site-packages', '/usr/local/lib/python3.11/site-packages', '/usr/lib64/python3.11/site-packages', '/usr/lib/python3.11/site-packages']
2023-08-11 18:01:42.839614 | controller | ERROR
2023-08-11 18:01:42.839750 | controller | {
2023-08-11 18:01:42.839798 | controller |   "delta": "0:00:00.259139",
2023-08-11 18:01:42.839825 | controller |   "end": "2023-08-11 18:01:42.805542",
2023-08-11 18:01:42.839849 | controller |   "msg": "non-zero return code",
2023-08-11 18:01:42.839894 | controller |   "rc": 1,
2023-08-11 18:01:42.839918 | controller |   "start": "2023-08-11 18:01:42.546403"
2023-08-11 18:01:42.839941 | controller | }

🙄

@gravesm
Copy link
Member

gravesm commented Aug 16, 2023

Using 3.10 will get you past the selinux issues, but then fail to install pyyaml because of aws/aws-cli#8036, which I assume would also be a problem with 3.11.

@gravesm
Copy link
Member

gravesm commented Aug 16, 2023

#1819 should fix the selinux problem.

@felixfontein
Copy link
Contributor

felixfontein commented Aug 16, 2023

There's also zuul.d/amazon-aws-periodical-jobs.yaml which also needs to be updated I guess (#1817). (See https://github.com/ansible/ansible-zuul-jobs/pull/1817/files)

@alinabuzachis
Copy link
Collaborator

@tremble What's the Python version we want to use: 3.10 or 3.11? There's also this PR https://github.com/ansible/ansible-zuul-jobs/pull/1818/files that updates the zuul.d/amazon-aws-periodical-jobs.yaml to 3.10.

@tremble
Copy link
Contributor Author

tremble commented Aug 22, 2023

@tremble What's the Python version we want to use: 3.10 or 3.11? There's also this PR https://github.com/ansible/ansible-zuul-jobs/pull/1818/files that updates the zuul.d/amazon-aws-periodical-jobs.yaml to 3.10.

We now run the compile and unit tests against all supported versions, IMO we can use either. I'd lean towards 3.11 to increase the chance that we're away from Zuul by the time this hits again

@gravesm
Copy link
Member

gravesm commented Aug 22, 2023

Strongly prefer 3.11 for the reason @tremble stated.

@gravesm gravesm added the mergeit Merge the PR (SoftwareFActory) label Aug 22, 2023
@softwarefactory-project-zuul
Copy link
Contributor

Build succeeded (gate pipeline).
https://ansible.softwarefactory-project.io/zuul/buildset/9a10022d4e8748db8dc57688b8a4cc25

✔️ ansible-tox-linters SUCCESS in 10m 29s
✔️ ansible-tox-py38 SUCCESS in 10m 39s
✔️ ansible-tox-py39 SUCCESS in 10m 59s

@softwarefactory-project-zuul softwarefactory-project-zuul bot merged commit f16d066 into ansible:master Aug 22, 2023
2 checks passed
softwarefactory-project-zuul bot pushed a commit to ansible-collections/community.aws that referenced this pull request Aug 24, 2023
CI: Force PyYAML version that can be installed

SUMMARY
Currently integration tests with ansible/ansible-zuul-jobs#1816 still fail when installing some requirements:
2023-08-22 05:53:46.350742 | TASK [ansible-test : Install python requirements]
[...]

2023-08-22 05:53:53.860850 | controller | Collecting PyYAML<5.5,>=3.10 (from awscli->-r /home/zuul-worker/.ansible/collections/ansible_collections/community/aws/test-requirements.txt (line 19))
2023-08-22 05:53:53.866271 | controller |   Downloading PyYAML-5.4.1.tar.gz (175 kB)
2023-08-22 05:53:53.878160 | controller |      �������������������������������������� 175.1/175.1 kB 19.0 MB/s eta 0:00:00
2023-08-22 05:53:54.065094 | controller |   Installing build dependencies: started
2023-08-22 05:53:58.372457 | controller |   Installing build dependencies: finished with status 'done'
2023-08-22 05:53:58.373282 | controller |   Getting requirements to build wheel: started
2023-08-22 05:53:58.680407 | controller |   Getting requirements to build wheel: finished with status 'error'
2023-08-22 05:53:58.689654 | controller |   error: subprocess-exited-with-error

(https://b3e35e76f7fc3e0cf6b5-d430d94f79a1de67219002b64dcf7484.ssl.cf1.rackcdn.com/1904/63f02a9c37ef75f9dcf25159fb4033d6edf146ee/check/integration-community.aws-1/b2f8016/job-output.txt)
Tries to work around this problem by pinning the PyYAML version to 5.3.1 (see also yaml/pyyaml#736).
ISSUE TYPE

Test Pull Request

COMPONENT NAME
integration tests

Reviewed-by: Alina Buzachis
Reviewed-by: Mark Chappell
Reviewed-by: Felix Fontein <felix@fontein.de>
Reviewed-by: Markus Bergholz <git@osuv.de>
patchback bot pushed a commit to ansible-collections/community.aws that referenced this pull request Aug 24, 2023
CI: Force PyYAML version that can be installed

SUMMARY
Currently integration tests with ansible/ansible-zuul-jobs#1816 still fail when installing some requirements:
2023-08-22 05:53:46.350742 | TASK [ansible-test : Install python requirements]
[...]

2023-08-22 05:53:53.860850 | controller | Collecting PyYAML<5.5,>=3.10 (from awscli->-r /home/zuul-worker/.ansible/collections/ansible_collections/community/aws/test-requirements.txt (line 19))
2023-08-22 05:53:53.866271 | controller |   Downloading PyYAML-5.4.1.tar.gz (175 kB)
2023-08-22 05:53:53.878160 | controller |      �������������������������������������� 175.1/175.1 kB 19.0 MB/s eta 0:00:00
2023-08-22 05:53:54.065094 | controller |   Installing build dependencies: started
2023-08-22 05:53:58.372457 | controller |   Installing build dependencies: finished with status 'done'
2023-08-22 05:53:58.373282 | controller |   Getting requirements to build wheel: started
2023-08-22 05:53:58.680407 | controller |   Getting requirements to build wheel: finished with status 'error'
2023-08-22 05:53:58.689654 | controller |   error: subprocess-exited-with-error

(https://b3e35e76f7fc3e0cf6b5-d430d94f79a1de67219002b64dcf7484.ssl.cf1.rackcdn.com/1904/63f02a9c37ef75f9dcf25159fb4033d6edf146ee/check/integration-community.aws-1/b2f8016/job-output.txt)
Tries to work around this problem by pinning the PyYAML version to 5.3.1 (see also yaml/pyyaml#736).
ISSUE TYPE

Test Pull Request

COMPONENT NAME
integration tests

Reviewed-by: Alina Buzachis
Reviewed-by: Mark Chappell
Reviewed-by: Felix Fontein <felix@fontein.de>
Reviewed-by: Markus Bergholz <git@osuv.de>
(cherry picked from commit 002b139)
felixfontein added a commit to felixfontein/community.aws that referenced this pull request Aug 24, 2023
CI: Force PyYAML version that can be installed

SUMMARY
Currently integration tests with ansible/ansible-zuul-jobs#1816 still fail when installing some requirements:
2023-08-22 05:53:46.350742 | TASK [ansible-test : Install python requirements]
[...]

2023-08-22 05:53:53.860850 | controller | Collecting PyYAML<5.5,>=3.10 (from awscli->-r /home/zuul-worker/.ansible/collections/ansible_collections/community/aws/test-requirements.txt (line 19))
2023-08-22 05:53:53.866271 | controller |   Downloading PyYAML-5.4.1.tar.gz (175 kB)
2023-08-22 05:53:53.878160 | controller |      �������������������������������������� 175.1/175.1 kB 19.0 MB/s eta 0:00:00
2023-08-22 05:53:54.065094 | controller |   Installing build dependencies: started
2023-08-22 05:53:58.372457 | controller |   Installing build dependencies: finished with status 'done'
2023-08-22 05:53:58.373282 | controller |   Getting requirements to build wheel: started
2023-08-22 05:53:58.680407 | controller |   Getting requirements to build wheel: finished with status 'error'
2023-08-22 05:53:58.689654 | controller |   error: subprocess-exited-with-error

(https://b3e35e76f7fc3e0cf6b5-d430d94f79a1de67219002b64dcf7484.ssl.cf1.rackcdn.com/1904/63f02a9c37ef75f9dcf25159fb4033d6edf146ee/check/integration-community.aws-1/b2f8016/job-output.txt)
Tries to work around this problem by pinning the PyYAML version to 5.3.1 (see also yaml/pyyaml#736).
ISSUE TYPE

Test Pull Request

COMPONENT NAME
integration tests

Reviewed-by: Alina Buzachis
Reviewed-by: Mark Chappell
Reviewed-by: Felix Fontein <felix@fontein.de>
Reviewed-by: Markus Bergholz <git@osuv.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mergeit Merge the PR (SoftwareFActory)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants