-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integration tests for Vulnerability Detector: Red Hat 9 support (#3040) #4497
Conversation
a141f9f
to
9ac0e8b
Compare
9ac0e8b
to
97028d6
Compare
97028d6
to
8bb06c8
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please check if there are other similar cases after the changes.
..._detector/test_feeds/data/configuration_template/configuration_import_invalid_feed_type.yaml
Show resolved
Hide resolved
5cdd410
to
be4aee6
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The following tests have failed:
test_vulnerability_detector/test_vulnerability_inventory
test_vulnerability_detector/test_scan_types
https://ci.wazuh.info/view/Tests/job/Test_integration/43183/
Please, after the changes, test if they already work correctly.
All changes were applied, next let's to see the tests evidence: Details
root@wazuh:~/wazuh-qa/deps/wazuh_testing# python3.9 -m pytest -v ../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_baseline_scan.py
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.9.18, pytest-7.1.2, pluggy-1.3.0 -- /usr/bin/python3.9
cachedir: .pytest_cache
metadata: {'Python': '3.9.18', 'Platform': 'Linux-5.15.74-1-pve-x86_64-with-glibc2.31', 'Packages': {'pytest': '7.1.2', 'pluggy': '1.3.0'}, 'Plugins': {'testinfra': '5.0.0', 'html': '3.1.1', 'metadata': '3.0.0'}}
rootdir: /root/wazuh-qa/tests/integration, configfile: pytest.ini
plugins: testinfra-5.0.0, html-3.1.1, metadata-3.0.0
collected 1 item
../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_baseline_scan.py::test_vulnerability_inserted_baseline_scan[RHEL] PASSED [100%]
=============================================================================================== 1 passed in 16.99s ================================================================================================
root@wazuh:~/wazuh-qa/deps/wazuh_testing# python3.9 -m pytest -v ../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_full_scan.py
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.9.18, pytest-7.1.2, pluggy-1.3.0 -- /usr/bin/python3.9
cachedir: .pytest_cache
metadata: {'Python': '3.9.18', 'Platform': 'Linux-5.15.74-1-pve-x86_64-with-glibc2.31', 'Packages': {'pytest': '7.1.2', 'pluggy': '1.3.0'}, 'Plugins': {'testinfra': '5.0.0', 'html': '3.1.1', 'metadata': '3.0.0'}}
rootdir: /root/wazuh-qa/tests/integration, configfile: pytest.ini
plugins: testinfra-5.0.0, html-3.1.1, metadata-3.0.0
collected 2 items
../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_full_scan.py::test_vulnerability_inserted_full_scan[RHEL] PASSED [ 50%]
../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_full_scan.py::test_vulnerability_removed_full_scan[RHEL] PASSED [100%]
=============================================================================================== 2 passed in 31.28s ================================================================================================
root@wazuh:~/wazuh-qa/deps/wazuh_testing# python3.9 -m pytest -v ../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_partial_scan.py
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.9.18, pytest-7.1.2, pluggy-1.3.0 -- /usr/bin/python3.9
cachedir: .pytest_cache
metadata: {'Python': '3.9.18', 'Platform': 'Linux-5.15.74-1-pve-x86_64-with-glibc2.31', 'Packages': {'pytest': '7.1.2', 'pluggy': '1.3.0'}, 'Plugins': {'testinfra': '5.0.0', 'html': '3.1.1', 'metadata': '3.0.0'}}
rootdir: /root/wazuh-qa/tests/integration, configfile: pytest.ini
plugins: testinfra-5.0.0, html-3.1.1, metadata-3.0.0
collected 2 items
../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_partial_scan.py::test_vulnerability_inserted_partial_scan[RHEL] PASSED [ 50%]
../../tests/integration/test_vulnerability_detector/test_vulnerability_inventory/test_vulnerability_inventory_partial_scan.py::test_vulnerability_removed_partial_scan[RHEL] PASSED [100%]
=============================================================================================== 2 passed in 31.88s ================================================================================================
root@wazuh:~/wazuh-qa/deps/wazuh_testing# python3.9 -m pytest -v ../../tests/integration/test_vulnerability_detector/test_scan_types/test_baseline_scan_type.py
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.9.18, pytest-7.1.2, pluggy-1.3.0 -- /usr/bin/python3.9
cachedir: .pytest_cache
metadata: {'Python': '3.9.18', 'Platform': 'Linux-5.15.74-1-pve-x86_64-with-glibc2.31', 'Packages': {'pytest': '7.1.2', 'pluggy': '1.3.0'}, 'Plugins': {'testinfra': '5.0.0', 'html': '3.1.1', 'metadata': '3.0.0'}}
rootdir: /root/wazuh-qa/tests/integration, configfile: pytest.ini
plugins: testinfra-5.0.0, html-3.1.1, metadata-3.0.0
collected 2 items
../../tests/integration/test_vulnerability_detector/test_scan_types/test_baseline_scan_type.py::test_baseline_scan_start[RHEL] PASSED [ 50%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_baseline_scan_type.py::test_baseline_scan_alert[RHEL] PASSED [100%]
=============================================================================================== 2 passed in 31.68s ================================================================================================
root@wazuh:~/wazuh-qa/deps/wazuh_testing# python3.9 -m pytest -v ../../tests/integration/test_vulnerability_detector/test_scan_types/test_full_scan_type.py
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.9.18, pytest-7.1.2, pluggy-1.3.0 -- /usr/bin/python3.9
cachedir: .pytest_cache
metadata: {'Python': '3.9.18', 'Platform': 'Linux-5.15.74-1-pve-x86_64-with-glibc2.31', 'Packages': {'pytest': '7.1.2', 'pluggy': '1.3.0'}, 'Plugins': {'testinfra': '5.0.0', 'html': '3.1.1', 'metadata': '3.0.0'}}
rootdir: /root/wazuh-qa/tests/integration, configfile: pytest.ini
plugins: testinfra-5.0.0, html-3.1.1, metadata-3.0.0
collected 4 items
../../tests/integration/test_vulnerability_detector/test_scan_types/test_full_scan_type.py::test_full_scan_start[RHEL] PASSED [ 25%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_full_scan_type.py::test_full_scan_no_alert_after_no_changes[RHEL] PASSED [ 50%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_full_scan_type.py::test_full_scan_alert_after_changes[RHEL] PASSED [ 75%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_full_scan_type.py::test_full_scan_remove_vulnerability_alert[RHEL] PASSED [100%]
========================================================================================== 4 passed in 80.28s (0:01:20) ===========================================================================================
root@wazuh:~/wazuh-qa/deps/wazuh_testing# python3.9 -m pytest -v ../../tests/integration/test_vulnerability_detector/test_scan_types/test_partial_scan_type.py
=============================================================================================== test session starts ===============================================================================================
platform linux -- Python 3.9.18, pytest-7.1.2, pluggy-1.3.0 -- /usr/bin/python3.9
cachedir: .pytest_cache
metadata: {'Python': '3.9.18', 'Platform': 'Linux-5.15.74-1-pve-x86_64-with-glibc2.31', 'Packages': {'pytest': '7.1.2', 'pluggy': '1.3.0'}, 'Plugins': {'testinfra': '5.0.0', 'html': '3.1.1', 'metadata': '3.0.0'}}
rootdir: /root/wazuh-qa/tests/integration, configfile: pytest.ini
plugins: testinfra-5.0.0, html-3.1.1, metadata-3.0.0
collected 4 items
../../tests/integration/test_vulnerability_detector/test_scan_types/test_partial_scan_type.py::test_partial_scan_start[RHEL] PASSED [ 25%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_partial_scan_type.py::test_partial_scan_no_alert_after_no_changes[RHEL] PASSED [ 50%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_partial_scan_type.py::test_partial_scan_alert_after_changes[RHEL] PASSED [ 75%]
../../tests/integration/test_vulnerability_detector/test_scan_types/test_partial_scan_type.py::test_partial_scan_remove_vulnerability_alert[RHEL] PASSED [100%]
========================================================================================== 4 passed in 91.70s (0:01:31) =========================================================================================== |
35891f8
to
b28ca88
Compare
b28ca88
to
bd2e19d
Compare
ff14180
to
a4bb896
Compare
a4bb896
to
13d0df5
Compare
93ae6bf
to
d9de397
Compare
d9de397
to
13d0df5
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Test execution failed: https://ci.wazuh.info/job/Test_integration_launcher/201/
d4936b7
to
eda39b1
Compare
eda39b1
to
93be49f
Compare
@juliamagan I need your approval here to be able to do the merge, the failure that you show is due to the changes (the SUSE fix wazuh/wazuh#19217) not yet being merged from 4.5.3 to 4.6.0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Description
this development intends to add support for testing RHEL9 linux OS, added to the previous existing references
The following tests should cover the new supported OS version:
Tests were affected
wazuh-qa/tests/integration/test_vulnerability_detector/test_feeds/test_download_feeds.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_feeds/test_duplicate_feeds.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_feeds/test_validate_feed_content.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_providers/test_enabled.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_providers/test_multiple_provider_feeds.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_scan_results/test_scan_nvd_vulnerabilities.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_scan_results/test_scan_provider_and_nvd_vulnerabilities.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_scan_results/test_scan_provider_vulnerabilities.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_scan_results/test_scan_vulnerabilities_triaged_null.py
Details
wazuh-qa/tests/integration/test_vulnerability_detector/test_scan_results/test_scan_vulnerability_removal.py
Details
wazuh_qa/tests/integration/test_vulnerability_detector/test_feeds/test_import_invalid_feed_type.py
Details
PASSED
)4.5.3
- https://ci.wazuh.info/view/Tests/job/Test_integration/43296/ (RHEL and RHEL 9 -PASSED
)4.6.0
- https://ci.wazuh.info/view/Tests/job/Test_integration/43425/ - 🟢