Add qa-ctl v0.2
#2299
Merged
Add qa-ctl v0.2
#2299
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 30 commits
September 13, 2021 11:11
Using a test name, it is searched recursively and print if it exists or not. Also, setup.py is updated.
Also, QADOCS logger added. Now we have to migrate from older logger to `qadocs_logger`.
Now it has to be used in all `qa-docs` modules.
…er in `PytestWrap` module. #1879
…er in `Sanity` module. #1879 Also, sanity new lines style and `qa-docs` paths within wazuh framework fixed.
…er in `utils` module. #1879
It only loads the config file within a Config instance.
Custom `qa-docs` logger use
Also added `qa_docs` script copyright.
Also, copyright has been added and doc improved.
It passes pep': pycodestyle --max-line-length=120 --show-source --show-pep8
Also, few incorrect sentences have been corrected because they may create doubts when a user would be read them.
It passes `pycodestyle --max-line-length=120 --show-source --show-pep8`.
…to 1999-qa-ctl-stopping-threads
…heck if test(s) are documentated following the `qa-docs` schema. #1864
Add test documentation validation when running `qa-ctl` in automatic mode
QA-CTL: Remove pytest error traceback test results
Add `--os` parameter validation according to the specified tests in the qa-ctl tool
…lidator QA-CTL: Update JSON schema validator file
In addition, it has been standardize the qa-ctl script according to the PEP-8 standard.
…to 2173-qa-ctl-v2-release
Now the test section is generated correctly when running tests for several systems
Done in config generator
snaow
approved these changes
Dec 16, 2021
|
Great job, another small step helping to the creation of a consistent and robust QA Framework for Wazuh products. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds a new
0.2version ofqa-ctl, plus all the necessary changes toqa-docsto be able to parse the test documentation schema.The new changes introduced in this new version are as follows (you can find the changelog of
qa-ctl0.2here):General improvements
wazuh_qa_ctl#2013--osparameter in qa-ctl to specify the system(s) with which to launch tests automatically #2019qa-ctl#2023qa-docschanges (prev0.1) toqa-ctl(prev0.2) #2080New issues
qa-ctl#2139qa-ctlis not inDEBUGmode #2140qa-ctlon a docker container #2143Add Windows tests support
qa-ctltool #2020Documentation
qa-ctldocumentation forv0.2release #2079Checks
Linux
qa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -dqa-ctl -r test_general_setting_enabled --qa-branch 2173-qa-ctl-v2-release -ddqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -pqa-ctl -c config.yaml --qa-branch 2173-qa-ctl-v2-release --skip-deployment --skip-provisioningqa-ctl -c config.yaml --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -v 4.2.0qa-ctl -r test_general_settings_enabled --dry-runqa-ctl -r test_registry_restrict --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_basic_usage_move_file --qa-branch 2173-qa-ctl-v2-release --os centos windowsWindows
qa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -dqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -ddqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -pqa-ctl -c config.yaml --qa-branch 2173-qa-ctl-v2-release --skip-deployment --skip-provisioningqa-ctl -c config.yaml --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -v 4.2.0qa-ctl -r test_general_settings_enabled --dry-runqa-ctl -r test_registry_restrict --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_basic_usage_move_file --qa-branch 2173-qa-ctl-v2-release --os centos windowsGeneric tests
test_corsqa-ctl -r test_cors --qa-branch 2173-qa-ctl-v2-releasetest_execd_restartqa-ctl -r test_execd_restart --qa-branch 2173-qa-ctl-v2-releasetest_cacheqa-ctl -r test_cache --qa-branch 2173-qa-ctl-v2-releasetest_execd_firewall_dropqa-ctl -r test_execd_firewall_drop --qa-branch 2173-qa-ctl-v2-releasetest_basic_usage_baseline_generationqa-ctl -r test_basic_usage_baseline_generation --qa-branch 2173-qa-ctl-v2-releasetest_agentd_reconnectionqa-ctl -r test_agentd_reconnection --qa-branch 2173-qa-ctl-v2-releasetest_duplicate_entriesqa-ctl -r test_duplicate_entries --qa-branch 2173-qa-ctl-v2-releasetest_basic_usage_create_scheduledqa-ctl -r test_basic_usage_create_scheduled --qa-branch 2173-qa-ctl-v2-releasetest_ignoreqa-ctl -r test_ignore --qa-branch 2173-qa-ctl-v2-releaseInvalid qa-ctl script parameters
qa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release -c config.yaml--versionparameter can be only run in automatic modeqa-ctl -c config.yaml --qa-branch 2173-qa-ctl-v2-release -v 4.2.2--dry-runparameter can only be used in automatic modeqa-ctl -c config.yaml --qa-branch 2173-qa-ctl-v2-release --dry-run--skip-deploymentparameter can only be used in manual modeqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release --skip-deployment--skip-provisioningparameter can only be used in manual modeqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release --skip-provisioning--skip-testingparameter can only be used in manual modeqa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release --skip-testing--versionformat parameter.qa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release --version 4.2--versionrelease parameter.qa-ctl -r test_general_settings_enabled --qa-branch 2173-qa-ctl-v2-release --version 4.1.10--qa-branchparameter. It does not exists on remote repository.qa-ctl -r test_general_settings_enabled --qa-branch bad-branchqa-ctl -r bad_test_name --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_wpk_manager --qa-branch 2173-qa-ctl-v2-releaseqa-ctl -r test_wpk_manager --qa-branch 2173-qa-ctl-v2-release --os windows