Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.8.0 - Beta 2 - Wazuh UI regression testing #6446

Closed
1 task done
asteriscos opened this issue Feb 26, 2024 · 3 comments
Closed
1 task done

Release 4.8.0 - Beta 2 - Wazuh UI regression testing #6446

asteriscos opened this issue Feb 26, 2024 · 3 comments
Assignees
Labels
level/task Task issue type/test Test issue

Comments

@asteriscos
Copy link
Member

asteriscos commented Feb 26, 2024

The following issue aims to run manual tests for the current release candidate, report the results, and open new issues for any encountered errors.

Wazuh UI tests information

Main release candidate issue wazuh/wazuh#22069
Version 4.8.0
Release candidate # Beta 2
Tag v4.8.0-2.10.0-beta2
Previous UI regression tests issue #6386

Test report procedure

TL;DR

  1. The specified tests will be executed in every platform and version mentioned in this issue.
  2. Include evidence of each test performed.
  3. Report any problem or bug. Open a new issue for each of them and link them here.
  4. Justify skipped tests.

All test results must have one the following statuses:

Doesn't apply
The test hasn't started yet.
🟢 All checks passed.
🔴 There is at least one failed check.
🟡 There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause.
It must be included in the Problems section of the current release candidate issue.

Any expected fail or skipped test must be justified with a reason.
All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip, txt or images.
This report can be used by the auditors to dig deeper into any possible failures and details.

Test template

Test Chrome Firefox Safari
-

Test plan

  1. Verify the app package installs and operates as expected.
  2. Fixed a error pop-up spawn in MITRE ATT&CK
  3. Changed overview home top KPIs
  4. Change text in endpoint summary most active agent tooltip
  5. Add the Vulnerabilities Detection application to the menu in Endpoints summary view
  6. Remove the vulnerability pattern check in the health check
  7. Add cluster filter by default in vulnerabilities dashboard and inventory tab
  8. Check the existence of the index pattern of vulnerabilities states in Vulnerabilities Detection tabs
  9. Add manager filter with cluster mode disabled
  10. Change the value to display in the Top 5 agents table
  11. Changed most vulnerable endpoint label
  12. Exclude server filters on Vulnerabilities Detection > Dashboard and Inventory

Test

Test Chrome Firefox Safari
Verify the app package installs and operates as expected 🟢 🟢
Fixed a error pop-up spawn in MITRE ATT&CK 🟢 🟢
Changed overview home top KPIs 🟢 🟢 🟢
Change text in endpoint summary most active agent tooltip 🟢 🟢
Add the Vulnerabilities Detection application to the menu in Endpoints summary view 🟢 🟢
Remove the vulnerability pattern check in the health check 🟢 🟢
Add cluster filter by default in vulnerabilities dashboard and inventory tab 🟡 🟡
Check the existence of the index pattern of vulnerabilities states in Vulnerabilities Detection tabs 🟢 🟢
Add manager filter with cluster mode disabled 🟢 🟢
Change the value to display in the Top 5 agents table 🟢 🟢
Changed most vulnerable endpoint label 🟢 🟢
Exclude server filters on Vulnerabilities Detection > Dashboard and Inventory 🟢 🟢

Conclusions

All tests have been executed and the results can be seen above.

Issues found:

Even though this was not part of the mentioned pull request, I found an unexpected behavior when using the visualization filters. I opened the following issue:

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted to close this issue.

@JuanGarriuz
Copy link
Member

JuanGarriuz commented Feb 27, 2024

Test Chrome Firefox Safari
Verify the app package installs and operates as expected 🟢 🟢
Fixed a error pop-up spawn in MITRE ATT&CK 🟢 🟢
Changed overview home top KPIs 🟢 🟢 🟢
Change text in endpoint summary most active agent tooltip 🟢 🟢
Add the Vulnerabilities Detection application to the menu in Endpoints summary view 🟢 🟢
Remove the vulnerability pattern check in the health check 🟢 🟢
Add cluster filter by default in vulnerabilities dashboard and inventory tab 🟡 🟡
Check the existence of the index pattern of vulnerabilities states in Vulnerabilities Detection tabs 🟢 🟢
Add manager filter with cluster mode disabled 🟢 🟢
Change the value to display in the Top 5 agents table 🟢 🟢
Changed most vulnerable endpoint label 🟢 🟢
Exclude server filters on Vulnerabilities Detection > Dashboard and Inventory 🟢 🟢

Verify the app package installs and operates as expected

🟢 Chrome

image

🟢 Firefox

Screenshot from 2024-02-27 13-47-13

Fixed an error pop-up spawn in MITRE ATT&CK

🟢 Chrome

image

🟢 Firefox

Screenshot from 2024-02-27 16-07-24

Changed overview home top KPIs

🟢 Chrome

image

🟢 Firefox

image

🟢 Safari

image

Change text in endpoint summary most active agent tooltip

🟢 Chrome

image

🟢 Firefox

image

Add the Vulnerabilities Detection application to the menu in Endpoints summary view

🟢 Chrome

Screenshot from 2024-02-27 13-40-27

🟢 Firefox

Screenshot from 2024-02-27 13-42-04

Remove the vulnerability pattern check in the health check

🟢 Chrome

image

screencapture-192-168-56-18-app-app-settings-2024-02-27-13_51_13

🟢 Firefox

image

image

Add cluster filter by default in vulnerabilities dashboard and inventory tab

🟡 Chrome

image

image

The specific test of the pull request works fine, but when I tested the visualization filters they were lost when I changed between dashboard and inventory tabs.

Peek 2024-02-27 16-55

🟡 Firefox

image

image

The specific test of the pull request works fine, but when I tested the visualization filters they were lost when I changed between dashboard and inventory tabs.

Peek 2024-02-27 17-00

Check the existence of the index pattern of vulnerabilities states in Vulnerabilities Detection tabs

🟢 Chrome

✔️ Both tabs show a call with a warning when the Vulnerabilities module is disabled

✔️ If the index-pattern doesn't exist both tabs create it

Peek 2024-02-27 16-37

Peek 2024-02-27 16-36

🟢 Firefox

✔️ Both tabs show a call with a warning when the Vulnerabilities module is disabled

✔️ If the index-pattern doesn't exist both tabs create it

Peek 2024-02-27 16-50

Peek 2024-02-27 16-41

Add manager filter with cluster mode disabled

🟢 Chrome

Screenshot from 2024-02-27 16-10-51

image

image

🟢 Firefox

image

image

image

Change the value to display in the Top 5 agents table

🟢 Chrome

image

🟢 Firefox

image

Changed most vulnerable endpoint label

🟢 Chrome

image

🟢 Firefox

image

Exclude server filters on Vulnerabilities Detection > Dashboard and Inventory

🟢 Chrome

image

image

🟢 Firefox

image

image

@wazuhci wazuhci moved this from Backlog to In progress in Release 4.8.0 Feb 27, 2024
@wazuhci wazuhci moved this from In progress to Pending review in Release 4.8.0 Feb 27, 2024
@asteriscos
Copy link
Member Author

LGTM

@wazuhci wazuhci moved this from Pending review to Pending final review in Release 4.8.0 Feb 27, 2024
@wazuhci wazuhci moved this from Pending final review to In final review in Release 4.8.0 Feb 28, 2024
@damarisg
Copy link
Member

LGTM!

@damarisg damarisg moved this from In final review to Done in Release 4.8.0 Feb 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
level/task Task issue type/test Test issue
Projects
No open projects
Status: Done
Development

No branches or pull requests

4 participants