[meta] Accessibility tests

[bhavyarm]

This is a meta issue for adding tests for accessibility

Kibana
Base tests and infrastructure
PR: #51893

OSS

• Visualize table A11y base tests #51893
• Create visualizions A11y base tests #51893
• Create dashboard A11y base tests #51893
• Dashboard listing table A11y base tests #51893
• Add one sample data set A11y base tests #51893
• Create index pattern A11y base tests #51893
• Dev tools console A11y base tests #51893
• Filter panel A11y tests for filter panel  #78776
• Kibana overview page without data refactor a11y tests to group by data sets #113876
• Kibana overview page with data refactor a11y tests to group by data sets #113876

Default Distribution

• Discover: Discover a11y tests #54209 a11y tests on adding columns to discover table #59375
• Dashboard: Comprehensive dashboard a11y tests #57821 accessibility tests for dashboard panel ( OSS)  #62055 Accessibility dashboard edit panel tests  #77829
• Visualize: [wip] A11y tests for visualize #54846 (on hiatus because charts are not accessible yet)
• Kibana Management: More a11y tests on index pattern page #59575 A11y tests on saved object management #59601 Accessibility tests for Stack management > advanced settings page #78102 A11y tests for tags and tags management page #127657 A11y tests search sessions management page #128005
• Kibana home a11y for xpack home #62342
• Spaces & feature controls - a11y tests on spaces home page including feature control  #76515
• feature controls - a11y tests on spaces home page including feature control  #76515
• Security - A11y tests for user page #79199, Roles, Role Mapping, api
• Login page and messages - a11y tests for login and logout #60799
• lens - [Lens] Add a11y tests #83594
• Maps - [Maps] (Accessibility) Maps  #57271 ally geo smoke test #127982
• Graph - Graph a11y tests #134694
• Canvas - Adding automated a11y tests for Canvas #91571 (Incomplete coverage)
• Controls - [Controls] Add accessibility tests #130488
• New discover table - Adding a11y tests for the new data grid in discover #131854
• Dashboard controls a11y tests Filter by type panel element click interrupted error  #148657

Management

Stack management

• License Management - A11y tests for license management page #127497
• Upgrade assistant - [Upgrade Assistant] Enable functional and a11y tests #109909
• Deployment management - Ensures select element has an accessible name a11y rule violation on create follow index form #153599
• Create policy form A11y issues on create policy form on snapshot and restore page #153788

Ingest

• Ingest Node Pipelines Added accessibility test for ingest node pipelines #84983
• Logstash Pipelines
• Beats Central Management

Data
#79374

• Index Management - [Index Management] Add accessibility tests  #114872
• Index Lifecycle Policies - Add Accessibility Test For Creating New Policy in ILM #92569
• Snapshot and Restore - Added Snapshot Restore a11y tests. #134414
• Rollup Jobs - Rollup Job a11y Tests #134975
• Transforms [ML] Transforms: Adds a11y tests for Transform plugin #93197
• Cross-Cluster Replication Cross cluster replication a11y tests #135514
• Remote Clusters [Remote Clusters] Added a11y tests and fixed violations #96989

Alerts and Insights

• Alerts - Rules and Connectors - A11y test for rules and connectors #140665
• Reporting Reporting UI needs a11y tests #79375
• Watcher a11y tests for watcher. Minimal in scope. #135046

Stack monitoring

• Elasticsearch A11y tests for monitoring plugin #124248
• Kibana A11y tests for monitoring plugin #124248 a11y test for stack monitoring #134140
• Logstash A11y tests for monitoring plugin #124248
• Beats A11y tests for monitoring plugin #124248
• apm A11y tests for monitoring plugin #124248

Dev tools

• Grok debugger: XPack-Accessibility- Grok Debugger Test #62104 ( currently skipped because of aria-label violation)
• Search profiler : draft search profiler accessibility tests #62357
• Painless Lab :(Accessibility)We need a11y tests for Painless Lab #75221

Other solutions

Observability

• Uptime Uptime app needs a11y tests #61697
• Observability UI A11y tests for Observability plugin #124246
• Logs UI A11y tests for infra plugin #124247
• Metrics UI A11y tests for infra plugin #124247
• Accessibility tests for APM UI #104692
• User experience
• Uptime Uptime Accessibility detail page a11y violation error  #148659
• Uptime Ensures ARIA attributes are allowed for an element's role rule violation on uptime Accessibility detail page #153601

Security ( see the comment section )

• https://github.com/elastic/kibana/blob/main/x-pack/test/accessibility/apps/security_solution.ts ( but this test is skipped)
• Overview
• Detections
• Hosts
• Network
• Timelines
• Cases
• Administration

Machine learning

• ML [ML] Adds a11y tests for ML plugin #88323
• ML [ML] "Buttons must have discernible text" a11y violation on the memory usage annotation marker #153596
• ML [ML] [aria-allowed-attr]: Ensures ARIA attributes are allowed for an element's role on ML notifications button  #153592

Enterprise search

• Enterprise search - [Enterprise Search] Set up automated a11y tests #106765

Fleet

• Overview Adding fleet cypress a11y tests #138192
• Integrations Adding fleet cypress a11y tests #138192
• Policies Adding fleet cypress a11y tests #138192
• Agents Adding fleet cypress a11y tests #138192
• Data steams Adding fleet cypress a11y tests #138192
• Settings Adding fleet cypress a11y tests #138192

Add a table for skipped a11y tests

[bhavyarm]

@rayafratkina @LeeDr

[bhavyarm]

@bhavyarm to add skipped tests table and tracking.

[rashmivkulkarni]

For the Security Solution a11y tests : here is what the team says
Gloria - Hey! before I left for vacation the a11y subject came back to me as a requirement from Kibana QA, I did a POC of using Cypress to write a11y tests to let the managers know how complex could be for us to start working on it and present the subject. My understanding so far is that a11y is not top priority right now since we have other challenges we need to face first, so for now things are going be on-hold.
https://github.com/elastic/kibana/blob/main/x-pack/test/accessibility/apps/security_solution.ts

[cuff-links]

@rashmivkulkarni If the a11y tests for security solutions are the only ones left, I think that we should look at closing this issue and having another issue with just their tasks open and either assign it to them or we hang onto it but we shouldn't block this issue from being closed on account of those issues since it seems that it's deprioritized on their end.

[rashmivkulkarni]

Except for Security Solution Accessibility Tests, rest all others are covered . I agree, this should not be blocking us from closing this issue. I have opened this issue to track security solution tests and have tagged the team. Closing this Meta issue.

cc @elastic/kibana-accessibility

[bhavyarm]

@cuff-links @rashmivkulkarni re-opening this as there are two of my PRs linked to this not completed yet because it needs developer help. Thanks!

[elasticmachine]

Pinging @elastic/kibana-qa (Team:QA)