Skip to content

Focus visible test #114

Focus visible test

Focus visible test #114

Triggered via pull request August 1, 2023 17:59
Status Success
Total duration 18m 30s
Artifacts 1
print-info
0s
print-info
accessibility-test-jupyterlab
18m 0s
accessibility-test-jupyterlab
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 1 warning, and 1 notice
[chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells: testing/jupyterlab/tests/axe-violations.test.ts#L43
1) [chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells Error: expect: Property 'toBeAccessible' not found. 41 | await page.notebook.openByPath(`${tmpPath}/${LORENZ}`); 42 | try { > 43 | await expect(page).toBeAccessible(); | ^ 44 | } finally { 45 | await scrollNotebookToBottom(page); 46 | } at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/axe-violations.test.ts:43:13
[chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells: testing/jupyterlab/tests/axe-violations.test.ts#L43
1) [chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells Retry #1 --------------------------------------------------------------------------------------- Error: expect: Property 'toBeAccessible' not found. 41 | await page.notebook.openByPath(`${tmpPath}/${LORENZ}`); 42 | try { > 43 | await expect(page).toBeAccessible(); | ^ 44 | } finally { 45 | await scrollNotebookToBottom(page); 46 | } at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/axe-violations.test.ts:43:13
[chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells: testing/jupyterlab/tests/axe-violations.test.ts#L43
1) [chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells Retry #2 --------------------------------------------------------------------------------------- Error: expect: Property 'toBeAccessible' not found. 41 | await page.notebook.openByPath(`${tmpPath}/${LORENZ}`); 42 | try { > 43 | await expect(page).toBeAccessible(); | ^ 44 | } finally { 45 | await scrollNotebookToBottom(page); 46 | } at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/axe-violations.test.ts:43:13
[chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells: testing/jupyterlab/<anonymous>#L3782
2) [chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells page.evaluate: TypeError: Cannot read properties of undefined (reading 'text') at GalataInpage.waitForCellRun (<anonymous>:3782:34) at GalataInpage.waitForNotebookRun (<anonymous>:3747:32) at eval (eval at evaluate (:191:30), <anonymous>:2:35) at UtilityScript.evaluate (<anonymous>:193:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at NotebookHelper.waitForRun (/home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:347:21) at NotebookHelper.run (/home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:268:16) at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/axe-violations.test.ts:51:5
[chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells: testing/jupyterlab/<anonymous>#L3782
2) [chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells Retry #1 --------------------------------------------------------------------------------------- page.evaluate: TypeError: Cannot read properties of undefined (reading 'text') at GalataInpage.waitForCellRun (<anonymous>:3782:34) at GalataInpage.waitForNotebookRun (<anonymous>:3747:32) at eval (eval at evaluate (:191:30), <anonymous>:2:35) at UtilityScript.evaluate (<anonymous>:193:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at NotebookHelper.waitForRun (/home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:347:21) at NotebookHelper.run (/home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:268:16) at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/axe-violations.test.ts:51:5
[chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells: testing/jupyterlab/<anonymous>#L3782
2) [chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells Retry #2 --------------------------------------------------------------------------------------- page.evaluate: TypeError: Cannot read properties of undefined (reading 'text') at GalataInpage.waitForCellRun (<anonymous>:3782:34) at GalataInpage.waitForNotebookRun (<anonymous>:3747:32) at eval (eval at evaluate (:191:30), <anonymous>:2:35) at UtilityScript.evaluate (<anonymous>:193:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at NotebookHelper.waitForRun (/home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:347:21) at NotebookHelper.run (/home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/node_modules/@jupyterlab/galata/src/helpers/notebook.ts:268:16) at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/axe-violations.test.ts:51:5
[chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator: testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts#L132
3) [chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator Error: focus visible comparison failed on JSHandle@<a href="#" tabindex="1" class="skip-link">Skip to left side bar</a> Expected: false Received: true 130 | `focus visible comparison failed on\n\t${node.toString()}`, 131 | ) > 132 | .toBe(false); | ^ 133 | } 134 | }); 135 | }); at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts:132:10
[chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator: testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts#L132
3) [chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator Error: focus visible comparison failed on JSHandle@<li tabindex="0" role="menuitem" aria-haspopup="true…>…</li> Expected: false Received: true 130 | `focus visible comparison failed on\n\t${node.toString()}`, 131 | ) > 132 | .toBe(false); | ^ 133 | } 134 | }); 135 | }); at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts:132:10
[chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator: testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts#L132
3) [chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator Retry #1 --------------------------------------------------------------------------------------- Error: focus visible comparison failed on JSHandle@<a href="#" tabindex="1" class="skip-link">Skip to left side bar</a> Expected: false Received: true 130 | `focus visible comparison failed on\n\t${node.toString()}`, 131 | ) > 132 | .toBe(false); | ^ 133 | } 134 | }); 135 | }); at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts:132:10
[chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator: testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts#L132
3) [chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator Retry #1 --------------------------------------------------------------------------------------- Error: focus visible comparison failed on JSHandle@<li tabindex="0" role="menuitem" aria-haspopup="true…>…</li> Expected: false Received: true 130 | `focus visible comparison failed on\n\t${node.toString()}`, 131 | ) > 132 | .toBe(false); | ^ 133 | } 134 | }); 135 | }); at /home/runner/work/jupyter-a11y-testing/jupyter-a11y-testing/testing/jupyterlab/tests/regression-tests/visible-focus-indicator-initial-page.test.ts:132:10
🎭 Playwright Run Summary
4 failed [chromium] › axe-violations.test.ts:37:3 › JupyterLab accessibility checks › Lorenz notebook before running all cells [chromium] › axe-violations.test.ts:49:3 › JupyterLab accessibility checks › Lorenz notebook after running all cells [chromium] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator [regression] › regression-tests/visible-focus-indicator-initial-page.test.ts:67:3 › every tab-focusable element on initial app page › should have visible focus indicator 2 passed (5m)
accessibility-test-jupyterlab
Mamba support is still experimental and can result in differently solved environments!

Artifacts

Produced during runtime
Name Size
jupyterlab-a11y-tests-refs-pull-33-merge-097aa4ef Expired
57 MB