Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

End to End Tests

End to End Tests #6643

Triggered via workflow run January 10, 2024 13:51
@t3chguyt3chguy
completed 1333456
Status Failure
Total duration 22m 2s
Artifacts 2

end-to-end-tests.yaml

on: workflow_run
Prepare
2s
Prepare
Matrix: tests
Fit to window
Zoom out
Zoom in

Annotations

12 errors, 5 warnings, and 1 notice
Run Tests 1/8
The process '/usr/bin/xvfb-run' failed with exit code 1
Run Tests 5/8
The process '/usr/bin/xvfb-run' failed with exit code 1
[Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it: matrix-react-sdk/playwright/element-web-test.ts#L201
1) [Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it Error: expect(received).toEqual(expected) // deep equality - Expected - 1 + Received + 37 - Array [] + Array [ + Object { + "description": "Ensures all page content is contained by landmarks", + "help": "All page content should be contained by landmarks", + "helpUrl": "https://dequeuniversity.com/rules/axe/4.8/region?application=playwright", + "id": "region", + "impact": "moderate", + "nodes": Array [ + Object { + "all": Array [], + "any": Array [ + Object { + "data": Object { + "isIframe": false, + }, + "id": "region", + "impact": "moderate", + "message": "Some page content is not contained by landmarks", + "relatedNodes": Array [], + }, + ], + "failureSummary": "Fix any of the following: + Some page content is not contained by landmarks", + "html": "<div class=\"mx_Tooltip_wrapper\"><div role=\"tooltip\" class=\"mx_Tooltip mx_Tooltip_visible\" style=\"display: block; right: 179px; top: 604px; transform: translateY(-50%);\"><div class=\"mx_Tooltip_chevron\"></div>Edit</div></div>", + "impact": "moderate", + "none": Array [], + "target": Array [ + ".mx_Tooltip_wrapper", + ], + }, + ], + "tags": Array [ + "cat.keyboard", + "best-practice", + ], + }, + ] at ../element-web-test.ts:201 199 | }); 200 | > 201 | expect(results.violations).toEqual([]); | ^ 202 | }), 203 | 204 | app: async ({ page }, use) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:201:40 at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/editing/editing.spec.ts:294:13
[Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it: matrix-react-sdk/playwright/element-web-test.ts#L201
1) [Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality - Expected - 1 + Received + 37 - Array [] + Array [ + Object { + "description": "Ensures all page content is contained by landmarks", + "help": "All page content should be contained by landmarks", + "helpUrl": "https://dequeuniversity.com/rules/axe/4.8/region?application=playwright", + "id": "region", + "impact": "moderate", + "nodes": Array [ + Object { + "all": Array [], + "any": Array [ + Object { + "data": Object { + "isIframe": false, + }, + "id": "region", + "impact": "moderate", + "message": "Some page content is not contained by landmarks", + "relatedNodes": Array [], + }, + ], + "failureSummary": "Fix any of the following: + Some page content is not contained by landmarks", + "html": "<div class=\"mx_Tooltip_wrapper\"><div role=\"tooltip\" class=\"mx_Tooltip mx_Tooltip_visible\" style=\"display: block; right: 179px; top: 604px; transform: translateY(-50%);\"><div class=\"mx_Tooltip_chevron\"></div>Edit</div></div>", + "impact": "moderate", + "none": Array [], + "target": Array [ + ".mx_Tooltip_wrapper", + ], + }, + ], + "tags": Array [ + "cat.keyboard", + "best-practice", + ], + }, + ] at ../element-web-test.ts:201 199 | }); 200 | > 201 | expect(results.violations).toEqual([]); | ^ 202 | }), 203 | 204 | app: async ({ page }, use) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:201:40 at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/editing/editing.spec.ts:294:13
[Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it: matrix-react-sdk/playwright/element-web-test.ts#L201
1) [Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(received).toEqual(expected) // deep equality - Expected - 1 + Received + 37 - Array [] + Array [ + Object { + "description": "Ensures all page content is contained by landmarks", + "help": "All page content should be contained by landmarks", + "helpUrl": "https://dequeuniversity.com/rules/axe/4.8/region?application=playwright", + "id": "region", + "impact": "moderate", + "nodes": Array [ + Object { + "all": Array [], + "any": Array [ + Object { + "data": Object { + "isIframe": false, + }, + "id": "region", + "impact": "moderate", + "message": "Some page content is not contained by landmarks", + "relatedNodes": Array [], + }, + ], + "failureSummary": "Fix any of the following: + Some page content is not contained by landmarks", + "html": "<div class=\"mx_Tooltip_wrapper\"><div role=\"tooltip\" class=\"mx_Tooltip mx_Tooltip_visible\" style=\"display: block; right: 179px; top: 604px; transform: translateY(-50%);\"><div class=\"mx_Tooltip_chevron\"></div>Edit</div></div>", + "impact": "moderate", + "none": Array [], + "target": Array [ + ".mx_Tooltip_wrapper", + ], + }, + ], + "tags": Array [ + "cat.keyboard", + "best-practice", + ], + }, + ] at ../element-web-test.ts:201 199 | }); 200 | > 201 | expect(results.violations).toEqual([]); | ^ 202 | }), 203 | 204 | app: async ({ page }, use) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:201:40 at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/editing/editing.spec.ts:294:13
[Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen: matrix-react-sdk/playwright/e2e/login/utils.ts#L45
2) [Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:45 43 | 44 | // Synapse prompts us to pick a user ID > 45 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 46 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 47 | 48 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/utils.ts:45:78) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/login.spec.ts:100:13
[Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen: matrix-react-sdk/playwright/e2e/login/utils.ts#L45
2) [Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:45 43 | 44 | // Synapse prompts us to pick a user ID > 45 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 46 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 47 | 48 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/utils.ts:45:78) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/login.spec.ts:100:13
[Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen: matrix-react-sdk/playwright/e2e/login/utils.ts#L45
2) [Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:45 43 | 44 | // Synapse prompts us to pick a user ID > 45 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 46 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 47 | 48 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/utils.ts:45:78) at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/login.spec.ts:100:13
[Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails: matrix-react-sdk/playwright/e2e/login/utils.ts#L45
3) [Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails, and allows a re-login Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:45 43 | 44 | // Synapse prompts us to pick a user ID > 45 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 46 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 47 | 48 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/utils.ts:45:78) at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/soft_logout.spec.ts:62:30)
[Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails: matrix-react-sdk/playwright/e2e/login/utils.ts#L45
3) [Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails, and allows a re-login Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:45 43 | 44 | // Synapse prompts us to pick a user ID > 45 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 46 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 47 | 48 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/utils.ts:45:78) at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/soft_logout.spec.ts:62:30)
[Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails: matrix-react-sdk/playwright/e2e/login/utils.ts#L45
3) [Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails, and allows a re-login Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Create your account' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Create your account' }) at login/utils.ts:45 43 | 44 | // Synapse prompts us to pick a user ID > 45 | await expect(page.getByRole("heading", { name: "Create your account" })).toBeVisible(); | ^ 46 | await page.getByRole("textbox", { name: "Username (required)" }).fill("alice"); 47 | 48 | // wait for username validation to start, and complete at doTokenRegistration (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/utils.ts:45:78) at Object.user (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/login/soft_logout.spec.ts:62:30)
[Rust Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it: matrix-react-sdk/playwright/element-web-test.ts#L201
4) [Rust Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it Error: expect(received).toEqual(expected) // deep equality - Expected - 1 + Received + 37 - Array [] + Array [ + Object { + "description": "Ensures all page content is contained by landmarks", + "help": "All page content should be contained by landmarks", + "helpUrl": "https://dequeuniversity.com/rules/axe/4.8/region?application=playwright", + "id": "region", + "impact": "moderate", + "nodes": Array [ + Object { + "all": Array [], + "any": Array [ + Object { + "data": Object { + "isIframe": false, + }, + "id": "region", + "impact": "moderate", + "message": "Some page content is not contained by landmarks", + "relatedNodes": Array [], + }, + ], + "failureSummary": "Fix any of the following: + Some page content is not contained by landmarks", + "html": "<div class=\"mx_Tooltip_wrapper\"><div role=\"tooltip\" class=\"mx_Tooltip mx_Tooltip_visible\" style=\"display: block; right: 179px; top: 604px; transform: translateY(-50%);\"><div class=\"mx_Tooltip_chevron\"></div>Edit</div></div>", + "impact": "moderate", + "none": Array [], + "target": Array [ + ".mx_Tooltip_wrapper", + ], + }, + ], + "tags": Array [ + "cat.keyboard", + "best-practice", + ], + }, + ] at ../element-web-test.ts:201 199 | }); 200 | > 201 | expect(results.violations).toEqual([]); | ^ 202 | }), 203 | 204 | app: async ({ page }, use) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/element-web-test.ts:201:40 at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/editing/editing.spec.ts:294:13
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 5.9m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.4m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.8m
Slow Test: [Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 3.8m
Slow Test: [Legacy Crypto] › read-receipts/high-level.spec.ts#L1
[Legacy Crypto] › read-receipts/high-level.spec.ts took 3.6m
🎭 Playwright Run Summary
6 failed [Legacy Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it [Legacy Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen [Legacy Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails, and allows a re-login [Rust Crypto] › editing/editing.spec.ts:265:9 › Editing › should close the composer when clicking save after making a change and undoing it [Rust Crypto] › login/login.spec.ts:93:13 › Login › SSO login › logs in with SSO and lands on the home screen [Rust Crypto] › login/soft_logout.spec.ts:72:13 › Soft logout › with SSO user › shows the soft-logout page when a request fails, and allows a re-login 4 flaky [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A [Rust Crypto] › presence/presence.spec.ts:26:13 › Presence tests › bob unreachable › renders unreachable presence state correctly [Rust Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A [Rust Crypto] › timeline/timeline.spec.ts:555:13 › Timeline › message displaying › should set inline start padding to a hidden event line 114 skipped 624 passed (18.0m)

Artifacts

Produced during runtime
Name Size
all-blob-reports Expired
53 MB
html-report--attempt-1 Expired
70.8 MB