Skip to content

End to End Tests

End to End Tests #3553

Triggered via merge group December 23, 2024 22:36
Status Success
Total duration 14m 49s
Artifacts 8

end-to-end-tests.yaml

on: merge_group
Build Element-Web
1m 41s
Build Element-Web
Matrix: playwright
end-to-end-tests
32s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

7 errors, 29 warnings, and 6 notices
[Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot: playwright/e2e/right-panel/right-panel.spec.ts#L51
1) [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#loremIpsumDolorSitAmetConsecteturAdipisicingElitSedDoEiusmodTemporIncididuntUtLaboreEtDoloreMagnaAliqua:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#loremIpsumDolorSitAmetConsecteturAdipisicingElitSedDoEiusmodTemporIncididuntUtLaboreEtDoloreMagnaAliqua:localhost') 49 | await localAddresses.getByRole("textbox").fill(ROOM_ADDRESS_LONG); 50 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 51 | await expect(localAddresses.getByText(`#${ROOM_ADDRESS_LONG}:localhost`)).toHaveClass( | ^ 52 | "mx_EditableItem_item", 53 | ); 54 | at /home/runner/work/element-web/element-web/playwright/e2e/right-panel/right-panel.spec.ts:51:87
[Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot: playwright/e2e/right-panel/right-panel.spec.ts#L51
1) [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#loremIpsumDolorSitAmetConsecteturAdipisicingElitSedDoEiusmodTemporIncididuntUtLaboreEtDoloreMagnaAliqua:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#loremIpsumDolorSitAmetConsecteturAdipisicingElitSedDoEiusmodTemporIncididuntUtLaboreEtDoloreMagnaAliqua:localhost') 49 | await localAddresses.getByRole("textbox").fill(ROOM_ADDRESS_LONG); 50 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 51 | await expect(localAddresses.getByText(`#${ROOM_ADDRESS_LONG}:localhost`)).toHaveClass( | ^ 52 | "mx_EditableItem_item", 53 | ); 54 | at /home/runner/work/element-web/element-web/playwright/e2e/right-panel/right-panel.spec.ts:51:87
[Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue: playwright/e2e/read-receipts/index.ts#L446
1) [Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for getByRole('treeitem', { name: /^Room Beta/ }).locator('.mx_NotificationBadge_dot') 9 × locator resolved to <div class="mx_NotificationBadge mx_NotificationBadge_visible mx_NotificationBadge_dot">…</div> - unexpected value "visible" at read-receipts/index.ts:446 444 | async assertRead(room: string | { name: string }) { 445 | const tile = this.getRoomListTile(room); > 446 | await expect(tile.locator(".mx_NotificationBadge_dot")).not.toBeVisible(); | ^ 447 | await expect(tile.locator(".mx_NotificationBadge_count")).not.toBeVisible(); 448 | } 449 | at Helpers.assertRead (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:446:69) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/redactions-in-threads.spec.ts:440:28
[Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:53:17 › Read receipts › editing messages › in the main timeline › Editing a message after marking as read leaves the room read @mergequeue: eval at evaluate (:234:30)#L1
1) [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:53:17 › Read receipts › editing messages › in the main timeline › Editing a message after marking as read leaves the room read @mergequeue Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/editing-messages-main-timeline.spec.ts:61:17
[Chrome] › read-receipts/high-level.spec.ts:111:13 › Read receipts › Paging up › Paging up through old messages of an unread room leaves the room unread @mergequeue: eval at evaluate (:234:30)#L1
2) [Chrome] › read-receipts/high-level.spec.ts:111:13 › Read receipts › Paging up › Paging up through old messages of an unread room leaves the room unread @mergequeue Error: jsHandle.evaluate: TypeError: Cannot read properties of undefined (reading 'roomId') at eval (eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (<anonymous>:236:17) at UtilityScript.<anonymous> (<anonymous>:1:44) at eval (/home/runner/work/element-web/element-web/eval at evaluate (:234:30), <anonymous>:1:14) at UtilityScript.evaluate (/home/runner/work/element-web/element-web/<anonymous>:236:17) at UtilityScript.<anonymous> (/home/runner/work/element-web/element-web/<anonymous>:1:44) at Helpers.sendMessageAsClient (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:338:35) at Helpers.receiveMessages (/home/runner/work/element-web/element-web/playwright/e2e/read-receipts/index.ts:582:9) at /home/runner/work/element-web/element-web/playwright/e2e/read-receipts/high-level.spec.ts:119:13
[Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/e2e/oidc/oidc-native.spec.ts#L1
1) [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Test timeout of 90000ms exceeded.
[Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit: playwright/e2e/oidc/oidc-native.spec.ts#L19
1) [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit Error: page.waitForRequest: Test timeout of 90000ms exceeded. 17 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 18 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 19 | const tokenApiPromise = page.waitForRequest( | ^ 20 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 21 | ); 22 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:19:38
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 1.0m
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 43.0s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 38.2s
Slow Test: [Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 30.7s
Slow Test: [Chrome] › read-receipts/room-list-order.spec.ts#L1
[Chrome] › read-receipts/room-list-order.spec.ts took 26.9s
Slow Test: [Chrome] › read-receipts/redactions-main-timeline.spec.ts#L1
[Chrome] › read-receipts/redactions-main-timeline.spec.ts took 1.9m
Slow Test: [Chrome] › read-receipts/read-receipts.spec.ts#L1
[Chrome] › read-receipts/read-receipts.spec.ts took 1.1m
Slow Test: [Chrome] › read-receipts/reactions-in-threads.spec.ts#L1
[Chrome] › read-receipts/reactions-in-threads.spec.ts took 55.8s
Slow Test: [Chrome] › read-receipts/redactions-thread-roots.spec.ts#L1
[Chrome] › read-receipts/redactions-thread-roots.spec.ts took 52.6s
Slow Test: [Chrome] › read-receipts/new-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/new-messages-thread-roots.spec.ts took 51.6s
Slow Test: [Chrome] › read-receipts/new-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/new-messages-in-threads.spec.ts took 1.6m
Slow Test: [Chrome] › read-receipts/editing-messages-in-threads.spec.ts#L1
[Chrome] › read-receipts/editing-messages-in-threads.spec.ts took 1.2m
Slow Test: [Chrome] › read-receipts/new-messages-main-timeline.spec.ts#L1
[Chrome] › read-receipts/new-messages-main-timeline.spec.ts took 1.2m
Slow Test: [Chrome] › read-receipts/editing-messages-thread-roots.spec.ts#L1
[Chrome] › read-receipts/editing-messages-thread-roots.spec.ts took 51.9s
Slow Test: [Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.7m
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.2m
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.6m
Slow Test: [Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 35.1s
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 32.9s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.2m
Slow Test: [Chrome] › pinned-messages/pinned-messages.spec.ts#L1
[Chrome] › pinned-messages/pinned-messages.spec.ts took 1.7m
Slow Test: [Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.0m
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 37.1s
Slow Test: [Chrome] › integration-manager/read_events.spec.ts#L1
[Chrome] › integration-manager/read_events.spec.ts took 36.0s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.2m
Slow Test: [Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.1m
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 59.0s
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 44.6s
🎭 Playwright Run Summary
1 flaky [Chrome] › right-panel/right-panel.spec.ts:41:13 › RightPanel › in rooms › should handle long room address and long room name @screenshot 9 skipped 70 passed (9.6m)
🎭 Playwright Run Summary
1 flaky [Chrome] › read-receipts/redactions-in-threads.spec.ts:410:17 › Read receipts › redactions › in threads › A thread with a redacted unread is still read after restart @mergequeue 15 skipped 59 passed (9.6m)
🎭 Playwright Run Summary
2 flaky [Chrome] › read-receipts/editing-messages-main-timeline.spec.ts:53:17 › Read receipts › editing messages › in the main timeline › Editing a message after marking as read leaves the room read @mergequeue [Chrome] › read-receipts/high-level.spec.ts:111:13 › Read receipts › Paging up › Paging up through old messages of an unread room leaves the room unread @mergequeue 32 skipped 48 passed (9.7m)
🎭 Playwright Run Summary
3 skipped 69 passed (9.7m)
🎭 Playwright Run Summary
1 flaky [Chrome] › oidc/oidc-native.spec.ts:17:9 › OIDC Native › can register the oauth2 client and an account @no-firefox @no-webkit 1 skipped 76 passed (11.6m)
🎭 Playwright Run Summary
81 passed (11.5m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-Chrome-1
690 KB
all-blob-reports-Chrome-2
5.92 MB
all-blob-reports-Chrome-3
7.56 MB
all-blob-reports-Chrome-4
4.45 MB
all-blob-reports-Chrome-5
6.19 MB
all-blob-reports-Chrome-6
780 KB
html-report
25 MB
webapp
29.2 MB