Skip to content

Add mergequeue tag to read-receipts tests and skip running them on PR commits #3010

Add mergequeue tag to read-receipts tests and skip running them on PR commits

Add mergequeue tag to read-receipts tests and skip running them on PR commits #3010

Re-run triggered December 5, 2024 11:12
Status Success
Total duration 10m 23s
Artifacts 10

end-to-end-tests.yaml

on: pull_request
Build Element-Web
1m 40s
Build Element-Web
Matrix: playwright
end-to-end-tests
28s
end-to-end-tests
Fit to window
Zoom out
Zoom in

Annotations

9 errors, 30 warnings, and 6 notices
[Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist: playwright/e2e/sliding-sync/sliding-sync.spec.ts#L18
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist Test timeout of 30000ms exceeded while running "beforeEach" hook. 16 | let roomId: string; 17 | > 18 | test.beforeEach(async ({ slidingSyncProxy, page, user, app }) => { | ^ 19 | roomId = await app.client.createRoom({ name: "Test Room" }); 20 | }); 21 | at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:18:10
[Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist: playwright/pages/client.ts#L176
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist Error: jsHandle.evaluate: Test timeout of 30000ms exceeded. at ../pages/client.ts:176 174 | public async createRoom(options: ICreateRoomOpts): Promise<string> { 175 | const client = await this.prepareClient(); > 176 | return await client.evaluate(async (cli, options) => { | ^ 177 | const resp = await cli.createRoom(options); 178 | const roomId = resp.room_id; 179 | if (!cli.getRoom(roomId)) { at Client.createRoom (/home/runner/work/element-web/element-web/playwright/pages/client.ts:176:29) at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:19:18
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory: playwright/e2e/room-directory/room-directory.spec.ts#L31
1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 29 | await localAddresses.getByRole("textbox").fill("gaming"); 30 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 32 | 33 | // Publish into the public rooms directory 34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory: playwright/e2e/room-directory/room-directory.spec.ts#L31
1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected) Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') Expected string: "mx_EditableItem_item" Received: <element(s) not found> Call log: - expect.toHaveClass with timeout 5000ms - waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost') 29 | await localAddresses.getByRole("textbox").fill("gaming"); 30 | await localAddresses.getByRole("button", { name: "Add" }).click(); > 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item"); | ^ 32 | 33 | // Publish into the public rooms directory 34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" }); at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow: playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
2) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected) Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost" Received string: "" Call log: - expect.toHaveValue with timeout 5000ms - waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias') 9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select> - unexpected value "" 45 | 46 | // 2. wait for the new setting to apply ... > 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`); | ^ 48 | 49 | // 3. Check if the dialog overflows 50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox(); at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account: playwright/e2e/oidc/oidc-native.spec.ts#L1
1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Test timeout of 90000ms exceeded.
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account: playwright/e2e/oidc/oidc-native.spec.ts#L23
1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account Error: page.waitForRequest: Test timeout of 90000ms exceeded. 21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => { 22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`; > 23 | const tokenApiPromise = page.waitForRequest( | ^ 24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code", 25 | ); 26 | at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38
[Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel: playwright/e2e/pinned-messages/index.ts#L157
2) [Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected) Locator: getByRole('menuitem', { name: 'Pinned messages' }) Expected string: "Pinned messages3" Received string: "Pinned messages2" Call log: - expect.toHaveText with timeout 5000ms - waiting for getByRole('menuitem', { name: 'Pinned messages' }) 9 × locator resolved to <button role="menuitem" data-kind="primary" class="_item_8j2l6_17 _interactive_8j2l6_35">…</button> - unexpected value "Pinned messages2" at pinned-messages/index.ts:157 155 | */ 156 | async assertPinnedCountInRoomInfo(count: number) { > 157 | await expect(this.page.getByRole("menuitem", { name: "Pinned messages" })).toHaveText( | ^ 158 | `Pinned messages${count}`, 159 | ); 160 | } at Helpers.assertPinnedCountInRoomInfo (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:157:84) at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:52:20
[Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot: playwright/e2e/pinned-messages/pinned-messages.spec.ts#L136
3) [Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot Error: expect(locator).toHaveScreenshot(expected) 436 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-banner-4-Msg4-linux.png Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome/pinned-message-banner-4-Msg4-actual.png Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome/pinned-message-banner-4-Msg4-diff.png Call log: - expect.toHaveScreenshot(pinned-message-banner-4-Msg4.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 436 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 436 pixels (ratio 0.01 of all image pixels) are different. 134 | for (const msg of ["Msg4", "Msg3", "Msg2", "Msg1"]) { 135 | await util.assertMessageInBanner(msg); > 136 | await expect(util.getBanner()).toMatchScreenshot(`pinned-message-banner-4-${msg}.png`); | ^ 137 | await util.getBanner().click(); 138 | } 139 | }); at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:136:44
Slow Test: [Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.4m
Slow Test: [Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 39.6s
Slow Test: [Chrome] › integration-manager/kick.spec.ts#L1
[Chrome] › integration-manager/kick.spec.ts took 39.4s
Slow Test: [Chrome] › editing/editing.spec.ts#L1
[Chrome] › editing/editing.spec.ts took 32.4s
Slow Test: [Chrome] › knock/manage-knocks.spec.ts#L1
[Chrome] › knock/manage-knocks.spec.ts took 30.3s
Slow Test: [Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.3m
Slow Test: [Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.5m
Slow Test: [Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 1.0m
Slow Test: [Chrome] › settings/preferences-user-settings-tab.spec.ts#L1
[Chrome] › settings/preferences-user-settings-tab.spec.ts took 28.4s
Slow Test: [Chrome] › share-dialog/share-dialog.spec.ts#L1
[Chrome] › share-dialog/share-dialog.spec.ts took 22.0s
Slow Test: [Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.3m
Slow Test: [Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 1.2m
Slow Test: [Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 1.0m
Slow Test: [Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 52.5s
Slow Test: [Chrome] › crypto/device-verification.spec.ts#L1
[Chrome] › crypto/device-verification.spec.ts took 45.7s
Slow Test: [Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.8m
Slow Test: [Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 42.9s
Slow Test: [Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 35.0s
Slow Test: [Chrome] › widgets/widget-pip-close.spec.ts#L1
[Chrome] › widgets/widget-pip-close.spec.ts took 22.9s
Slow Test: [Chrome] › widgets/stickers.spec.ts#L1
[Chrome] › widgets/stickers.spec.ts took 21.6s
Slow Test: [Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 56.9s
Slow Test: [Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 46.1s
Slow Test: [Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 39.9s
Slow Test: [Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 35.7s
Slow Test: [Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 33.0s
Slow Test: [Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.3m
Slow Test: [Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.1m
Slow Test: [Chrome] › login/soft_logout.spec.ts#L1
[Chrome] › login/soft_logout.spec.ts took 25.3s
Slow Test: [Chrome] › oidc/oidc-aware.spec.ts#L1
[Chrome] › oidc/oidc-aware.spec.ts took 21.7s
Slow Test: [Chrome] › left-panel/left-panel.spec.ts#L1
[Chrome] › left-panel/left-panel.spec.ts took 17.2s
🎭 Playwright Run Summary
48 passed (7.5m)
🎭 Playwright Run Summary
1 flaky [Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist 10 skipped 43 passed (7.3m)
🎭 Playwright Run Summary
54 passed (7.7m)
🎭 Playwright Run Summary
2 skipped 45 passed (6.2m)
🎭 Playwright Run Summary
2 flaky [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow 1 skipped 49 passed (7.7m)
🎭 Playwright Run Summary
3 flaky [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account [Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel [Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot 1 skipped 47 passed (9.1m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-3 Expired
8.83 MB
html-report Expired
15.9 MB