Add mergequeue tag to read-receipts tests and skip running them on PR commits #3010
Annotations
9 errors, 30 warnings, and 6 notices
[Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L18
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist
Test timeout of 30000ms exceeded while running "beforeEach" hook.
16 | let roomId: string;
17 |
> 18 | test.beforeEach(async ({ slidingSyncProxy, page, user, app }) => {
| ^
19 | roomId = await app.client.createRoom({ name: "Test Room" });
20 | });
21 |
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:18:10
|
[Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist:
playwright/pages/client.ts#L176
1) [Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist
Error: jsHandle.evaluate: Test timeout of 30000ms exceeded.
at ../pages/client.ts:176
174 | public async createRoom(options: ICreateRoomOpts): Promise<string> {
175 | const client = await this.prepareClient();
> 176 | return await client.evaluate(async (cli, options) => {
| ^
177 | const resp = await cli.createRoom(options);
178 | const roomId = resp.room_id;
179 | if (!cli.getRoom(roomId)) {
at Client.createRoom (/home/runner/work/element-web/element-web/playwright/pages/client.ts:176:29)
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:19:18
|
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory:
playwright/e2e/room-directory/room-directory.spec.ts#L31
1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
Expected string: "mx_EditableItem_item"
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
29 | await localAddresses.getByRole("textbox").fill("gaming");
30 | await localAddresses.getByRole("button", { name: "Add" }).click();
> 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item");
| ^
32 |
33 | // Publish into the public rooms directory
34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" });
at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69
|
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory:
playwright/e2e/room-directory/room-directory.spec.ts#L31
1) [Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
Expected string: "mx_EditableItem_item"
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for locator('.mx_SettingsFieldset').filter({ hasText: 'Local Addresses' }).getByText('#gaming:localhost')
29 | await localAddresses.getByRole("textbox").fill("gaming");
30 | await localAddresses.getByRole("button", { name: "Add" }).click();
> 31 | await expect(localAddresses.getByText("#gaming:localhost")).toHaveClass("mx_EditableItem_item");
| ^
32 |
33 | // Publish into the public rooms directory
34 | const publishedAddresses = page.locator(".mx_SettingsFieldset", { hasText: "Published Addresses" });
at /home/runner/work/element-web/element-web/playwright/e2e/room-directory/room-directory.spec.ts:31:69
|
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
2) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account:
playwright/e2e/oidc/oidc-native.spec.ts#L1
1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account
Test timeout of 90000ms exceeded.
|
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account:
playwright/e2e/oidc/oidc-native.spec.ts#L23
1) [Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account
Error: page.waitForRequest: Test timeout of 90000ms exceeded.
21 | test("can register the oauth2 client and an account", async ({ context, page, homeserver, mailhog, mas }) => {
22 | const tokenUri = `http://localhost:${mas.port}/oauth2/token`;
> 23 | const tokenApiPromise = page.waitForRequest(
| ^
24 | (request) => request.url() === tokenUri && request.postDataJSON()["grant_type"] === "authorization_code",
25 | );
26 |
at /home/runner/work/element-web/element-web/playwright/e2e/oidc/oidc-native.spec.ts:23:38
|
[Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel:
playwright/e2e/pinned-messages/index.ts#L157
2) [Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: getByRole('menuitem', { name: 'Pinned messages' })
Expected string: "Pinned messages3"
Received string: "Pinned messages2"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for getByRole('menuitem', { name: 'Pinned messages' })
9 × locator resolved to <button role="menuitem" data-kind="primary" class="_item_8j2l6_17 _interactive_8j2l6_35">…</button>
- unexpected value "Pinned messages2"
at pinned-messages/index.ts:157
155 | */
156 | async assertPinnedCountInRoomInfo(count: number) {
> 157 | await expect(this.page.getByRole("menuitem", { name: "Pinned messages" })).toHaveText(
| ^
158 | `Pinned messages${count}`,
159 | );
160 | }
at Helpers.assertPinnedCountInRoomInfo (/home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/index.ts:157:84)
at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:52:20
|
[Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot:
playwright/e2e/pinned-messages/pinned-messages.spec.ts#L136
3) [Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot
Error: expect(locator).toHaveScreenshot(expected)
436 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/element-web/element-web/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-banner-4-Msg4-linux.png
Received: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome/pinned-message-banner-4-Msg4-actual.png
Diff: /home/runner/work/element-web/element-web/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner-Chrome/pinned-message-banner-4-Msg4-diff.png
Call log:
- expect.toHaveScreenshot(pinned-message-banner-4-Msg4.png) with timeout 5000ms
- verifying given screenshot expectation
- waiting for getByTestId('pinned-message-banner')
- locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- 436 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for getByTestId('pinned-message-banner')
- locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div>
- taking element screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- attempting scroll into view action
- waiting for element to be stable
- captured a stable screenshot
- 436 pixels (ratio 0.01 of all image pixels) are different.
134 | for (const msg of ["Msg4", "Msg3", "Msg2", "Msg1"]) {
135 | await util.assertMessageInBanner(msg);
> 136 | await expect(util.getBanner()).toMatchScreenshot(`pinned-message-banner-4-${msg}.png`);
| ^
137 | await util.getBanner().click();
138 | }
139 | });
at /home/runner/work/element-web/element-web/playwright/e2e/pinned-messages/pinned-messages.spec.ts:136:44
|
Slow Test:
[Chrome] › crypto/event-shields.spec.ts#L1
[Chrome] › crypto/event-shields.spec.ts took 1.4m
|
Slow Test:
[Chrome] › knock/knock-into-room.spec.ts#L1
[Chrome] › knock/knock-into-room.spec.ts took 39.6s
|
Slow Test:
[Chrome] › integration-manager/kick.spec.ts#L1
[Chrome] › integration-manager/kick.spec.ts took 39.4s
|
Slow Test:
[Chrome] › editing/editing.spec.ts#L1
[Chrome] › editing/editing.spec.ts took 32.4s
|
Slow Test:
[Chrome] › knock/manage-knocks.spec.ts#L1
[Chrome] › knock/manage-knocks.spec.ts took 30.3s
|
Slow Test:
[Chrome] › spotlight/spotlight.spec.ts#L1
[Chrome] › spotlight/spotlight.spec.ts took 2.3m
|
Slow Test:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.5m
|
Slow Test:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 1.0m
|
Slow Test:
[Chrome] › settings/preferences-user-settings-tab.spec.ts#L1
[Chrome] › settings/preferences-user-settings-tab.spec.ts took 28.4s
|
Slow Test:
[Chrome] › share-dialog/share-dialog.spec.ts#L1
[Chrome] › share-dialog/share-dialog.spec.ts took 22.0s
|
Slow Test:
[Chrome] › composer/RTE.spec.ts#L1
[Chrome] › composer/RTE.spec.ts took 1.3m
|
Slow Test:
[Chrome] › audio-player/audio-player.spec.ts#L1
[Chrome] › audio-player/audio-player.spec.ts took 1.2m
|
Slow Test:
[Chrome] › crypto/crypto.spec.ts#L1
[Chrome] › crypto/crypto.spec.ts took 1.0m
|
Slow Test:
[Chrome] › crypto/decryption-failure-messages.spec.ts#L1
[Chrome] › crypto/decryption-failure-messages.spec.ts took 52.5s
|
Slow Test:
[Chrome] › crypto/device-verification.spec.ts#L1
[Chrome] › crypto/device-verification.spec.ts took 45.7s
|
Slow Test:
[Chrome] › timeline/timeline.spec.ts#L1
[Chrome] › timeline/timeline.spec.ts took 2.8m
|
Slow Test:
[Chrome] › threads/threads.spec.ts#L1
[Chrome] › threads/threads.spec.ts took 42.9s
|
Slow Test:
[Chrome] › user-onboarding/user-onboarding-new.spec.ts#L1
[Chrome] › user-onboarding/user-onboarding-new.spec.ts took 35.0s
|
Slow Test:
[Chrome] › widgets/widget-pip-close.spec.ts#L1
[Chrome] › widgets/widget-pip-close.spec.ts took 22.9s
|
Slow Test:
[Chrome] › widgets/stickers.spec.ts#L1
[Chrome] › widgets/stickers.spec.ts took 21.6s
|
Slow Test:
[Chrome] › right-panel/right-panel.spec.ts#L1
[Chrome] › right-panel/right-panel.spec.ts took 56.9s
|
Slow Test:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 46.1s
|
Slow Test:
[Chrome] › right-panel/file-panel.spec.ts#L1
[Chrome] › right-panel/file-panel.spec.ts took 39.9s
|
Slow Test:
[Chrome] › polls/polls.spec.ts#L1
[Chrome] › polls/polls.spec.ts took 35.7s
|
Slow Test:
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts#L1
[Chrome] › settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 33.0s
|
Slow Test:
[Chrome] › messages/messages.spec.ts#L1
[Chrome] › messages/messages.spec.ts took 2.3m
|
Slow Test:
[Chrome] › login/login.spec.ts#L1
[Chrome] › login/login.spec.ts took 1.1m
|
Slow Test:
[Chrome] › login/soft_logout.spec.ts#L1
[Chrome] › login/soft_logout.spec.ts took 25.3s
|
Slow Test:
[Chrome] › oidc/oidc-aware.spec.ts#L1
[Chrome] › oidc/oidc-aware.spec.ts took 21.7s
|
Slow Test:
[Chrome] › left-panel/left-panel.spec.ts#L1
[Chrome] › left-panel/left-panel.spec.ts took 17.2s
|
🎭 Playwright Run Summary
48 passed (7.5m)
|
🎭 Playwright Run Summary
1 flaky
[Chrome] › sliding-sync/sliding-sync.spec.ts:251:9 › Sliding Sync › should show a favourite DM only in the favourite sublist
10 skipped
43 passed (7.3m)
|
🎭 Playwright Run Summary
54 passed (7.7m)
|
🎭 Playwright Run Summary
2 skipped
45 passed (6.2m)
|
🎭 Playwright Run Summary
2 flaky
[Chrome] › room-directory/room-directory.spec.ts:18:9 › Room Directory › should allow admin to add alias & publish room to directory
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow
1 skipped
49 passed (7.7m)
|
🎭 Playwright Run Summary
3 flaky
[Chrome] › oidc/oidc-native.spec.ts:21:9 › OIDC Native › can register the oauth2 client and an account
[Chrome] › pinned-messages/pinned-messages.spec.ts:46:9 › Pinned messages › should pin messages and show them in the room info panel
[Chrome] › pinned-messages/pinned-messages.spec.ts:129:9 › Pinned messages › should display 4 messages in the banner @screenshot
1 skipped
47 passed (9.1m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports-3
Expired
|
8.83 MB |
|
html-report
Expired
|
15.9 MB |
|