This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
End to End Tests #6468
Annotations
10 errors, 5 warnings, and 1 notice
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
1) [Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
1) [Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
1) [Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
2) [Legacy Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
3) [Legacy Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:137:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
4) [Legacy Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:157:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
5) [Legacy Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:179:9
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/room/room.spec.ts#L100
6) [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A
Error: Timed out 5000ms waiting for expect(locator).toBeInViewport()
Locator: locator('.mx_MTextBody .mx_EventTile_body').getByText('test0')
Expected: in viewport
Received: outside viewport
Call log:
- expect.toBeInViewport with timeout 5000ms
- waiting for locator('.mx_MTextBody .mx_EventTile_body').getByText('test0')
98 | // The timeline should display the first message
99 | // The previous position before switching to Room B should be remembered
> 100 | await expect(page.locator(".mx_MTextBody .mx_EventTile_body").getByText("test0")).toBeInViewport();
| ^
101 | });
102 | });
103 |
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/room/room.spec.ts:100:91
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/timeline/timeline.spec.ts#L1013
7) [Legacy Crypto] › timeline/timeline.spec.ts:906:13 › Timeline › message sending › should display a reply chain
Error: Screenshot comparison failed:
103 pixels (ratio 0.01 of all image pixels) are different.
Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/timeline/timeline.spec.ts/event-tile-reply-chains-bubble-layout-linux.png
Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/timeline-timeline-Timeline-message-sending-should-display-a-reply-chain-Legacy-Crypto/event-tile-reply-chains-bubble-layout-actual.png
Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/timeline-timeline-Timeline-message-sending-should-display-a-reply-chain-Legacy-Crypto/event-tile-reply-chains-bubble-layout-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" a…>…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for element to be visible and stable
- element is visible and stable
- 103 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- waiting for locator('.mx_EventTile_last')
- locator resolved to <li tabindex="-1" aria-live="off" data-self="true" a…>…</li>
- taking element screenshot
- disabled all CSS animations
- waiting for element to be visible and stable
- element is visible and stable
- captured a stable screenshot
- 103 pixels (ratio 0.01 of all image pixels) are different.
1011 |
1012 | // Take a snapshot on bubble layout
> 1013 | await expect(page.locator(".mx_EventTile_last")).toMatchScreenshot(
| ^
1014 | "event-tile-reply-chains-bubble-layout.png",
1015 | screenshotOptions,
1016 | );
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/timeline/timeline.spec.ts:1013:62
|
Merge into HTML Report:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
8) [Rust Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:137:9
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 6.0m
|
Merge into HTML Report:
[Rust Crypto] › crypto/verification.spec.ts#L1
[Rust Crypto] › crypto/verification.spec.ts took 5.9m
|
Merge into HTML Report:
[Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.3m
|
Merge into HTML Report:
[Legacy Crypto] › crypto/verification.spec.ts#L1
[Legacy Crypto] › crypto/verification.spec.ts took 4.9m
|
Merge into HTML Report:
[Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.8m
|
Merge into HTML Report
1 failed
[Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
11 flaky
[Legacy Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
[Legacy Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
[Legacy Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
[Legacy Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login
[Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A
[Legacy Crypto] › timeline/timeline.spec.ts:906:13 › Timeline › message sending › should display a reply chain
[Rust Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
[Rust Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
[Rust Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login
[Rust Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A
[Rust Crypto] › timeline/timeline.spec.ts:555:13 › Timeline › message displaying › should set inline start padding to a hidden event line
112 skipped
606 passed (20.0m)
|
The logs for this run have expired and are no longer available.
Loading