This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
End to End Tests #6467
Annotations
11 errors, 5 warnings, and 1 notice
Run Tests 5/8
The process '/usr/bin/xvfb-run' failed with exit code 1
|
[Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
1) [Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
[Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
1) [Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
[Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
1) [Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
[Legacy Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
2) [Legacy Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:94:9
|
[Legacy Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L122
3) [Legacy Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
Expected string: "cached locally, well formed"
Received string: "not found locally"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.mx_SecureBackupPanel_statusList tr:nth-child(2) td')
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
- locator resolved to <td>not found locally</td>
- unexpected value "not found locally"
at crypto/utils.ts:122
120 |
121 | const cacheDecryptionKeyStatusElement = page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(2) td");
> 122 | await expect(cacheDecryptionKeyStatusElement).toHaveText("cached locally, well formed");
| ^
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:122:51)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:137:9
|
[Legacy Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
4) [Legacy Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:157:9
|
[Legacy Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
5) [Legacy Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:179:9
|
[Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A:
matrix-react-sdk/playwright/e2e/room/room.spec.ts#L100
6) [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A
Error: Timed out 5000ms waiting for expect(locator).toBeInViewport()
Locator: locator('.mx_MTextBody .mx_EventTile_body').getByText('test0')
Expected: in viewport
Received: outside viewport
Call log:
- expect.toBeInViewport with timeout 5000ms
- waiting for locator('.mx_MTextBody .mx_EventTile_body').getByText('test0')
98 | // The timeline should display the first message
99 | // The previous position before switching to Room B should be remembered
> 100 | await expect(page.locator(".mx_MTextBody .mx_EventTile_body").getByText("test0")).toBeInViewport();
| ^
101 | });
102 | });
103 |
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/room/room.spec.ts:100:91
|
[Rust Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
7) [Rust Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:137:9
|
[Rust Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login:
matrix-react-sdk/playwright/e2e/crypto/utils.ts#L125
8) [Rust Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
Error: expect(received).toBe(expected) // Object.is equality
Expected: "null (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
Received: "1 (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)"
at crypto/utils.ts:125
123 |
124 | const serverVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(5) td").textContent();
> 125 | expect(serverVersion.trim()).toBe(expectedBackupVersion + " (Algorithm: m.megolm_backup.v1.curve25519-aes-sha2)");
| ^
126 |
127 | const activeVersion = await page.locator(".mx_SecureBackupPanel_statusList tr:nth-child(6) td").textContent();
128 | expect(activeVersion.trim()).toBe(expectedBackupVersion);
at checkDeviceIsConnectedKeyBackup (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/utils.ts:125:34)
at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/verification.spec.ts:157:9
|
Slow Test:
[Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 6.3m
|
Slow Test:
[Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 5.9m
|
Slow Test:
[Rust Crypto] › crypto/verification.spec.ts#L1
[Rust Crypto] › crypto/verification.spec.ts took 5.7m
|
Slow Test:
[Legacy Crypto] › crypto/verification.spec.ts#L1
[Legacy Crypto] › crypto/verification.spec.ts took 4.9m
|
Slow Test:
[Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.9m
|
🎭 Playwright Run Summary
1 failed
[Rust Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
9 flaky
[Legacy Crypto] › crypto/verification.spec.ts:73:9 › Device verification › Verify device with SAS during login
[Legacy Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
[Legacy Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
[Legacy Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login
[Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A
[Rust Crypto] › crypto/verification.spec.ts:97:9 › Device verification › Verify device with QR code during login
[Rust Crypto] › crypto/verification.spec.ts:140:9 › Device verification › Verify device with Security Phrase during login
[Rust Crypto] › crypto/verification.spec.ts:160:9 › Device verification › Verify device with Security Key during login
[Rust Crypto] › timeline/timeline.spec.ts:555:13 › Timeline › message displaying › should set inline start padding to a hidden event line
112 skipped
606 passed (19.7m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
all-blob-reports
Expired
|
112 MB |
|
html-report--attempt-1
Expired
|
131 MB |
|
html-report--attempt-2
Expired
|
125 MB |
|