Refactor UI tests #327
Annotations
10 errors, 2 warnings, and 1 notice
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts#L72
1) tests/navigation.spec.ts:56:9 › #messagesNavigation › navigation without unread message › should navigate to last message
Error: Screenshot comparison failed:
12 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts-snapshots/navigation-bottom-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-ab7e2-ld-navigate-to-last-message/navigation-bottom-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-ab7e2-ld-navigate-to-last-message/navigation-bottom-diff.png
70 | // because the last messages will be marked as unread.
71 | expect(navigationBottom).not.toHaveClass(/jp-chat-navigation-unread/);
> 72 | expect(await navigationBottom.screenshot()).toMatchSnapshot(
| ^
73 | 'navigation-bottom.png'
74 | );
75 | await expect(messages.last()).not.toBeInViewport();
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts:72:51
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts#L72
1) tests/navigation.spec.ts:56:9 › #messagesNavigation › navigation without unread message › should navigate to last message
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
12 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts-snapshots/navigation-bottom-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-ab7e2-ld-navigate-to-last-message-retry1/navigation-bottom-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-ab7e2-ld-navigate-to-last-message-retry1/navigation-bottom-diff.png
70 | // because the last messages will be marked as unread.
71 | expect(navigationBottom).not.toHaveClass(/jp-chat-navigation-unread/);
> 72 | expect(await navigationBottom.screenshot()).toMatchSnapshot(
| ^
73 | 'navigation-bottom.png'
74 | );
75 | await expect(messages.last()).not.toBeInViewport();
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts:72:51
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts#L72
1) tests/navigation.spec.ts:56:9 › #messagesNavigation › navigation without unread message › should navigate to last message
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
12 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts-snapshots/navigation-bottom-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-ab7e2-ld-navigate-to-last-message-retry2/navigation-bottom-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-ab7e2-ld-navigate-to-last-message-retry2/navigation-bottom-diff.png
70 | // because the last messages will be marked as unread.
71 | expect(navigationBottom).not.toHaveClass(/jp-chat-navigation-unread/);
> 72 | expect(await navigationBottom.screenshot()).toMatchSnapshot(
| ^
73 | 'navigation-bottom.png'
74 | );
75 | await expect(messages.last()).not.toBeInViewport();
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts:72:51
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts#L1
2) tests/navigation.spec.ts:180:9 › #messagesNavigation › navigation with new unread message › should have unread icon for new messages
Test timeout of 60000ms exceeded.
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/test-utils.ts#L37
2) tests/navigation.spec.ts:180:9 › #messagesNavigation › navigation with new unread message › should have unread icon for new messages
Error: locator.isChecked: Target page, context or browser has been closed
at tests/test-utils.ts:37
35 | }, filename);
36 | await page.waitForCondition(
> 37 | async () => await page.activity.isTabActive(filename)
| ^
38 | );
39 | return (await page.activity.getPanelLocator(filename)) as Locator;
40 | };
at Object.isInSimpleMode (/home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/node_modules/@jupyterlab/galata/src/utils.ts:311:17)
at ActivityHelper.isTabActive (/home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/node_modules/@jupyterlab/galata/src/helpers/activity.ts:46:21)
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/test-utils.ts:37:37
at Timeout.check (/home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/node_modules/@jupyterlab/galata/src/utils.ts:183:33)
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts#L191
2) tests/navigation.spec.ts:180:9 › #messagesNavigation › navigation with new unread message › should have unread icon for new messages
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveClass(expected)
Locator: getByRole('main').getByRole('tabpanel', { name: 'my-chat.chat' }).locator('.jp-chat-navigation-bottom')
Expected pattern: /jp-chat-navigation-unread/
Received: <element(s) not found>
Call log:
- expect.toHaveClass with timeout 5000ms
- waiting for getByRole('main').getByRole('tabpanel', { name: 'my-chat.chat' }).locator('.jp-chat-navigation-bottom')
189 | await sendMessage(guestPage, FILENAME, MSG_CONTENT);
190 |
> 191 | await expect(navigationBottom).toHaveClass(/jp-chat-navigation-unread/);
| ^
192 | expect(await navigationBottom.screenshot()).toMatchSnapshot(
193 | 'navigation-bottom-unread.png'
194 | );
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts:191:38
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts#L192
2) tests/navigation.spec.ts:180:9 › #messagesNavigation › navigation with new unread message › should have unread icon for new messages
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
21 pixels (ratio 0.03 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts-snapshots/navigation-bottom-unread-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-4b6c7-nread-icon-for-new-messages-retry2/navigation-bottom-unread-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-navigation--messages-4b6c7-nread-icon-for-new-messages-retry2/navigation-bottom-unread-diff.png
190 |
191 | await expect(navigationBottom).toHaveClass(/jp-chat-navigation-unread/);
> 192 | expect(await navigationBottom.screenshot()).toMatchSnapshot(
| ^
193 | 'navigation-bottom-unread.png'
194 | );
195 | });
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/navigation.spec.ts:192:51
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts#L209
3) tests/notifications.spec.ts:195:7 › #notifications › should add unread symbol in tab label ────
Error: Screenshot comparison failed:
280 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts-snapshots/tab-with-unread-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-notifications--notif-8e6a5--unread-symbol-in-tab-label/tab-with-unread-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-notifications--notif-8e6a5--unread-symbol-in-tab-label/tab-with-unread-diff.png
207 | });
208 | expect(await beforePseudo).toHaveProperty('content', '"* "');
> 209 | expect(await tab.screenshot()).toMatchSnapshot('tab-with-unread.png');
| ^
210 |
211 | await messages.last().scrollIntoViewIfNeeded();
212 | expect(await tab.screenshot()).toMatchSnapshot('tab-without-unread.png');
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts:209:36
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts#L209
3) tests/notifications.spec.ts:195:7 › #notifications › should add unread symbol in tab label ────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
280 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts-snapshots/tab-with-unread-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-notifications--notif-8e6a5--unread-symbol-in-tab-label-retry1/tab-with-unread-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-notifications--notif-8e6a5--unread-symbol-in-tab-label-retry1/tab-with-unread-diff.png
207 | });
208 | expect(await beforePseudo).toHaveProperty('content', '"* "');
> 209 | expect(await tab.screenshot()).toMatchSnapshot('tab-with-unread.png');
| ^
210 |
211 | await messages.last().scrollIntoViewIfNeeded();
212 | expect(await tab.screenshot()).toMatchSnapshot('tab-without-unread.png');
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts:209:36
|
Execute integration tests:
python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts#L209
3) tests/notifications.spec.ts:195:7 › #notifications › should add unread symbol in tab label ────
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
280 pixels (ratio 0.05 of all image pixels) are different.
Expected: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts-snapshots/tab-with-unread-linux.png
Received: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-notifications--notif-8e6a5--unread-symbol-in-tab-label-retry2/tab-with-unread-actual.png
Diff: /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/test-results/tests-notifications--notif-8e6a5--unread-symbol-in-tab-label-retry2/tab-with-unread-diff.png
207 | });
208 | expect(await beforePseudo).toHaveProperty('content', '"* "');
> 209 | expect(await tab.screenshot()).toMatchSnapshot('tab-with-unread.png');
| ^
210 |
211 | await messages.last().scrollIntoViewIfNeeded();
212 | expect(await tab.screenshot()).toMatchSnapshot('tab-without-unread.png');
at /home/runner/work/jupyter-chat/jupyter-chat/python/jupyterlab-collaborative-chat/ui-tests/tests/notifications.spec.ts:209:36
|
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v3, actions/download-artifact@v3, actions/cache@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "jupyterlab_collaborative_chat-artifacts", "jupyterlab_collaborative_chat-playwright-tests", "jupyterlab_ws_chat-artifacts", "jupyterlab_ws_chat-playwright-tests".
Please update your workflow to use v4 of the artifact actions.
Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
|
Execute integration tests
3 failed
tests/navigation.spec.ts:56:9 › #messagesNavigation › navigation without unread message › should navigate to last message
tests/navigation.spec.ts:180:9 › #messagesNavigation › navigation with new unread message › should have unread icon for new messages
tests/notifications.spec.ts:195:7 › #notifications › should add unread symbol in tab label ─────
2 flaky
tests/jupyterlab_collaborative_chat.spec.ts:967:7 › #typingNotification › should display several typing users
tests/send-message.spec.ts:60:7 › #sendMessages › should use settings value sendWithShiftEnter ─
2 skipped
74 passed (5.5m)
|
Loading