WIP: trigger checks #24597

yury-s · 2023-08-03T22:35:45Z

No description provided.

github-actions · 2023-08-04T00:00:32Z

Test results for "tests 1"

6 flaky
⚠️ [chromium-chromium-ubuntu-22.04-node16] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node18] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [firefox-firefox-ubuntu-22.04-node16] › library/hit-target.spec.ts:366:3 › should detect overlayed element in a transformed iframe
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
⚠️ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

25047 passed, 583 skipped
✔️✔️✔️

Merge workflow run.

github-actions · 2023-08-04T23:57:37Z

Test results for "tests 1"

3 failed
❌ [playwright-test-macos-latest-node16] › expect-poll.spec.ts:222:5 › should show intermediate result for poll that spills over test time
❌ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events
❌ [playwright-test-ubuntu-latest-node16] › expect-to-pass.spec.ts:208:5 › should show intermediate result for toPass that spills over test time

11 flaky
⚠️ [chromium-chromium-ubuntu-22.04-node18] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node20] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox-firefox-ubuntu-22.04-node16] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox-firefox-ubuntu-22.04-node16] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [playwright-test-macos-latest-node16] › ui-mode-test-progress.spec.ts:167:5 › should update tracing network live
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events
⚠️ [playwright-test-windows-latest-node16] › ui-mode-test-progress.spec.ts:218:5 › should show trace w/ multiple contexts
⚠️ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events

25034 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test-macos-latest-node16] › expect-poll.spec.ts:222:5 › should show intermediate result for poll that spills over test time

Error: expect(received).toContain(expected) // indexOf

Expected substring: "Expected: 2"
Received string:    "
Running 1 test using 1 worker·
  ✘  1 a.spec.ts:3:11 › should fail (2.0s)··
  1) a.spec.ts:3:11 › should fail ──────────────────────────────────────────────────────────────────·
    Test timeout of 2000ms exceeded.·
  1 failed
    a.spec.ts:3:11 › should fail ───────────────────────────────────────────────────────────────────
"

  230 |   }, { timeout: 2000 });
  231 |   expect(result.exitCode).toBe(1);
> 232 |   expect(result.output).toContain('Expected: 2');
      |                         ^
  233 |   expect(result.output).toContain('Received: 3');
  234 | });
  235 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/expect-poll.spec.ts:232:25

❌ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks895ms",
+   "fixture: browser470ms",
+   "fixture: context78ms",
+   "fixture: page287ms",
+   "browserContext.newPage272ms",
+   "page.setContent25ms",
+   "expect.toBeVisiblelocator('button')34ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Retry 1:

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks946ms",
+   "fixture: browser544ms",
+   "fixture: context43ms",
+   "fixture: page309ms",
+   "browserContext.newPage289ms",
+   "page.setContent37ms",
+   "expect.toBeVisiblelocator('button')37ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Retry 2:

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks933ms",
+   "fixture: browser566ms",
+   "fixture: context65ms",
+   "fixture: page253ms",
+   "browserContext.newPage235ms",
+   "page.setContent26ms",
+   "expect.toBeVisiblelocator('button')33ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Retry 3:

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.1s",
+   "fixture: browser683ms",
+   "fixture: context74ms",
+   "fixture: page253ms",
+   "browserContext.newPage232ms",
+   "page.setContent26ms",
+   "expect.toBeVisiblelocator('button')42ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

❌ [playwright-test-ubuntu-latest-node16] › expect-to-pass.spec.ts:208:5 › should show intermediate result for toPass that spills over test time

Error: expect(received).toContain(expected) // indexOf

Expected substring: "Expected: 2"
Received string:    "
Running 1 test using 1 worker·
  ✘  1 a.spec.ts:3:11 › should fail (1.0s)··
  1) a.spec.ts:3:11 › should fail ──────────────────────────────────────────────────────────────────·
    Test timeout of 1000ms exceeded.·
  1 failed
    a.spec.ts:3:11 › should fail ───────────────────────────────────────────────────────────────────
"

  218 |   }, { timeout: 1000 });
  219 |   expect(result.exitCode).toBe(1);
> 220 |   expect(result.output).toContain('Expected: 2');
      |                         ^
  221 |   expect(result.output).toContain('Received: 3');
  222 | });
  223 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/expect-to-pass.spec.ts:220:25

Merge workflow run.

github-actions · 2023-08-05T01:12:15Z

Test results for "tests 2"

2 failed
❌ [webkit-webkit-macos-13] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2
❌ [webkit-webkit-ubuntu-20.04] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified

22 flaky
⚠️ [chromium-chromium-macos-12] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-20.04] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-20.04] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [chromium-chromium-ubuntu-22.04] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [chromium-chromium-windows-latest] › library\tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [firefox-firefox-macos-12] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox-firefox-macos-12] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox-firefox-macos-12] › page/page-goto.spec.ts:81:3 › should work with Cross-Origin-Opener-Policy
⚠️ [firefox-firefox-macos-12] › page/page-request-continue.spec.ts:271:3 › should work with Cross-Origin-Opener-Policy
⚠️ [firefox-firefox-macos-13] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox-firefox-ubuntu-20.04] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox-firefox-ubuntu-20.04] › library/proxy.spec.ts:179:3 › should exclude patterns
⚠️ [firefox-firefox-windows-latest] › library\proxy.spec.ts:179:3 › should exclude patterns
⚠️ [firefox-firefox-windows-latest] › library\signals.spec.ts:25:5 › should close the browser when the node process closes
⚠️ [chromium-tracing-chromium-tip-of-tree] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [firefox-tracing-firefox] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [webkit-tracing-webkit] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-macos-13] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [webkit-webkit-ubuntu-20.04] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit-webkit-ubuntu-20.04] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-ubuntu-22.04] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit-webkit-ubuntu-22.04] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified

58650 passed, 2461 skipped
✔️✔️✔️

❌ [webkit-webkit-macos-13] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 1:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 2:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 3:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

❌ [webkit-webkit-ubuntu-20.04] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-pytest.spec.ts:61:3

Retry 1:

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-pytest.spec.ts:61:3

Retry 2:

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-pytest.spec.ts:61:3

Retry 3:

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-pytest.spec.ts:61:3

Merge workflow run.

github-actions · 2023-08-06T17:32:52Z

Test results for "tests 1"

3 failed
❌ [playwright-test-macos-latest-node16] › reporter-html.spec.ts:1452:7 › created › labels › filter should update stats
❌ [playwright-test-macos-latest-node16] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats
❌ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events

9 flaky
⚠️ [chromium-chromium-ubuntu-22.04-node16] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node18] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › library/tracing.spec.ts:395:14 › should produce screencast frames fit
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions

25036 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test-macos-latest-node16] › reporter-html.spec.ts:1452:7 › created › labels › filter should update stats

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Total time: 1189ms"
Received: "Total time: 1.2s"

  1774 |         await expect(page.locator('.chip', { hasText: 'c.test.js' })).toHaveCount(1);
  1775 |
> 1776 |         await flakyButton.click();
       |                                 ^
  1777 |
  1778 |         await expect(searchInput).toHaveValue('@regression @flaky');
  1779 |         await expect(page).toHaveURL(/@regression%20@flaky/);

    at checkTotalDuration (/Users/runner/work/playwright/playwright/tests/playwright-test/reporter-html.spec.ts:1776:33)
    at /Users/runner/work/playwright/playwright/tests/playwright-test/reporter-html.spec.ts:1792:9

❌ [playwright-test-macos-latest-node16] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Total time: 1022ms"
Received: "Total time: 1.0s"

  1774 |         await expect(page.locator('.chip', { hasText: 'c.test.js' })).toHaveCount(1);
  1775 |
> 1776 |         await flakyButton.click();
       |                                 ^
  1777 |
  1778 |         await expect(searchInput).toHaveValue('@regression @flaky');
  1779 |         await expect(page).toHaveURL(/@regression%20@flaky/);

    at checkTotalDuration (/Users/runner/work/playwright/playwright/tests/playwright-test/reporter-html.spec.ts:1776:33)
    at /Users/runner/work/playwright/playwright/tests/playwright-test/reporter-html.spec.ts:1792:9

❌ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:22:5 › should merge trace events

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks818ms",
+   "fixture: browser560ms",
+   "fixture: context68ms",
+   "fixture: page147ms",
+   "browserContext.newPage142ms",
+   "page.setContent70ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')79ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Retry 1:

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.6s",
+   "fixture: browser1.2s",
+   "fixture: context76ms",
+   "fixture: page329ms",
+   "browserContext.newPage323ms",
+   "page.setContent34ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')113ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Retry 2:

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks836ms",
+   "fixture: browser555ms",
+   "fixture: context28ms",
+   "fixture: page225ms",
+   "browserContext.newPage220ms",
+   "page.setContent74ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')70ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Retry 3:

Error: action list

- Expected  -  8
+ Received  + 12

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /locator.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks833ms",
+   "fixture: browser568ms",
+   "fixture: context36ms",
+   "fixture: page151ms",
+   "browserContext.newPage146ms",
+   "page.setContent69ms",
+   "expect.toBe1ms",
+   "locator.clickgetByRole('button')80ms",
+   "expect.toBe0ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements
  -   locator resolved to 12 elements


  39 |       listItem,
  40 |       'action list'
> 41 |   ).toHaveText([
     |     ^
  42 |     /Before Hooks[\d.]+m?s/,
  43 |     /page.setContent[\d.]+m?s/,
  44 |     /expect.toBe[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:41:5

Merge workflow run.

github-actions · 2023-08-06T18:21:33Z

Test results for "tests 2"

1 failed
❌ [webkit-webkit-macos-13] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

20 flaky
⚠️ [chromium-chromium-macos-13] › library/chromium/oopif.spec.ts:259:3 › ElementHandle.boundingBox() should work
⚠️ [chromium-chromium-macos-13] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-20.04] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox-firefox-macos-12] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox-firefox-macos-12] › page/page-goto.spec.ts:431:3 › js redirect overrides url bar navigation
⚠️ [firefox-firefox-ubuntu-20.04] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox-firefox-ubuntu-22.04] › page/page-click-timeout-4.spec.ts:20:3 › should timeout waiting for stable position
⚠️ [firefox-firefox-windows-latest] › library\proxy.spec.ts:179:3 › should exclude patterns
⚠️ [chromium-tracing-chromium-tip-of-tree] › page/page-click.spec.ts:979:3 › should click a button that is overlayed by a permission popup
⚠️ [chromium-tracing-chromium] › page/page-screenshot.spec.ts:610:5 › page screenshot animations › should stop animations that happen right before screenshot
⚠️ [firefox-tracing-firefox] › page/frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [webkit-tracing-webkit] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-tracing-webkit] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-macos-12] › page/page-request-fallback.spec.ts:239:5 › post data › should amend binary post data
⚠️ [webkit-webkit-ubuntu-20.04] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit-webkit-ubuntu-20.04] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-ubuntu-22.04] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit-webkit-ubuntu-22.04] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit-webkit-ubuntu-22.04] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit-webkit-windows-latest] › library\har.spec.ts:424:3 › should return receive time

58653 passed, 2461 skipped
✔️✔️✔️

❌ [webkit-webkit-macos-13] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 1:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 2:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 3:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Merge workflow run.

github-actions · 2023-08-06T18:58:14Z

Test results for "tests 1"

2 failed
❌ [playwright-test-macos-latest-node16] › expect-poll.spec.ts:222:5 › should show intermediate result for poll that spills over test time
❌ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

8 flaky
⚠️ [chromium-chromium-ubuntu-22.04-node16] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node18] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium-chromium-ubuntu-22.04-node20] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox-firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [chromium-ubuntu-20.04-chromium-tip-of-tree] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit-webkit-ubuntu-22.04-node16] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [playwright-test-windows-latest-node16] › ui-mode-test-progress.spec.ts:218:5 › should show trace w/ multiple contexts

25038 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test-macos-latest-node16] › expect-poll.spec.ts:222:5 › should show intermediate result for poll that spills over test time

Error: expect(received).toContain(expected) // indexOf

Expected substring: "Expected: 2"
Received string:    "
Running 1 test using 1 worker·
  ✘  1 a.spec.ts:3:11 › should fail (2.0s)··
  1) a.spec.ts:3:11 › should fail ──────────────────────────────────────────────────────────────────·
    Test timeout of 2000ms exceeded.·
  1 failed
    a.spec.ts:3:11 › should fail ───────────────────────────────────────────────────────────────────
"

  230 |   }, { timeout: 2000 });
  231 |   expect(result.exitCode).toBe(1);
> 232 |   expect(result.output).toContain('Expected: 2');
      |                         ^
  233 |   expect(result.output).toContain('Received: 3');
  234 | });
  235 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/expect-poll.spec.ts:232:25

❌ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.1s",
+   "fixture: browser636ms",
+   "fixture: context51ms",
+   "fixture: page293ms",
+   "browserContext.newPage272ms",
+   "page.setContent32ms",
+   "expect.toBeVisiblelocator('button')38ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Retry 1:

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.1s",
+   "fixture: browser738ms",
+   "fixture: context43ms",
+   "fixture: page273ms",
+   "browserContext.newPage255ms",
+   "page.setContent35ms",
+   "expect.toBeVisiblelocator('button')59ms",
+   "After Hooks3ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Retry 2:

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks948ms",
+   "fixture: browser483ms",
+   "fixture: context47ms",
+   "fixture: page370ms",
+   "browserContext.newPage343ms",
+   "page.setContent37ms",
+   "expect.toBeVisiblelocator('button')43ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Retry 3:

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.5s",
+   "fixture: browser1.0s",
+   "fixture: context41ms",
+   "fixture: page347ms",
+   "browserContext.newPage323ms",
+   "page.setContent30ms",
+   "expect.toBeVisiblelocator('button')44ms",
+   "After Hooks4ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - locator._expect with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

Merge workflow run.

github-actions · 2023-08-08T00:14:10Z

Test results for "tests 1"

1 failed
❌ [playwright-test] › to-have-screenshot.spec.ts:864:5 › should satisfy both maxDiffPixelRatio and maxDiffPixels

7 flaky
⚠️ [chromium] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [playwright-test] › ui-mode-trace.spec.ts:22:5 › should merge trace events
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [playwright-test] › ui-mode-trace.spec.ts:22:5 › should merge trace events
⚠️ [webkit] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker

24407 passed, 580 skipped
✔️✔️✔️

❌ [playwright-test] › to-have-screenshot.spec.ts:864:5 › should satisfy both maxDiffPixelRatio and maxDiffPixels

Test timeout of 30000ms exceeded.

Merge workflow run.

github-actions · 2023-08-08T01:22:52Z

Test results for "tests 2"

2 failed
❌ [firefox] › library\signals.spec.ts:25:5 › should close the browser when the node process closes
❌ [webkit] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

74 flaky
⚠️ [chromium] › library/inspector/cli-codegen-2.spec.ts:493:7 › cli codegen › should --save-trace
⚠️ [chromium] › library/browsercontext-proxy.spec.ts:322:3 › should exclude patterns
⚠️ [chromium] › library/fetch-proxy.spec.ts:30:3 › context request should pick up proxy credentials
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/locator-misc-1.spec.ts:21:3 › should hover @smoke
⚠️ [chromium] › library/browsercontext-viewport.spec.ts:143:12 › should drag with high dpi
⚠️ [chromium] › page/page-mouse.spec.ts:166:3 › should trigger hover state
⚠️ [chromium] › library\chromium\oopif.spec.ts:314:3 › should emit filechooser event for iframe
⚠️ [chromium] › library\tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [chromium] › library/browsercontext-proxy.spec.ts:322:3 › should exclude patterns
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/video.spec.ts:334:5 › screencast › should capture navigation
⚠️ [chromium] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › library/capabilities.spec.ts:256:3 › requestFullscreen
⚠️ [firefox] › library/emulation-focus.spec.ts:65:3 › should not affect mouse event target page
⚠️ [firefox] › page/page-click.spec.ts:414:3 › should click a very large button with offset
⚠️ [firefox] › library/video.spec.ts:165:5 › screencast › should work with old options
⚠️ [firefox] › library/video.spec.ts:189:5 › screencast › should capture static page
⚠️ [firefox] › page/page-drag.spec.ts:272:5 › Drag and drop › should work if a frame is stalled
⚠️ [firefox] › page/page-drag.spec.ts:289:5 › Drag and drop › should work with the helper method
⚠️ [firefox] › library/video.spec.ts:165:5 › screencast › should work with old options
⚠️ [firefox] › library/video.spec.ts:712:5 › screencast › should capture full viewport on hidpi
⚠️ [firefox] › page/page-drag.spec.ts:34:5 › Drag and drop › should send the right events
⚠️ [firefox] › library\browsercontext-locale.spec.ts:118:3 › should be isolated between contexts
⚠️ [firefox] › library\browsercontext-pages.spec.ts:128:3 › should not leak listeners during navigation of 20 pages
⚠️ [firefox] › library\emulation-focus.spec.ts:177:12 › should focus with more than one page/context
⚠️ [firefox] › library\ignorehttpserrors.spec.ts:81:3 › should fail with WebSocket if not ignored
⚠️ [firefox] › library\inspector\cli-codegen-1.spec.ts:55:7 › cli codegen › should ignore programmatic events
⚠️ [firefox] › library\inspector\cli-codegen-2.spec.ts:493:7 › cli codegen › should --save-trace
⚠️ [firefox] › library\video.spec.ts:227:5 › screencast › saveAs should throw when no video frames
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › library/permissions.spec.ts:103:5 › permissions › should trigger permission onchange
⚠️ [firefox] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox] › library/capabilities.spec.ts💯3 › should play audio @smoke
⚠️ [firefox] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox] › library/fetch-proxy.spec.ts:30:3 › context request should pick up proxy credentials
⚠️ [firefox] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [firefox] › page/page-request-continue.spec.ts:271:3 › should work with Cross-Origin-Opener-Policy
⚠️ [firefox] › page\page-click.spec.ts:848:3 › should not hang when frame is detached
⚠️ [chromium] › page/page-screenshot.spec.ts:610:5 › page screenshot animations › should stop animations that happen right before screenshot
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › page/frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [webkit] › page/page-request-continue.spec.ts:177:5 › post data › should compute content-length from post data
⚠️ [webkit] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/inspector/cli-codegen-1.spec.ts:55:7 › cli codegen › should ignore programmatic events
⚠️ [webkit] › library/inspector/cli-codegen-3.spec.ts:57:7 › cli codegen › should click locator.nth
⚠️ [webkit] › library/inspector/cli-codegen-3.spec.ts:392:7 › cli codegen › should generate getByPlaceholder
⚠️ [webkit] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [webkit] › page/page-click.spec.ts:232:3 › should click on checkbox input and toggle
⚠️ [webkit] › page/page-drag.spec.ts:25:5 › Drag and drop › should work @smoke
⚠️ [webkit] › page/page-mouse.spec.ts:166:3 › should trigger hover state
⚠️ [webkit] › library\browsercontext-viewport.spec.ts:143:12 › should drag with high dpi
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:22:7 › cli codegen › should click
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:55:7 › cli codegen › should ignore programmatic events
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:196:7 › cli codegen › should not target selector preview by text regexp
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:340:7 › cli codegen › should press
⚠️ [webkit] › library\inspector\cli-codegen-3.spec.ts:360:7 › cli codegen › should generate getByTestId
⚠️ [webkit] › library\inspector\cli-codegen-3.spec.ts:479:7 › cli codegen › should generate getByLabel without regex
⚠️ [webkit] › page\page-drag.spec.ts:272:5 › Drag and drop › should work if a frame is stalled
⚠️ [webkit] › page\page-drag.spec.ts:289:5 › Drag and drop › should work with the helper method
⚠️ [webkit] › page\page-drag.spec.ts:330:5 › Drag and drop › should work with locators
⚠️ [webkit] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/inspector/cli-codegen-python.spec.ts:74:5 › should save the codegen output to a file if specified
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library\browsercontext-reuse.spec.ts:86:1 › should reset serviceworker that hangs in importScripts
⚠️ [webkit] › library\inspector\cli-codegen-java.spec.ts:92:5 › should work with --save-har

100510 passed, 5716 skipped
✔️✔️✔️

❌ [firefox] › library\signals.spec.ts:25:5 › should close the browser when the node process closes

Error: Command failed: taskkill /pid 7176 /T /F

  27 |   try {
  28 |     if (isWindows)
> 29 |       execSync(`taskkill /pid ${remoteServer.child().pid} /T /F`, { stdio: 'ignore' });
     |               ^
  30 |     else
  31 |       process.kill(remoteServer.child().pid);
  32 |   } catch (error) {

    at D:\a\playwright\playwright\tests\library\signals.spec.ts:29:15

Retry 1:

Error: Command failed: taskkill /pid 5888 /T /F

  27 |   try {
  28 |     if (isWindows)
> 29 |       execSync(`taskkill /pid ${remoteServer.child().pid} /T /F`, { stdio: 'ignore' });
     |               ^
  30 |     else
  31 |       process.kill(remoteServer.child().pid);
  32 |   } catch (error) {

    at D:\a\playwright\playwright\tests\library\signals.spec.ts:29:15

Retry 2:

Error: Command failed: taskkill /pid 11548 /T /F

  27 |   try {
  28 |     if (isWindows)
> 29 |       execSync(`taskkill /pid ${remoteServer.child().pid} /T /F`, { stdio: 'ignore' });
     |               ^
  30 |     else
  31 |       process.kill(remoteServer.child().pid);
  32 |   } catch (error) {

    at D:\a\playwright\playwright\tests\library\signals.spec.ts:29:15

Retry 3:

Error: Command failed: taskkill /pid 8072 /T /F

  27 |   try {
  28 |     if (isWindows)
> 29 |       execSync(`taskkill /pid ${remoteServer.child().pid} /T /F`, { stdio: 'ignore' });
     |               ^
  30 |     else
  31 |       process.kill(remoteServer.child().pid);
  32 |   } catch (error) {

    at D:\a\playwright\playwright\tests\library\signals.spec.ts:29:15

❌ [webkit] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 1:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 2:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 3:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Merge workflow run.

github-actions · 2023-08-08T22:40:00Z

Test results for "tests 1"

3 failed
❌ [playwright-test] › watch.spec.ts:564:5 › should run CT on changed deps
❌ [playwright-test] › watch.spec.ts:607:5 › should run CT on indirect deps change
❌ [playwright-test] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats

9 flaky
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [chromium] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [webkit] › library/inspector/cli-codegen-python-async.spec.ts:82:5 › should save the codegen output to a file if specified
⚠️ [playwright-test] › ui-mode-trace.spec.ts:22:5 › should merge trace events
⚠️ [playwright-test] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

25042 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test] › watch.spec.ts:564:5 › should run CT on changed deps

Test timeout of 30000ms exceeded.

❌ [playwright-test] › watch.spec.ts:607:5 › should run CT on indirect deps change

Test timeout of 30000ms exceeded.

❌ [playwright-test] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Total time: 1676ms"
Received: "Total time: 1.7s"

  1774 |         await expect(page.locator('.chip', { hasText: 'c.test.js' })).toHaveCount(1);
  1775 |
> 1776 |         await flakyButton.click();
       |                                 ^
  1777 |
  1778 |         await expect(searchInput).toHaveValue('@regression @flaky');
  1779 |         await expect(page).toHaveURL(/@regression%20@flaky/);

    at checkTotalDuration (D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1776:33)
    at D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1792:9

Merge workflow run.

yury-s added the CQ1 label Aug 3, 2023

yury-s force-pushed the test-run branch from 66b62c7 to 1025360 Compare August 4, 2023 23:13

yury-s added CQ1 and removed CQ1 labels Aug 4, 2023

yury-s force-pushed the test-run branch from 1025360 to 7355ffa Compare August 6, 2023 16:57

yury-s added CQ1 and removed CQ1 labels Aug 6, 2023

yury-s force-pushed the test-run branch from 7355ffa to 375c5e0 Compare August 6, 2023 18:25

yury-s added CQ1 and removed CQ1 labels Aug 6, 2023

yury-s force-pushed the test-run branch from 375c5e0 to dec8319 Compare August 7, 2023 23:28

yury-s added CQ1 and removed CQ1 labels Aug 7, 2023

yury-s added 2 commits August 8, 2023 14:52

WIP: trigger checks

c2af550

Upload remaining bot results

8f7799a

yury-s force-pushed the test-run branch from dec8319 to 8f7799a Compare August 8, 2023 21:54

yury-s added CQ1 and removed CQ1 labels Aug 8, 2023

mxschmitt closed this Aug 17, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WIP: trigger checks #24597

WIP: trigger checks #24597

yury-s commented Aug 3, 2023

github-actions bot commented Aug 4, 2023

github-actions bot commented Aug 4, 2023

github-actions bot commented Aug 5, 2023

github-actions bot commented Aug 6, 2023

github-actions bot commented Aug 6, 2023

github-actions bot commented Aug 6, 2023

github-actions bot commented Aug 8, 2023

github-actions bot commented Aug 8, 2023

github-actions bot commented Aug 8, 2023

WIP: trigger checks #24597

WIP: trigger checks #24597

Conversation

yury-s commented Aug 3, 2023

github-actions bot commented Aug 4, 2023

Test results for "tests 1"

github-actions bot commented Aug 4, 2023

Test results for "tests 1"

github-actions bot commented Aug 5, 2023

Test results for "tests 2"

github-actions bot commented Aug 6, 2023

Test results for "tests 1"

github-actions bot commented Aug 6, 2023

Test results for "tests 2"

github-actions bot commented Aug 6, 2023

Test results for "tests 1"

github-actions bot commented Aug 8, 2023

Test results for "tests 1"

github-actions bot commented Aug 8, 2023

Test results for "tests 2"

github-actions bot commented Aug 8, 2023

Test results for "tests 1"