devops: always create blob report on CI, write PR number within action

[yury-s]

No description provided.

[github-actions]

Test results for "tests 1"

1 failed
❌ [playwright-test-macos-latest-node16] › to-have-screenshot.spec.ts:439:5 › should fail when screenshot is different size

6 flaky
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events
⚠️ [firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:706:5 › should not emit after w/o before
⚠️ [webkit-ubuntu-22.04-node16] › library/browsercontext-fetch.spec.ts:1002:3 › should abort requests when browser context closes
⚠️ [chromium-ubuntu-22.04-node16] › library/capabilities.spec.ts:137:3 › should not crash on showDirectoryPicker
⚠️ [chromium-ubuntu-22.04-node16] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [chromium-ubuntu-22.04-node20] › library/tracing.spec.ts:239:5 › should not include trace resources from the provious chunks

21652 passed, 509 skipped
✔️✔️✔️

❌ [playwright-test-macos-latest-node16] › to-have-screenshot.spec.ts:439:5 › should fail when screenshot is different size

Error: expect(received).toContain(expected) // indexOf

Expected substring: "captured a stable screenshot"
Received string:    "
Running 1 test using 1 worker·
  ✘  1 a.spec.js:3:7 › is a test (3.4s)··
  1) a.spec.js:3:7 › is a test ─────────────────────────────────────────────────────────────────────·
    Error: Screenshot comparison failed:·
      Timeout 2000ms exceeded.·
    Call log:
      - expect.toHaveScreenshot(snapshot.png) with timeout 2000ms
      -   verifying given screenshot expectation
      - taking page screenshot
      -   disabled all CSS animations
      - Expected an image 22px by 33px, received 1280px by 720px. 726 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - Timeout 2000ms exceeded.·
    Expected: /Users/runner/work/playwright/playwright/test-results/to-have-screenshot-should-fail-when-screenshot-is-different-size-playwright-test/test-results/a-is-a-test/snapshot-expected.png
    Received: /Users/runner/work/playwright/playwright/test-results/to-have-screenshot-should-fail-when-screenshot-is-different-size-playwright-test/test-results/a-is-a-test/snapshot-actual.png
        Diff: /Users/runner/work/playwright/playwright/test-results/to-have-screenshot-should-fail-when-screenshot-is-different-size-playwright-test/test-results/a-is-a-test/snapshot-diff.png·
      2 |       const { test, expect } = require('@playwright/test');
      3 |       test('is a test', async ({ page }) => {
    > 4 |         await expect(page).toHaveScreenshot('snapshot.png', { timeout: 2000 });
        |                            ^
      5 |       });
      6 |······
        at /Users/runner/work/playwright/playwright/test-results/to-have-screenshot-should-fail-when-screenshot-is-different-size-playwright-test/a.spec.js:4:28·
    attachment #1: snapshot-expected.png (image/png) ───────────────────────────────────────────────
    test-results/a-is-a-test/snapshot-expected.png
    ────────────────────────────────────────────────────────────────────────────────────────────────·
    attachment #2: snapshot-actual.png (image/png) ─────────────────────────────────────────────────
    test-results/a-is-a-test/snapshot-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────·
    attachment #3: snapshot-diff.png (image/png) ───────────────────────────────────────────────────
    test-results/a-is-a-test/snapshot-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────·
  1 failed
    a.spec.js:3:7 › is a test ──────────────────────────────────────────────────────────────────────
"

  452 |   expect(result.exitCode).toBe(1);
  453 |   expect(result.output).toContain(`verifying given screenshot expectation`);
> 454 |   expect(result.output).toContain(`captured a stable screenshot`);
      |                         ^
  455 |   expect(result.output).toContain('Expected an image 22px by 33px, received 1280px by 720px.');
  456 | });
  457 |

    at /Users/runner/work/playwright/playwright/tests/playwright-test/to-have-screenshot.spec.ts:454:25

⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

Error: action list

- Expected  -  6
+ Received  + 10

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page.setContent[\d.]+m?s/,
-   /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.5s",
+   "fixture: browser983ms",
+   "fixture: context43ms",
+   "fixture: page299ms",
+   "browserContext.newPage274ms",
+   "page.setContent37ms",
+   "expect.toBeVisiblelocator('button')45ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - expect.toHaveText with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements
  -   locator resolved to 10 elements


  68 |       listItem,
  69 |       'action list'
> 70 |   ).toHaveText([
     |     ^
  71 |     /Before Hooks[\d.]+m?s/,
  72 |     /page.setContent[\d.]+m?s/,
  73 |     /expect.toBeVisiblelocator\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:70:5

⚠️ [firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:706:5 › should not emit after w/o before

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 8,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

⚠️ [webkit-ubuntu-22.04-node16] › library/browsercontext-fetch.spec.ts:1002:3 › should abort requests when browser context closes

⚠️ [chromium-ubuntu-22.04-node16] › library/capabilities.spec.ts:137:3 › should not crash on showDirectoryPicker

Error: expect(received).toContain(expected) // indexOf

Expected substring: "DOMException: The user aborted a request"
Received string:    "page.evaluate: DOMException: Failed to execute 'showDirectoryPicker' on 'Window': User activation is required to show a file picker."

  144 |       const dir = await (window as any).showDirectoryPicker();
  145 |       return dir.name;
> 146 |     }).catch(e => expect(e.message).toContain('DOMException: The user aborted a request')),
      |                                     ^
  147 |     // The dialog will not be accepted, so we just wait for some time to
  148 |     // to give the browser a chance to crash.
  149 |     new Promise(r => setTimeout(r, 1000))

    at /home/runner/work/playwright/playwright/tests/library/capabilities.spec.ts:146:37
    at /home/runner/work/playwright/playwright/tests/library/capabilities.spec.ts:142:3

⚠️ [chromium-ubuntu-22.04-node16] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-javascript.spec.ts:92:3

⚠️ [chromium-ubuntu-22.04-node20] › library/tracing.spec.ts:239:5 › should not include trace resources from the provious chunks

Error: expect(received).toBe(expected) // Object.is equality

Expected: 0
Received: 1

  266 |     // 1 network resource should be preserved.
  267 |     expect(names.filter(n => n.endsWith('.html')).length).toBe(1);
> 268 |     expect(names.filter(n => n.endsWith('.jpeg')).length).toBe(0);
      |                                                           ^
  269 |     // 0 source file for the second test.
  270 |     expect(names.filter(n => n.endsWith('.txt')).length).toBe(0);
  271 |   }

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:268:59

--- Merge [workflow run](https://github.com/microsoft/playwright/actions/runs/5558901992).

[github-actions]

Test results for "tests 1"

8 flaky
⚠️ [webkit-ubuntu-22.04-node16] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit-ubuntu-22.04-node16] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [playwright-test-ubuntu-latest-node20] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
⚠️ [playwright-test-windows-latest-node16] › ui-mode-test-progress.spec.ts:218:5 › should show trace w/ multiple contexts
⚠️ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
⚠️ [firefox-ubuntu-22.04-node16] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:706:5 › should not emit after w/o before

21651 passed, 509 skipped
✔️✔️✔️

⚠️ [webkit-ubuntu-22.04-node16] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker

⚠️ [webkit-ubuntu-22.04-node16] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-javascript.spec.ts:92:3

Retry 1:

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-javascript.spec.ts:92:3

⚠️ [playwright-test-ubuntu-latest-node20] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks743ms",
+   "fixture: browser453ms",
+   "fixture: context55ms",
+   "fixture: page138ms",
+   "browserContext.newPage98ms",
+   "page.setContent88ms",
+   "locator.clickgetByRole('button')164ms",
+   "expect.toBe1ms",
+   "After Hooks3ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - expect.toHaveText with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at /home/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:144:5

⚠️ [playwright-test-macos-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks830ms",
+   "fixture: browser446ms",
+   "fixture: context40ms",
+   "fixture: page300ms",
+   "browserContext.newPage238ms",
+   "page.setContent62ms",
+   "locator.clickgetByRole('button')165ms",
+   "expect.toBe1ms",
+   "After Hooks2ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - expect.toHaveText with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 1 element
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at /Users/runner/work/playwright/playwright/tests/playwright-test/ui-mode-trace.spec.ts:144:5

⚠️ [playwright-test-windows-latest-node16] › ui-mode-test-progress.spec.ts:218:5 › should show trace w/ multiple contexts

Error: action list

- Expected  - 5
+ Received  + 1

- Array [
-   /apiRequestContext.get[\d.]+m?s/,
-   /browserContext.newPage[\d.]+m?s/,
-   /page.gotoabout:blank[\d.]+m?s/,
- ]
+ Array []
Call log:
  - expect.toHaveText with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements


  240 |       listItem,
  241 |       'action list'
> 242 |   ).toHaveText([
      |     ^
  243 |     /apiRequestContext.get[\d.]+m?s/,
  244 |     /browserContext.newPage[\d.]+m?s/,
  245 |     /page.gotoabout:blank[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-test-progress.spec.ts:242:5

⚠️ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions

Error: action list

- Expected  -  7
+ Received  + 11

  Array [
-   /Before Hooks[\d.]+m?s/,
-   /page\.setContent[\d.]+m?s/,
-   /locator\.clickgetByRole\('button'\)[\d.]+m?s/,
-   /expect\.toBe[\d.]+m?s/,
-   /After Hooks[\d.]+m?s/,
-   /fixture: page[\d.]+m?s/,
-   /fixture: context[\d.]+m?s/,
+   "Before Hooks1.1s",
+   "fixture: browser790ms",
+   "fixture: context50ms",
+   "fixture: page233ms",
+   "browserContext.newPage226ms",
+   "page.setContent58ms",
+   "locator.clickgetByRole('button')81ms",
+   "expect.toBe1ms",
+   "After Hooks1ms",
+   "fixture: page0ms",
+   "fixture: context0ms",
  ]
Call log:
  - expect.toHaveText with timeout 75000ms
  - waiting for getByTestId('action-list').getByRole('listitem')
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 0 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements
  -   locator resolved to 11 elements


  142 |       listItem,
  143 |       'action list'
> 144 |   ).toHaveText([
      |     ^
  145 |     /Before Hooks[\d.]+m?s/,
  146 |     /page\.setContent[\d.]+m?s/,
  147 |     /locator\.clickgetByRole\('button'\)[\d.]+m?s/,

    at D:\a\playwright\playwright\tests\playwright-test\ui-mode-trace.spec.ts:144:5

⚠️ [firefox-ubuntu-22.04-node16] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation

TypeError: Cannot read properties of null (reading 'request')

  152 |   ]);
  153 |   await expect(page).toHaveURL('https://www.theverge.com/');
> 154 |   expect(response.request().url()).toBe('https://www.theverge.com/');
      |                   ^
  155 |   expect(await page.evaluate(() => location.href)).toBe('https://www.theverge.com/');
  156 | });
  157 |

    at /home/runner/work/playwright/playwright/tests/library/browsercontext-har.spec.ts:154:19

⚠️ [firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:706:5 › should not emit after w/o before

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 8,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

Retry 1:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 6,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

--- Merge [workflow run](https://github.com/microsoft/playwright/actions/runs/5558914594).

[github-actions]

Test results for "tests 2"

4 failed
❌ [chromium] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
❌ [webkit] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
❌ [firefox] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
❌ [chromium-chromium-tip-of-tree] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse

2 flaky
⚠️ [chromium] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [firefox] › library/fetch-proxy.spec.ts:30:3 › context request should pick up proxy credentials

12138 passed, 741 skipped
✔️✔️✔️

❌ [chromium] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
Retry 1:
Retry 2:
Retry 3:

❌ [webkit] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
Retry 1:
Retry 2:
Retry 3:

❌ [firefox] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
Retry 1:
Retry 2:
Retry 3:

❌ [chromium-chromium-tip-of-tree] › library/debug-controller.spec.ts:233:1 › should reset routes before reuse
Retry 1:
Retry 2:
Retry 3:

⚠️ [chromium] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-pytest.spec.ts:61:3

Retry 1:

Error: Process failed with exit code 1

   at config/commonFixtures.ts:202

  200 |     const r = await this.exited;
  201 |     if (r.exitCode)
> 202 |       throw new Error(`Process failed with exit code ${r.exitCode}`);
      |             ^
  203 |     if (r.signal)
  204 |       throw new Error(`Process received signal: ${r.signal}`);
  205 |   }

    at TestChildProcess.cleanExit (/home/runner/work/playwright/playwright/tests/config/commonFixtures.ts:202:13)
    at /home/runner/work/playwright/playwright/tests/config/baseTest.ts:49:14
    at /home/runner/work/playwright/playwright/tests/library/inspector/cli-codegen-pytest.spec.ts:61:3

⚠️ [firefox] › library/fetch-proxy.spec.ts:30:3 › context request should pick up proxy credentials

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Basic dXNlcjpzZWNyZXQ="
Received: undefined

  41 |   const response = await context.request.get('http://non-existent.com/simple.json');
  42 |   expect(proxyServer.connectHosts).toContain('non-existent.com:80');
> 43 |   expect(auth).toBe('Basic ' + Buffer.from('user:secret').toString('base64'));
     |                ^
  44 |   expect(await response.json()).toEqual({ foo: 'bar' });
  45 |   await browser.close();
  46 | });

    at /home/runner/work/playwright/playwright/tests/library/fetch-proxy.spec.ts:43:16

--- Merge [workflow run](https://github.com/microsoft/playwright/actions/runs/5559145042).