Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(chromium-tip-of-tree): roll to r1142 #26441

Merged
merged 2 commits into from
Aug 12, 2023
Merged

feat(chromium-tip-of-tree): roll to r1142 #26441

merged 2 commits into from
Aug 12, 2023

Conversation

playwrightmachine
Copy link
Collaborator

@playwrightmachine playwrightmachine commented Aug 11, 2023 •
edited by mxschmitt
Loading

Fixes #24549

@github-actions
Copy link
Contributor

Test results for "tests 1"

1 failed
❌ [chromium] › page/page-accessibility.spec.ts:146:3 › rich text editable fields should have children

9 flaky
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [playwright-test] › ui-mode-trace.spec.ts:22:5 › should merge trace events
⚠️ [playwright-test] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events
⚠️ [playwright-test] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [playwright-test] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

25029 passed, 583 skipped
✔️✔️✔️

❌ [chromium] › page/page-accessibility.spec.ts:146:3 › rich text editable fields should have children 

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Retry 1:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Retry 2:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Retry 3:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Merge workflow run.

@github-actions
Copy link
Contributor

Test results for "tests 2"

2 fatal errors, not part of any test
17 failed
❌ [chromium] › library/chromium/launcher.spec.ts:102:3 › should support request/response events when using backgroundPage()
❌ [chromium] › page/page-event-request.spec.ts:44:3 › should report requests and responses handled by service worker
❌ [chromium] › page/page-event-request.spec.ts:72:3 › should report requests and responses handled by service worker with routing
❌ [firefox] › library/beforeunload.spec.ts:20:3 › should close browser with beforeunload page
❌ [firefox] › library/browsercontext-har.spec.ts:237:3 › should produce extracted zip
❌ [firefox] › library/browsercontext-har.spec.ts:256:3 › should round-trip extracted har.zip
❌ [firefox] › library/browsercontext-locale.spec.ts:118:3 › should be isolated between contexts
❌ [firefox] › library/browsercontext-pages.spec.ts:128:3 › should not leak listeners during navigation of 20 pages
❌ [firefox] › library/proxy.spec.ts:93:11 › should proxy local network requests › by default › link-local
❌ [firefox] › library/proxy.spec.ts:93:11 › should proxy local network requests › with other bypasses › localhost
❌ [firefox] › library/role-utils.spec.ts:37:7 › wpt accname #0
❌ [firefox] › library/role-utils.spec.ts:37:7 › wpt accname #1
❌ [firefox] › library/role-utils.spec.ts:37:7 › wpt accname #2
❌ [chromium] › page/page-accessibility.spec.ts:146:3 › rich text editable fields should have children
❌ [webkit] › library\har.spec.ts:659:3 › should return security details directly from response
❌ [webkit] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2
❌ [webkit] › library\har.spec.ts:659:3 › should return security details directly from response

75 flaky
⚠️ [chromium] › library/browsercontext-proxy.spec.ts:322:3 › should exclude patterns
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:506:5 › should export trace concurrently to second navigation
⚠️ [chromium] › page/page-screenshot.spec.ts:610:5 › page screenshot animations › should stop animations that happen right before screenshot
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-drag.spec.ts💯5 › Drag and drop › should cancel on escape
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library\browsercontext-viewport-mobile.spec.ts:57:5 › mobile viewport › should be detectable by Modernizr
⚠️ [chromium] › library\browsercontext-viewport.spec.ts:94:3 › should not have touch by default
⚠️ [chromium] › library\tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [chromium] › library\tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [chromium] › library/beforeunload.spec.ts:92:3 › should not stall on evaluate when dismissing beforeunload
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [firefox] › library/browsercontext-base-url.spec.ts:37:3 › should construct a new URL when a baseURL in browserType.launchPersistentContext is passed to page.goto
⚠️ [firefox] › library/browsercontext-locale.spec.ts:141:3 › should not change default locale in another context
⚠️ [firefox] › library/defaultbrowsercontext-1.spec.ts:149:3 › should support javascriptEnabled option
⚠️ [firefox] › library/emulation-focus.spec.ts:65:3 › should not affect mouse event target page
⚠️ [firefox] › library/inspector/cli-codegen-python.spec.ts:74:5 › should save the codegen output to a file if specified
⚠️ [firefox] › library/proxy.spec.ts:31:3 › should use proxy @smoke
⚠️ [firefox] › library/proxy.spec.ts:44:3 › should use proxy for second page
⚠️ [firefox] › library/trace-viewer.spec.ts:176:1 › should show params and return value
⚠️ [firefox] › library/video.spec.ts:165:5 › screencast › should work with old options
⚠️ [firefox] › library/video.spec.ts:189:5 › screencast › should capture static page
⚠️ [firefox] › library/video.spec.ts:677:5 › screencast › should capture full viewport
⚠️ [firefox] › library/video.spec.ts:712:5 › screencast › should capture full viewport on hidpi
⚠️ [firefox] › page/page-goto.spec.ts:482:3 › should succeed on url bar navigation when there is pending navigation
⚠️ [firefox] › library/video.spec.ts:165:5 › screencast › should work with old options
⚠️ [firefox] › library/video.spec.ts:189:5 › screencast › should capture static page
⚠️ [firefox] › library/video.spec.ts:677:5 › screencast › should capture full viewport
⚠️ [firefox] › page/page-goto.spec.ts:431:3 › js redirect overrides url bar navigation
⚠️ [firefox] › library\browsercontext-fetch.spec.ts:221:3 › should preserve cookie order from Set-Cookie header
⚠️ [firefox] › library\browsercontext-har.spec.ts:158:3 › should change document URL after redirected navigation on click
⚠️ [firefox] › library\browsercontext-locale.spec.ts:118:3 › should be isolated between contexts
⚠️ [firefox] › library\browsercontext-pages.spec.ts:128:3 › should not leak listeners during navigation of 20 pages
⚠️ [firefox] › library\capabilities.spec.ts:173:3 › navigator.clipboard should be present
⚠️ [firefox] › library\download.spec.ts:612:3 › should be able to download a inline PDF file via response interception
⚠️ [firefox] › library\permissions.spec.ts:103:5 › permissions › should trigger permission onchange
⚠️ [firefox] › page\frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [firefox] › page\page-event-network.spec.ts:45:3 › Page.Events.RequestFailed @smoke
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › page/elementhandle-bounding-box.spec.ts:64:3 › should handle scroll offset and click
⚠️ [firefox] › library/headful.spec.ts:83:3 › should dispatch click events to oversized viewports
⚠️ [firefox] › library/proxy.spec.ts:179:3 › should exclude patterns
⚠️ [firefox] › page/page-request-continue.spec.ts:271:3 › should work with Cross-Origin-Opener-Policy
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › library\proxy.spec.ts:179:3 › should exclude patterns
⚠️ [firefox] › library\signals.spec.ts:25:5 › should close the browser when the node process closes
⚠️ [firefox] › page\page-goto.spec.ts:226:3 › should fail when server returns 204
⚠️ [firefox] › page\page-history.spec.ts:181:3 › page.reload should work with cross-origin redirect
⚠️ [firefox] › page\page-wait-for-function.spec.ts:55:3 › should avoid side effects after timeout
⚠️ [webkit] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [webkit] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [webkit] › library/popup.spec.ts:115:3 › should inherit viewport size from browser context
⚠️ [webkit] › page/page-drag.spec.ts:272:5 › Drag and drop › should work if a frame is stalled
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › page/page-drag.spec.ts:70:5 › Drag and drop › should work inside iframe
⚠️ [webkit] › library\browsercontext-viewport.spec.ts:143:12 › should drag with high dpi
⚠️ [webkit] › library\har.spec.ts:424:3 › should return receive time
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:323:7 › cli codegen › should fill [contentEditable]
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:552:7 › cli codegen › should select
⚠️ [webkit] › library\inspector\cli-codegen-3.spec.ts:392:7 › cli codegen › should generate getByPlaceholder
⚠️ [webkit] › library\inspector\cli-codegen-3.spec.ts:450:7 › cli codegen › should generate getByLabel
⚠️ [webkit] › library\tracing.spec.ts:469:5 › should work with multiple chunks
⚠️ [webkit] › page/page-request-fallback.spec.ts:239:5 › post data › should amend binary post data
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [webkit] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [webkit] › library\har.spec.ts:424:3 › should return receive time
⚠️ [webkit] › library\tracing.spec.ts:469:5 › should work with multiple chunks

1 interrupted
⚠️ [firefox] › library/role-utils.spec.ts:102:5 › axe-core implicit-role

98443 passed, 7766 skipped
✔️✔️✔️

❌ fatal error, not part of any test

Timed out waiting 5400s for the test suite to run

❌ fatal error, not part of any test

Timed out waiting 5400s for the teardown for test suite to run

❌ [chromium] › library/chromium/launcher.spec.ts:102:3 › should support request/response events when using backgroundPage() 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [chromium] › page/page-event-request.spec.ts:44:3 › should report requests and responses handled by service worker 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [chromium] › page/page-event-request.spec.ts:72:3 › should report requests and responses handled by service worker with routing 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/beforeunload.spec.ts:20:3 › should close browser with beforeunload page 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/browsercontext-har.spec.ts:237:3 › should produce extracted zip 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/browsercontext-har.spec.ts:256:3 › should round-trip extracted har.zip 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/browsercontext-locale.spec.ts:118:3 › should be isolated between contexts 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/browsercontext-pages.spec.ts:128:3 › should not leak listeners during navigation of 20 pages 

Test timeout of 90000ms exceeded.

Retry 1:

Test timeout of 90000ms exceeded.

Retry 2:

Test timeout of 90000ms exceeded.

Retry 3:

Test timeout of 90000ms exceeded.

❌ [firefox] › library/proxy.spec.ts:93:11 › should proxy local network requests › by default › link-local 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/proxy.spec.ts:93:11 › should proxy local network requests › with other bypasses › localhost 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/role-utils.spec.ts:37:7 › wpt accname #0 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/role-utils.spec.ts:37:7 › wpt accname #1 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [firefox] › library/role-utils.spec.ts:37:7 › wpt accname #2 

Test timeout of 30000ms exceeded.

Retry 1:

Test timeout of 30000ms exceeded.

Retry 2:

Test timeout of 30000ms exceeded.

Retry 3:

Test timeout of 30000ms exceeded.

❌ [chromium] › page/page-accessibility.spec.ts:146:3 › rich text editable fields should have children 

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Retry 1:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Retry 2:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

Retry 3:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Object {
+   "checked": undefined,
    "children": Array [
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "Edit this image: ",
+       "pressed": undefined,
        "role": "text",
+       "value": undefined,
      },
      Object {
+       "checked": undefined,
+       "children": undefined,
        "name": "my fake image",
-       "role": "img",
+       "pressed": undefined,
+       "role": "image",
+       "value": undefined,
      },
    ],
    "name": "",
+   "pressed": undefined,
    "role": "generic",
    "value": "Edit this image: ",
  }

  176 |   };
  177 |   const snapshot = await page.accessibility.snapshot();
> 178 |   expect(snapshot.children[0]).toEqual(golden);
      |                                ^
  179 | });
  180 |
  181 | it('rich text editable fields with role should have children', async function({ page, browserName, browserMajorVersion, browserVersion, channel, isWebView2 }) {

    at /home/runner/work/playwright/playwright/tests/page/page-accessibility.spec.ts:178:32

❌ [webkit] › library\har.spec.ts:659:3 › should return security details directly from response 

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Retry 1:

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Retry 2:

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Retry 3:

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

❌ [webkit] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2 

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 1:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 2:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 3:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

❌ [webkit] › library\har.spec.ts:659:3 › should return security details directly from response 

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Retry 1:

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Retry 2:

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Retry 3:

Error: expect(received).toEqual(expected) // deep equality

- Expected  - 1
+ Received  + 2

  Object {
+   "protocol": undefined,
    "subjectName": "playwright-test",
    "validFrom": 1691708270,
-   "validTo": -1,
+   "validTo": 2007068270,
  }

  665 |   const securityDetails = await response.securityDetails();
  666 |   if (browserName === 'webkit' && platform === 'win32')
> 667 |     expect({ ...securityDetails, protocol: undefined }).toEqual({ subjectName: 'playwright-test', validFrom: 1691708270, validTo: -1 });
      |                                                         ^
  668 |   else if (browserName === 'webkit')
  669 |     expect(securityDetails).toEqual({ protocol: 'TLS 1.3', subjectName: 'playwright-test', validFrom: 1691708270, validTo: 2007068270 });
  670 |   else

    at D:\a\playwright\playwright\tests\library\har.spec.ts:667:57

Merge workflow run.

This was referenced Aug 12, 2023
Closed
Closed
@mxschmitt mxschmitt added CQ1 and removed CQ1 labels Aug 12, 2023
@github-actions
Copy link
Contributor

Test results for "tests 1"

2 failed
❌ [playwright-test] › expect-to-pass.spec.ts:208:5 › should show intermediate result for toPass that spills over test time
❌ [playwright-test] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats

11 flaky
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/browsertype-connect.spec.ts:648:5 › launchServer › should upload large file
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox] › page/page-event-request.spec.ts:162:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox] › page/page-request-continue.spec.ts:271:3 › should work with Cross-Origin-Opener-Policy
⚠️ [playwright-test] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events
⚠️ [chromium] › library/inspector/cli-codegen-python-async.spec.ts:82:5 › should save the codegen output to a file if specified
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/inspector/cli-codegen-javascript.spec.ts:87:5 › should save the codegen output to a file if specified
⚠️ [playwright-test] › ui-mode-test-progress.spec.ts:218:5 › should show trace w/ multiple contexts
⚠️ [playwright-test] › ui-mode-trace.spec.ts:53:5 › should merge web assertion events

25026 passed, 583 skipped
✔️✔️✔️

❌ [playwright-test] › expect-to-pass.spec.ts:208:5 › should show intermediate result for toPass that spills over test time 

Error: expect(received).toContain(expected) // indexOf

Expected substring: "Expected: 2"
Received string:    "
Running 1 test using 1 worker·
  ✘  1 a.spec.ts:3:11 › should fail (1.0s)··
  1) a.spec.ts:3:11 › should fail ──────────────────────────────────────────────────────────────────·
    Test timeout of 1000ms exceeded.·
  1 failed
    a.spec.ts:3:11 › should fail ───────────────────────────────────────────────────────────────────
"

  218 |   }, { timeout: 1000 });
  219 |   expect(result.exitCode).toBe(1);
> 220 |   expect(result.output).toContain('Expected: 2');
      |                         ^
  221 |   expect(result.output).toContain('Received: 3');
  222 | });
  223 |

    at /home/runner/work/playwright/playwright/tests/playwright-test/expect-to-pass.spec.ts:220:25

❌ [playwright-test] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats 

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Total time: 1088ms"
Received: "Total time: 1.1s"

  1774 |         await expect(page.locator('.chip', { hasText: 'c.test.js' })).toHaveCount(1);
  1775 |
> 1776 |         await flakyButton.click();
       |                                 ^
  1777 |
  1778 |         await expect(searchInput).toHaveValue('@regression @flaky');
  1779 |         await expect(page).toHaveURL(/@regression%20@flaky/);

    at checkTotalDuration (D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1776:33)
    at D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1782:9

Merge workflow run.

@mxschmitt mxschmitt merged commit 04b71bf into main Aug 12, 2023
87 of 96 checks passed
@mxschmitt mxschmitt deleted the roll-into-pw-chromium-tip-of-tree/1142 branch August 12, 2023 18:00
@github-actions
Copy link
Contributor

Test results for "tests 2"

1 failed
❌ [webkit] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2

66 flaky
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/elementhandle-misc.spec.ts:27:3 › should hover when Node is removed
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-drag.spec.ts:330:5 › Drag and drop › should work with locators
⚠️ [chromium] › library\chromium\oopif.spec.ts:314:3 › should emit filechooser event for iframe
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library\tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › library/browsercontext-events.spec.ts:19:5 › console event should work @smoke
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-screenshot.spec.ts:752:5 › page screenshot animations › should trigger particular events for css transitions
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › library/capabilities.spec.ts:256:3 › requestFullscreen
⚠️ [firefox] › library/video.spec.ts:334:5 › screencast › should capture navigation
⚠️ [firefox] › library/trace-viewer.spec.ts:847:1 › should pick locator
⚠️ [firefox] › library/video.spec.ts:165:5 › screencast › should work with old options
⚠️ [firefox] › library/video.spec.ts:677:5 › screencast › should capture full viewport
⚠️ [firefox] › library/video.spec.ts:712:5 › screencast › should capture full viewport on hidpi
⚠️ [firefox] › page/page-drag.spec.ts:289:5 › Drag and drop › should work with the helper method
⚠️ [firefox] › page/page-goto.spec.ts:482:3 › should succeed on url bar navigation when there is pending navigation
⚠️ [firefox] › library\browsercontext-pages.spec.ts:128:3 › should not leak listeners during navigation of 20 pages
⚠️ [firefox] › library\capabilities.spec.ts:212:3 › webkit should define window.safari
⚠️ [firefox] › library\hit-target.spec.ts:52:3 › should block click when mousedown fails
⚠️ [firefox] › library\inspector\cli-codegen-1.spec.ts:196:7 › cli codegen › should not target selector preview by text regexp
⚠️ [firefox] › library\inspector\cli-codegen-2.spec.ts:493:7 › cli codegen › should --save-trace
⚠️ [firefox] › library\signals.spec.ts:25:5 › should close the browser when the node process closes
⚠️ [firefox] › library\trace-viewer.spec.ts:83:1 › should show empty trace viewer
⚠️ [firefox] › library\tracing.spec.ts:363:5 › should not stall on dialogs
⚠️ [firefox] › page\page-click-timeout-3.spec.ts:39:3 › should timeout waiting for hit target
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [firefox] › page/page-request-continue.spec.ts:271:3 › should work with Cross-Origin-Opener-Policy
⚠️ [firefox] › library\beforeunload.spec.ts:20:3 › should close browser with beforeunload page
⚠️ [firefox] › library\browsercontext-user-agent.spec.ts:90:3 › custom user agent for download
⚠️ [firefox] › library\proxy.spec.ts:179:3 › should exclude patterns
⚠️ [firefox] › library\signals.spec.ts:25:5 › should close the browser when the node process closes
⚠️ [firefox] › page\page-history.spec.ts:55:3 › page.goBack should work for file urls
⚠️ [chromium] › library/capabilities.spec.ts:139:3 › should not crash on showDirectoryPicker
⚠️ [firefox] › library/fetch-proxy.spec.ts:30:3 › context request should pick up proxy credentials
⚠️ [firefox] › page/page-wait-for-function.spec.ts:43:3 › should poll on interval
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/inspector/cli-codegen-pytest.spec.ts:56:5 › should save the codegen output to a file if specified
⚠️ [webkit] › page/selectors-vue.spec.ts:51:7 › vue2 › should not crash when there is no match
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › page/page-drag.spec.ts💯5 › Drag and drop › should cancel on escape
⚠️ [webkit] › page/page-drag.spec.ts:246:5 › Drag and drop › should work if the drag event is captured but not canceled
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/inspector/cli-codegen-1.spec.ts:55:7 › cli codegen › should ignore programmatic events
⚠️ [webkit] › library/inspector/cli-codegen-1.spec.ts:520:7 › cli codegen › should uncheck
⚠️ [webkit] › page/elementhandle-misc.spec.ts:20:3 › should hover
⚠️ [webkit] › page/page-drag.spec.ts:272:5 › Drag and drop › should work if a frame is stalled
⚠️ [webkit] › library\browsercontext-user-agent.spec.ts:22:3 › should work
⚠️ [webkit] › library\browsercontext-viewport.spec.ts:143:12 › should drag with high dpi
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:403:7 › cli codegen › should record ArrowDown
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:520:7 › cli codegen › should uncheck
⚠️ [webkit] › library\inspector\cli-codegen-1.spec.ts:552:7 › cli codegen › should select
⚠️ [webkit] › library\inspector\cli-codegen-3.spec.ts:22:7 › cli codegen › should click locator.first
⚠️ [webkit] › library\inspector\cli-codegen-3.spec.ts:392:7 › cli codegen › should generate getByPlaceholder
⚠️ [webkit] › page\page-drag.spec.ts:272:5 › Drag and drop › should work if a frame is stalled
⚠️ [webkit] › page\page-drag.spec.ts:289:5 › Drag and drop › should work with the helper method
⚠️ [webkit] › page/page-request-fallback.spec.ts:239:5 › post data › should amend binary post data
⚠️ [webkit] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit] › library/browsercontext-fetch.spec.ts:1039:3 › should abort requests when browser context closes
⚠️ [webkit] › library\har.spec.ts:424:3 › should return receive time

100519 passed, 5716 skipped
✔️✔️✔️

❌ [webkit] › library/signals.spec.ts:62:7 › signals › should report browser close signal 2 

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 1:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 2:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Retry 3:

Error: expect(received).toBe(expected) // Object.is equality

Expected: "137"
Received: "null"

  66 |     if (isMac && browserName === 'webkit' && parseInt(os.release(), 10) === 22) {
  67 |       // WebKit on mac13 exits differently.
> 68 |       expect(await remoteServer.out('exitCode')).toBe('137');
     |                                                  ^
  69 |       expect(await remoteServer.out('signal')).toBe('null');
  70 |     } else {
  71 |       expect(await remoteServer.out('exitCode')).toBe('null');

    at /Users/runner/work/playwright/playwright/tests/library/signals.spec.ts:68:50

Merge workflow run.

Germandrummer92 pushed a commit to OctoMind-dev/playwright that referenced this pull request Oct 27, 2023
@playwrightmachine @Germandrummer92
feat(chromium-tip-of-tree): roll to r1142 (microsoft#26441)
768da6d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CQ1
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[internal] Recent Chromium ToT failure
2 participants
@playwrightmachine @mxschmitt