Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

devops: merge reports fall pw tests in tests 2 #24309

Merged
merged 1 commit into from
Jul 19, 2023

Conversation

yury-s
Copy link
Member

@yury-s yury-s commented Jul 19, 2023

No description provided.

@yury-s yury-s added the CQ1 label Jul 19, 2023
@yury-s yury-s merged commit 8b454cb into microsoft:main Jul 19, 2023
79 of 94 checks passed
@yury-s yury-s deleted the merge-reports-for-all-tests branch July 19, 2023 20:01
@github-actions
Copy link
Contributor

Test results for "tests 1"

2 failed
❌ [playwright-test-windows-latest-node16] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats
❌ [firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:706:5 › should not emit after w/o before

6 flaky
⚠️ [playwright-test-windows-latest-node16] › ui-mode-test-progress.spec.ts:22:5 › should update trace live
⚠️ [playwright-test-windows-latest-node16] › ui-mode-test-progress.spec.ts:218:5 › should show trace w/ multiple contexts
⚠️ [playwright-test-windows-latest-node16] › ui-mode-trace.spec.ts:126:5 › should show snapshots for sync assertions
⚠️ [webkit-ubuntu-22.04-node16] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [firefox-ubuntu-22.04-node16] › library/browsercontext-har.spec.ts:144:3 › should change document URL after redirected navigation
⚠️ [chromium-ubuntu-22.04-node16] › page/page-event-request.spec.ts💯3 › should report navigation requests and responses handled by service worker

21699 passed, 511 skipped
✔️✔️✔️

[playwright-test-windows-latest-node16] › reporter-html.spec.ts:1452:7 › merged › labels › filter should update stats

Error: expect(received).toBe(expected) // Object.is equality

Expected: "Total time: 1288ms"
Received: "Total time: 1.3s"

  1774 |         await expect(page.locator('.chip', { hasText: 'c.test.js' })).toHaveCount(1);
  1775 |
> 1776 |         await flakyButton.click();
       |                                 ^
  1777 |
  1778 |         await expect(searchInput).toHaveValue('@regression @flaky');
  1779 |         await expect(page).toHaveURL(/@regression%20@flaky/);

    at checkTotalDuration (D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1776:33)
    at D:\a\playwright\playwright\tests\playwright-test\reporter-html.spec.ts:1782:9

[firefox-ubuntu-22.04-node16] › library/tracing.spec.ts:706:5 › should not emit after w/o before

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 8,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

Retry 1:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 6,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

Retry 2:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 6,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

Retry 3:

Error: expect(received).toEqual(expected) // deep equality

- Expected  -  1
+ Received  + 11

  Array [
    Object {
+     "apiName": "page.evaluate",
+     "callId": Any<Number>,
+     "type": "before",
+   },
+   Object {
      "apiName": "page.evaluateHandle",
      "callId": Any<Number>,
      "type": "before",
    },
    Object {
      "apiName": undefined,
-     "callId": Any<Number>,
+     "callId": 0,
+     "type": "after",
+   },
+   Object {
+     "apiName": undefined,
+     "callId": 6,
      "type": "after",
    },
  ]

  753 |   {
  754 |     const { events } = await parseTraceRaw(testInfo.outputPath('trace2.zip'));
> 755 |     expect(events.map(sanitize).filter(Boolean)).toEqual([
      |                                                  ^
  756 |       {
  757 |         type: 'before',
  758 |         callId: expect.any(Number),

    at /home/runner/work/playwright/playwright/tests/library/tracing.spec.ts:755:50

Merge workflow run.

Germandrummer92 pushed a commit to OctoMind-dev/playwright that referenced this pull request Oct 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants