MWPW-164967 [NALA] test for Target enablement #2462
Annotations
5 errors, 1 warning, and 1 notice
Run Nala Tests via pr.run.sh:
nala/features/personalization/target-on.test.js#L29
1) [milo-live-chromium] › features/personalization/target-on.test.js:12:5 › @check for running Target tests,@targeton0 @smoke @regression @milo › step-2: verify metadata test page
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.marquee').first().locator('.heading-xl').first()
Expected string: "Target is running"
Received string: "Heading XL Marquee standard medium left"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.marquee').first().locator('.heading-xl').first()
- locator resolved to <h2 class="heading-xl" id="heading-xl-marquee-standard-medium-left">…</h2>
- unexpected value "Heading XL Marquee standard medium left"
27 | await page.goto(metadataURL);
28 | await page.waitForTimeout(1000);
> 29 | await expect(marquee.headingXL).toHaveText('Target is running');
| ^
30 | });
31 |
32 | await test.step('step-3: verify parameter test page', async () => {
at /home/runner/work/milo/milo/nala/features/personalization/target-on.test.js:29:37
at /home/runner/work/milo/milo/nala/features/personalization/target-on.test.js:25:3
|
Run Nala Tests via pr.run.sh:
nala/features/personalization/target-on.test.js#L29
1) [milo-live-chromium] › features/personalization/target-on.test.js:12:5 › @check for running Target tests,@targeton0 @smoke @regression @milo › step-2: verify metadata test page
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveText(expected)
Locator: locator('.marquee').first().locator('.heading-xl').first()
Expected string: "Target is running"
Received string: "Heading XL Marquee standard medium left"
Call log:
- expect.toHaveText with timeout 5000ms
- waiting for locator('.marquee').first().locator('.heading-xl').first()
- locator resolved to <h2 class="heading-xl" id="heading-xl-marquee-standard-medium-left">…</h2>
- unexpected value "Heading XL Marquee standard medium left"
- locator resolved to <h2 class="heading-xl" id="heading-xl-marquee-standard-medium-left">…</h2>
- unexpected value "Heading XL Marquee standard medium left"
27 | await page.goto(metadataURL);
28 | await page.waitForTimeout(1000);
> 29 | await expect(marquee.headingXL).toHaveText('Target is running');
| ^
30 | });
31 |
32 | await test.step('step-3: verify parameter test page', async () => {
at /home/runner/work/milo/milo/nala/features/personalization/target-on.test.js:29:37
at /home/runner/work/milo/milo/nala/features/personalization/target-on.test.js:25:3
|
Run Nala Tests via pr.run.sh:
nala/libs/accessibility.js#L126
2) [milo-live-chromium] › blocks/review/review.test.js:34:7 › Milo Review Block test suite › [Test Id - 1] @review low,@review @smoke @regression @milo › step-2: Verify the accessibility test on the review block
AccessibilityError: [Accessibility Test failed for [Test Id - 1] @review low].
Accessibility test failed : 1 violation(s) found.
========== Accessibility Test ==========
[Test Name ]: [Test Id - 1] @review low
[Test Page URL]: https://target-on--milo--adobecom.aem.live/drafts/nala/blocks/review/review
[Accessibility]: Running accessibility test on the provided locator: locator('.review')
[Result ]: Accessibility test found 1 accessibility violation(s) for [Test Id - 1] @review low
[Violation Details]:
1. Violation: Ensure the contrast between foreground and background colors meets WCAG 2 AA minimum contrast ratio thresholds
- Axe Rule ID: color-contrast
- Severity: serious
- WCAG Tags: cat.color, wcag2aa, wcag143, TTv5, TT13.c, EN-301-549, EN-9.1.4.3, ACT
- Nodes affected:
1. <h3 class="hlx-reviewTitle">Rate your Experience</h3>
- Fix: https://dequeuniversity.com/rules/axe/4.10/color-contrast?application=playwright
at libs/accessibility.js:126
124 | }
125 | } catch (err) {
> 126 | throw new AccessibilityError(
| ^
127 | `[Accessibility Test failed for ${testName}].\n ${err.message}`,
128 | );
129 | }
at runAccessibilityTest (/home/runner/work/milo/milo/nala/libs/accessibility.js:126:11)
at /home/runner/work/milo/milo/nala/blocks/review/review.test.js:44:7
at /home/runner/work/milo/milo/nala/blocks/review/review.test.js:43:5
|
Run Nala Tests via pr.run.sh:
nala/features/mas/benchmark/benchmark.test.js#L46
3) [milo-live-chromium] › features/mas/benchmark/benchmark.test.js:17:7 › Benchmark feature test suite › @MAS-CCD-benchmark,@MAS-CCD @merch-benchmark-ccd-cards @mas-benchmark @Commerce @smoke @regression @milo › step-2: Validate benchmark
Error: 688.1000000000058ms should be less than limit 681.9512195122803ms (adjusted from 400ms)
expect(received).toBeTruthy()
Received: false
44 | expect(times.length).toBeGreaterThan(0);
45 | times.forEach((time) => {
> 46 | expect(parseFloat(time) < parseFloat(limit), `${time}ms should be less than limit ${limitMessage}`).toBeTruthy();
| ^
47 | });
48 | });
49 | });
at forEach (/home/runner/work/milo/milo/nala/features/mas/benchmark/benchmark.test.js:46:109)
at /home/runner/work/milo/milo/nala/features/mas/benchmark/benchmark.test.js:45:13
at /home/runner/work/milo/milo/nala/features/mas/benchmark/benchmark.test.js:27:5
|
Run Nala Tests via pr.run.sh
Process completed with exit code 1.
|
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Run Nala Tests via pr.run.sh
1 failed
[milo-live-chromium] › features/personalization/target-on.test.js:12:5 › @check for running Target tests,@targeton0 @smoke @regression @milo
2 flaky
[milo-live-chromium] › blocks/review/review.test.js:34:7 › Milo Review Block test suite › [Test Id - 1] @review low,@review @smoke @regression @milo
[milo-live-chromium] › features/mas/benchmark/benchmark.test.js:17:7 › Benchmark feature test suite › @MAS-CCD-benchmark,@MAS-CCD @merch-benchmark-ccd-cards @mas-benchmark @Commerce @smoke @regression @milo
56 skipped
601 passed (7.5m)
|
Loading