bug: shadow root expansion in parseWithCheerio removes content

[barjin]

On some pages (e.g. https://accessgroup.my.site.com/Support/s/article/Dimensions-AOI-Error-Category-number-cannot-be-changed), the call to the parseWithCheerio Playwright helper removes some of the content from the page.

This does not happen when the ignoreShadowRoots constructor option is set to true

Repro:

import { PlaywrightCrawler } from 'crawlee';
import { setTimeout } from 'timers/promises';

const startUrls = ['https://accessgroup.my.site.com/Support/s/article/Dimensions-AOI-Error-Category-number-cannot-be-changed'];

const crawler = new PlaywrightCrawler({
    requestHandler: async ({ parseWithCheerio, page }) => {
        // wait till the content loads
        await page.waitForSelector('.cKnowledge_Articles');

        // parse with Cheerio, expanding the shadow roots (and removing the content).
        await parseWithCheerio();

        await setTimeout(10e3);
    },
    headless: false,
    ignoreShadowRoots: false, // set to `true` to make it work correctly
});

await crawler.run(startUrls);

With ignoreShadowRoots: false:

bad.mp4

With ignoreShadowRoots: true:

good.mp4

CC @B4nan as the author of the original PR adding the shadow root expansion.