how to Skip request of page at preNavigationHooks

[am1ru1]

Hi All!

I have a list of links to be excluded (I can't use enqueueLinks filter for this use case).
How do I skip/ignore a specific request? I am able to throw Error to skip an URL but this is not an Error and its disrupts the error statistics.

If I do "return", the handler gets triggered.. any idea?

  preNavigationHooks: [
    ({ session, request }) => {
        if (seenTopics1.includes(request.url)){
          console.log(`Topic have seen before skipping: ${request.url}`);
          request.noRetry = true
          throw new Error("Skip topic");
        }
       },
  ],

[LeMoussel]

You can do it with

• transformRequestFunction option of enqueueLinks.

transformRequestFunction: (request) => {
   if (request.url.match(mySkipRegex)) {
    return null;
}
return request;
}

• By combining the Request#skipNavigation option
  See Skipping navigations for certain requests

[am1ru1]

Updating that the skipNavigation option works, but got "DEBUG PlaywrightCrawler: Page opened." for the skipped URL. Wondering if the page is loaded (traffic downloaded)?

  preNavigationHooks: [
    ({ session, request }) => {
        if (seenTopics1.includes(request.url)){
          console.log(`Topic have seen before skipping: ${request.url}`);
          request.noRetry = true
          request.skipNavigation = true
        }
       },
  ],

router.addHandler("TOPIC", async ({ request, page, log }) => {
  // The request should have the navigation skipped
  if (request.skipNavigation) {
      log.debug(`Skipping Topic: ${request.url}`);

      // Prevent executing the rest of the code as we do not need it
      return;
  }
});

[am1ru1]

@LeMoussel :
transformRequestFunction option of enqueueLinks works much better for my case, since the page is not loaded. Thank you for the guidance!