docs/guides/proxy-management

[giscus[bot]]

docs/guides/proxy-management

Using proxies to get around those annoying IP-blocks

https://crawlee.dev/docs/guides/proxy-management

[toptr]

How to use different proxies when navigating to the same link?
How to work with rotating proxies where rotation occurs on the proxy side? How to force the browser to open a new connection forcibly?
The example below allows obtaining different IP addresses, how to achieve the same behavior in Crawlee?

import { firefox } from 'playwright';

(async () => {
    const browser = await firefox.launch();
    for (let i = 0; i < 5; i++) {
        const context = await browser.newContext({ proxy: { server: "HOST:PORT" } });
        const page = await context.newPage();
        await page.goto('https://httpbin.org/ip');
        const ip = await page.textContent("body");
        console.log(ip);
        await context.close();
    }
    await browser.close();
})();