Cheerio is lightweight and doesn't require a full browser environment like some other scraping tools. Keep in mind that when scraping websites, you should always review and comply with the website's terms of service and policies to ensure ethical and legal use of the data.
- (Optional) Connect Text Splitter.
- Input desired URL to be scraped.
Visit Web Crawl guide to allow scaping of multiple pages.
Loads URL content as Document