An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
A Python module to bypass Cloudflare's anti-bot page.
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
Implementation of X/Twitter v1, v2, and GraphQL APIs
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...
Scrape domain names from SSL certificates of arbitrary hosts
Advanced python library to scrap Twitter (tweets, users) from unofficial API
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Scrape Instagram's API with Puppeteer
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Scrape any website, article or RSS/Atom Feed with ease!
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.
Google/Bing Images Web Downloader
Crawl telegra.ph searching for nudes!
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
Node.js package to bypass CloudFlare's anti-bot JavaScript challenges
This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.
Add a description, image, and links to the scrape topic page so that developers can more easily learn about it.
To associate your repository with the scrape topic, visit your repo's landing page and select "manage topics."