Awesome Web Scraping

Lists of packages, services and manuals related to web scraping.

Topics

Python - Python packages
PHP - PHP packages
Ruby - Ruby packages
JavaScript - JavaScript packages
Go - Go packages
Web Scraping Manuals - list of articles and books teaching web scraping
dhamaniasad / HeadlessBrowsers - list of (almost) all headless web browsers in existence
DNS over HTTPS providers - list of DNS over HTTPs providers
Awesome Pastebins - list of pastebin sites

Captcha Solving Services

https://2captcha.com

Proxy Server Marketplaces

Telegram Discussion Groups

@grablab - talks in English
@grablab_ru - talks in Russian

How to Contribute to This List

See Contributing guide.

Credits

The list is based initially on some data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript