用爬虫爬取小说网站上所有小说，存储到数据库中，并用爬到的数据构建自己的小说网站

Dynamic configurable crawl (动态可配置化爬虫)

Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira: https://scrapinghub.atlassian.net/projects/WEB

项目整体分为scrapy-redis分布式爬虫爬取数据、基于ElasticSearch数据检索和前端界面展示三大模块。做此项目是为了熟悉scrapy-redis的基本流程，以及其背后的原理，同时熟悉ElasticSearch的使用。本项目可以作为一个基于ES存储的简单但是相对全面的全栈开发的Demo。项目中所采用的组件均在win10本地环境搭建（伪分布），旨在演示项目流程。你可以参考该项目，并将其扩展到多个主机上，实现分布式ES以及分布式Scrapy。

Scrapyd Dashboard

A Platform designed to track different products on the biggest Ecommerce in MENA region

El proyecto consiste en la recopilación de información de documentos descalificados de páginas web como la CIA, Mossad y la NSA.

Scrape salaries from Glassdoor, store them in AWS DynamoDB and visual analysis with plotly's Dash

Web-Application, which shows information about the product from online stores. Built with Django and Scrapy!

Real Estate Rental Info Data Collector

Batyr is a web application that can be used to improve listening skills.

This is a hobby project. It helps me to decide if i should open crate or sell it.

IMDb crawler - Scrapy, MongoDB, Docker, Flask

Web search engine for the SM Caen soccer club

Uso de scrapy para integración con Drupal

A Django project with Scrapy. Help you to get sources more conveniently.

scrapy app of python for learning