Skip to content

Latest commit

 

History

History
31 lines (22 loc) · 649 Bytes

README.md

File metadata and controls

31 lines (22 loc) · 649 Bytes

Simple ecommerce webscrapper

This is a simple ecommerce webscrapper as well as a jupyter notebook file showcasing the initial exploration of the scrapped pages.

Dependencies

I recommend you use anaconda, more info on: https://anaconda.org/.

After installing conda you can create a virtual environment as follows:

conda env create -f environment.yml
source activate scraping_env

Another option is to install needed packages with your favorite third-party package manager, like pip for example:

pip install -r requirements.txt

Usage

The crawler

python ecommerce_spider.py

The notebook

jupyter notebook