Generic web scraper BASE : https://github.com/naderalexan/generic_scrapper
Python 3.6
- Put scraper.py and requirements.txt in your project directory
- Cd into the project directory
- Create a virualenv
virtualenv env -p python3 - Activate environment
source env/bin/activate - Install requriments
pip install -r requirments.txt - Download and Add chromedriver to your path (https://sites.google.com/a/chromium.org/chromedriver/)