Web scraper 🔍

Description

This project is a web scraper designed to extract data from websites.

How to use

1. Clone the repository
2. cd webscraper
3. cd app
4. pip3 install -r requirements.txt
5. python3 scripts/monet.py for the monet scraper
6. python3 scripts/torres.py for the torres scraper

How to use with Docker

1. Clone the repository
2. cd webscraper/app
3. docker compose up -d
4. docker exec -it docker exec -it scraper xvfb-run --auto-servernum --server-num=1 --server-args='-screen 0, 1920x1080x24' python3 scripts/monet.py for the monet scraper
5. docker exec -it docker exec -it scraper xvfb-run --auto-servernum --server-num=1 --server-args='-screen 0, 1920x1080x24' python3 scripts/torres.py for the torres scraper
6. docker compose down

Video

Watch the video