This repository contains a Python web scraper that extracts data from university websites. The scraper is designed to retrieve specific information andit is customizable for different uses.
The article: Web Scraper Medium Article
- Data Scraping: The scraper multiple HTML fields to specify where to look for and the keywords to look for.
- Customizable: Easily modify the scraper to suit your specific use case.
- UI: The Scraper features a user-friendly UI written in TKinter
- Database: he scraper uses an SQL database for the website configs and retrieved information.
- Multithread: For each website a dedicated thread is created for faster data retrieval.
- Documentation: Detailed instructions on how to use the scraper are provided in the code comments.
- Clone this repository to your local machine.
- Install the required dependencies.