This project is another example for a requests-based scraper that uses Selenium to encompass a "click for more" button to reveal information and to obtain all URLs that can then be scraped via a simple BeautifulSoup parser. The scraper is part of an academic project to monitor job market developments during the COVID-19 pandemic.
-
Notifications
You must be signed in to change notification settings - Fork 0
calogerobra/job_portal_scraper_pagebutton_2
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Another Selenium-based scraper to elegantly encompass a page button to reveal all elements.
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published