Skip to content

A nodejs application using puppeteer to scrape iaeste.org for internships in the CS field, export into an xlsx file and detect if new offers are available since last run.

Notifications You must be signed in to change notification settings

YassineMEJRI/IAESTE-offers-web-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

IAESTE-offers-web-scraper

A nodejs CLI tool to scrape iaeste.org for internships in the CS field using a headless browser, export into an xlsx file and detect if new offers are available since last run.

How to use?

First you need to install the node dependencies. Simply cd into the directory using the terminal and run:

npm i

After installation finishes, run the application using:

node .

The script will create an internships.xlsx file that list all scraped offers with their details, like the title, start date, expiration date, salary, link to the offer, and more.

It will also create an old_data.json file. This file contains the history of the previous run. Keep it to detect new available offers since last run.

Packages used

puppeteer | chalk | nanospinner | xlsx

About

A nodejs application using puppeteer to scrape iaeste.org for internships in the CS field, export into an xlsx file and detect if new offers are available since last run.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published