This aims to scrape this page (embedded here) to turn it into a CSV.
Uses https://mircozeiss.com/json2csv/ for creating the CSV.
- Write the scraper: INN/umbrella-currentorg#135
- Conversion task (old): INN/umbrella-currentorg#121
- Final scrape: INN/umbrella-currentorg#136
- Clone this repo
- Run
make
- In the browser window opened by the
scrape
target, open your browser's dev tools. - Find the console log item that is the contents of a CSV. Save it.
Other make
targets:
make clean
removes all files generated bymake
make download
redownloads the databasemake injected
inserts our scraping JS into the downloaded page and performs some text replacements that are undone byinjection.js
make scrape
opens the post-injection page in the browser
- you're on a Mac with all the Homebrew dependencies, including
make
andopen
- Linux users may be able to
alias open=xdg-open
- Linux users may be able to