Skip to content

Releases: jaypyles/Scraperr

v1.0.4

22 Nov 00:14
Compare
Choose a tag to compare

Improvements

  • Drop MongoDB, replace with sqllite

Reasoning

Remove the need for another dependency, sqllite is more than enough to act as a queue.

v1.0.3

17 Nov 03:03
7d80ff5
Compare
Choose a tag to compare

Improvements

  • Added the ability to create a "Site Map" which is a series of actions performed on a site. This currently is either clicking a button or inputting text into a field.

Bug Fixes

  • Issue with scroll ability on job queue
  • Issue with scroll ability on main page

v1.0.2

13 Nov 04:40
Compare
Choose a tag to compare

Improvements

  • Restructure to pass API calls to Next API first
  • Remove dependency on reverse proxy

v1.0.1

10 Nov 03:29
1cdffd9
Compare
Choose a tag to compare

Summary

  • Added the ability to pass in a list of comma separated proxies to be used when submitting a scraping job.

v1.0.0

07 Nov 01:25
Compare
Choose a tag to compare

Improvements

  • Add scrolling when attempting to scrape a page a long page which may trigger data loading on scroll
  • Remove login requirement to scrape
  • Add "Go to Job" after submitting a job
  • Fix issues with commas breaking CSV files on download
  • Fix broken logs page