Skip to content

Releases: spatie/crawler

4.6.2

08 Aug 06:52
Compare
Choose a tag to compare
update CHANGELOG

4.6.1

07 Aug 22:23
08b6a0f
Compare
Choose a tag to compare
  • fix bugs in hasAlreadyBeenProcessed

4.6.0

07 Aug 08:16
Compare
Choose a tag to compare
wip

4.5.0

22 Jul 09:58
Compare
Choose a tag to compare
Update CHANGELOG

4.4.3

23 Jun 18:09
54b268f
Compare
Choose a tag to compare
  • delayBetweenRequests now uses int instead of float everywhere

4.4.2

20 Jun 11:08
Compare
Choose a tag to compare
Update CHANGELOG

4.4.1

06 Jun 08:00
4a57ce7
Compare
Choose a tag to compare

4.4.1 - 2019-06-06

  • handle relative paths after redirects correctly

4.4.0

05 Apr 12:41
5797619
Compare
Choose a tag to compare
  • add getUrls and getPendingUrls

4.3.2

04 Apr 14:03
Compare
Choose a tag to compare
  • Respect maximumDepth in combination with robots (#181)

4.3.1

03 Apr 13:25
Compare
Choose a tag to compare
  • Properly handle noindex,follow urls.