4.3.0

• added capability of crawling links with rel= next or prev

4.2.0

• add setDelayBetweenRequests

4.1.7

• fix an issue where the node in the depthtree could be null

4.1.6

• improve performance by only building the depth three when needed
• handlers will get html after JavaScript has been processed

4.1.5

• refactor to improve extendability

4.1.4

• always add links to pool if robots shouldn't be respected

4.1.3

• refactor of internals

4.1.2

• make it possible to override $defaultClientOptions

4.1.1

• Bump minimum required version of spatie/robots-txt to 1.0.1.

4.1.0

Respect robots.txt