All notable changes to this project will be documented in this file.
- Updated dependencies to their latest versions
- In particular the devDependencies
puppeteer
andpuppeteer-core
received a major upgrade (to version5
) peerDependencies
was changed accordingly.
- In particular the devDependencies
- Updated dependencies to their latest versions
- In particular the devDependencies
puppeteer
andpuppeteer-core
received a major upgrade (to version3
)
- In particular the devDependencies
peerDependencies
was changed to^1.5.0 || ^2.0.0 || ^3.0.0
as there were no changes regarding the API that this library uses.- Removed support for Node.js version 8 as puppeteer dropped support for it.
- Added check to ensure
maxConcurrency
is set (#243)
- Add a new option
perBrowserOptions
for using different args for each puppeteer instance- Allowing to use a different proxy for each worker
- Updated dev dependencies to their latest versions
- Added the parameter
jobWillRetry
to the'taskerror'
Event
- Updated dependencies to their latest versions
- In particular the devDependencies
puppeteer
andpuppeteer-core
received a major upgrade (to version2
)
- In particular the devDependencies
peerDependencies
was changed to^1.5.0 || ^2.0.0
as there were no changes regarding the API that this library uses.- Removed support for Node.js version 6 as puppeteer dropped support for it.
- Updated dependencies to their latest versions
- Fixed bug making it impossible to queue
null
(issue #178)
- License changed to MIT
- Updated dependencies to their latest versions
- Fixed bug, which crashed the cluster in some environments (#113)
- Changed when the
queue
event is emitted (after the job is queued into the internal queue).
- Event
queue
added
- Support for generics via
Cluster<InType, OutType>
package-lock.json
file was not updated
- Internal helper function was accidentally set to public
Cluster.execute
function added- Examples for
Cluster.execute
added
- Fixed support for custom concurrency implementations
- Support for custom puppeteer libraries added
- Support for custom concurrency implementations added
- Updated dependencies to their latest versions
- Fixed another sameDomainDelay bug leading to high CPU usage
- Fixed
sameDomainDelay
bug (issue #11)
- Fixed rarely happening bug (issue #3), which made browser not able to restart
- Node.js support for version 6 and 7 added
- Circular structures led to crashs in case of crawling errors.
- Cluster.task function signature changed from
Cluster.task(page, url)
toCluster.task({ page, data })
.Cluster.queue
can be passed any data instead of a string or object.
- The timeout-promise for a task was not canceled when a task threw an error.
- Cluster can be used without defining a Cluster.task function by queuing only functions.
- Page errors ("Page crashed!") were not caught so far
- maxCPU and maxMemory options removed as they made no sense (better to check how much chromium your machine can handle.)