Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove / Empty Queue #293

Closed
olliem36 opened this issue Nov 20, 2018 · 8 comments
Closed

Remove / Empty Queue #293

olliem36 opened this issue Nov 20, 2018 · 8 comments

Comments

@olliem36
Copy link

How can I empty the queue and cancel current queued items?

@mike442144
Copy link
Collaborator

No way till now, what's your scenario? is it possible to change your flow?

@olliem36
Copy link
Author

I'm crawling a set of sites for a particular piece of information. When I have located the information I wish to stop crawling that particular site.

For now, I'm not using any concurrency when crawling a site, so there are no queued tasks to kill when I have found what I'm looking for.

On a separate note, how can I use jsdom with the library? I can't find an example anywhere?

Thanks!

@mike442144
Copy link
Collaborator

You just place your conditional code in your callback and decide to queue pending tasks or not. jsdom is deprecated for now. If you wanna get ajax data, better to send request to that ajax url.

@mike442144
Copy link
Collaborator

close due to inactive

@LouisWayne
Copy link

I want this feature..lol

@mike442144
Copy link
Collaborator

@LouisWayne What's your scenario?

@LouisWayne
Copy link

@mike442144

I want to manually stop the crawler from the admin screen

@mike442144
Copy link
Collaborator

@LouisWayne Can you just kill the process?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants