You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm trying to implement a crawler with System.Threading.Tasks.Dataflow, the core feature is to have a TransformBlock, which accepts an url as input, request the url, parse the response, and find more urls for the same block.
Then I noticed a problem that I cannot complete/stop this pipeline. The following code simulates my problem:
I'm trying to implement a crawler with
System.Threading.Tasks.Dataflow
, the core feature is to have aTransformBlock
, which accepts an url as input, request the url, parse the response, and find more urls for the same block.Then I noticed a problem that I cannot complete/stop this pipeline. The following code simulates my problem:
The output is:
And program stuck here,
block.Completion.Wait()
never return.I've also tried to have two blocks link to each other, yet the result is same.
So what can I do about my code? How can I stop this dataflow?
The text was updated successfully, but these errors were encountered: