You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Datahub users can stop running jobs using mim jobs operate -o kill <jobtitle>. When they do, a context is canceled, and there are a couple of places in the pipeline where datahub checks the context-cancel-state and aborts (kills) job processing.
In practise, these context check points are not frequent enough. Specifically jobs using MultiSource can spend alot of processing time processing source dependencies without checking for canceling.
Datahub should do cancel checks more frequently, so that users always can kill jobs in a timely manner
The text was updated successfully, but these errors were encountered:
Datahub users can stop running jobs using
mim jobs operate -o kill <jobtitle>
. When they do, a context is canceled, and there are a couple of places in the pipeline where datahub checks the context-cancel-state and aborts (kills) job processing.In practise, these context check points are not frequent enough. Specifically jobs using
MultiSource
can spend alot of processing time processing source dependencies without checking for canceling.Datahub should do cancel checks more frequently, so that users always can kill jobs in a timely manner
The text was updated successfully, but these errors were encountered: