You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
So far this worked well. The tutorial offers a new solution but this literally suggest to manually open multiple terminals.
This is not really feasible in an automized setting where everything is handled from within Python. Also there are multiple preprocessing steps also in the scripts not just model training.
Would it be possible to choose a process based backend for paralellization ?
From my understanding loky uses forking on Linux instead of thread based paralleization ?
I´ve been using mlr3 in R so far and parallelization was pretty easy without setting up a database or starting multiple terminals. Even for bayesian optimization. While Optuna is really amazing, parallelization seem overly complicated and changing all the time.
The text was updated successfully, but these errors were encountered:
I suppose the issue creator looks happy with my answer, so let me close this issue. Please feel free to re-open if you ask the further question on n_jobs.
As 2.7 seems to have deprecated n_jobs how to do parallelization now, what to do now ?
So far i have been using:
So far this worked well. The tutorial offers a new solution but this literally suggest to manually open multiple terminals.
This is not really feasible in an automized setting where everything is handled from within Python. Also there are multiple preprocessing steps also in the scripts not just model training.
Would it be possible to choose a process based backend for paralellization ?
From my understanding loky uses forking on Linux instead of thread based paralleization ?
I´ve been using mlr3 in R so far and parallelization was pretty easy without setting up a database or starting multiple terminals. Even for bayesian optimization. While Optuna is really amazing, parallelization seem overly complicated and changing all the time.
The text was updated successfully, but these errors were encountered: