You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently, the default number of partitions is hardcoded to 16, the number of cores is hardcoded to 2.
Describe the solution you'd like
We can use psutil and multiprocessing to try to get CPU count, if not found, we hard code. It should try psutil first, if the package is not installed, try multiprocessing. psutil is preferred because it can return physical cores. But I am not sure if we should make this a requirement or not.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Currently, the default number of partitions is hardcoded to 16, the number of cores is hardcoded to 2.
Describe the solution you'd like
We can use
psutil
andmultiprocessing
to try to get CPU count, if not found, we hard code. It should trypsutil
first, if the package is not installed, trymultiprocessing
.psutil
is preferred because it can return physical cores. But I am not sure if we should make this a requirement or not.The text was updated successfully, but these errors were encountered: