Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ONNX does not run with slurm #482

Open
mkuemmel opened this issue Jun 9, 2022 · 1 comment
Open

ONNX does not run with slurm #482

mkuemmel opened this issue Jun 9, 2022 · 1 comment
Assignees
Milestone

Comments

@mkuemmel
Copy link
Collaborator

mkuemmel commented Jun 9, 2022

Since we are using the ONNX runtime for the ML detection we suffer from a problem between ONNX and slurm:
microsoft/onnxruntime#10736

Some comments from Alejandro:

It seems to be C++ code

http://www.xavierdupre.fr/app/onnxruntime/helpsphinx/api_summary.html#onnxruntime.SessionOptions.intra_op_num_threads

It would have to be added here I guess
https://github.com/astrorama/SourceXtractorPlusPlus/blob/2823f0c939a5464d4793994c71367c24b2aa32db/SEImplementation/src/lib/Common/OnnxModel.cpp#L23

Not sure how to expose that to the user of sourcextractor++, though, because there are a *lot* of options.
@mkuemmel
Copy link
Collaborator Author

I stumbled again over this one, meaning I was wondering why a job did not start until I remembered this issue.

Shall we fix this one variable to 1 to have a solution for slurm and see how far we come?

Slurm is quite commonly used, and there seems to be no issue with other framewrorks such as SGE (used at SDC-DE).

@marcschefer marcschefer self-assigned this Nov 18, 2022
@marcschefer marcschefer added this to the 0.20 milestone Nov 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants