Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fast abort of benchmarks when same executable is missing #224

Merged
merged 14 commits into from
Jul 27, 2023

Conversation

naomiGrew
Copy link
Contributor

No description provided.

rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
@naomiGrew naomiGrew force-pushed the missingBinary branch 2 times, most recently from d6c9d8e to 8c493e2 Compare July 18, 2023 10:57
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
@naomiGrew naomiGrew force-pushed the missingBinary branch 3 times, most recently from 2458acc to 3879bae Compare July 24, 2023 11:01
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/executor.py Outdated Show resolved Hide resolved
rebench/tests/executor_test.py Outdated Show resolved Hide resolved
naomiGrew and others added 2 commits July 24, 2023 15:33
fix pylint issues

return true false logic of completed_task

create method to mark binary as missing

give executor a binary missing attribute

change logic of batch scheduler to consume first item in list

add get_executor and is_binary_missing to run id
@smarr smarr changed the title Fast abort of benchmarks when same binary is missing Fast abort of benchmarks when same executable is missing Jul 26, 2023
@smarr
Copy link
Owner

smarr commented Jul 26, 2023

Using the executor object to identify run ids that won't work is catching only a part of them.
Executors get instantiated based on the structure of the configuration file, and are not unified because they may have different run settings etc.

Thus, instead of checking the executor object, I am now checking the executable path/filename as part of the cmdline. This also makes sure we only match the same executables. The problem here is that we can use the various variables in the command line expansions also in the path or executor names. Thus, looking at the cmdline after expansion is better.

… path

We support interpolation of variables in executer path and excutable name, this, need to use the rendered version.

Executor objects may also be instantiated multiple times, which means we can’t really use identity.

Change used vocabulary to remove binary, since we use executable in the config file.
@smarr smarr merged commit 0b4936c into smarr:master Jul 27, 2023
4 checks passed
@smarr smarr linked an issue Jul 27, 2023 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fast abort of benchmarks when same binary is missing
2 participants