Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an option to pass arguments to a runtime executing benchmarks #180

Open
fzhinkin opened this issue Jan 15, 2024 · 1 comment
Open

Add an option to pass arguments to a runtime executing benchmarks #180

fzhinkin opened this issue Jan 15, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@fzhinkin
Copy link
Contributor

Currently, there's no way to configure a set of options to pass to a runtime when executing benchmarks.

There are several use cases when it could be useful:

  • running benchmarks with different VM options to check how it affects performance or to validate some hypothesis regarding optimizations performed by a runtime;
  • pass options to extract various debugging information that may help analyze benchmarking results (for instance, pass --trace-turbo to nodejs/d8).

For JVM, the lack of such an option is not a big deal - one may take and use the generated jar file directly, but for other targets, like wasmJs, the process of running benchmarks directly, without using gradle commands, is much more painful.

One can always add arguments by getting and configuring corresponding tasks (like NodeJsExec), but it would be easier to setup args along with other benchmark-config related options.

I propose adding advanced configuration options to pass options directly to a runtime that executes benchmarks:

benchmark {
    configurations {
        main {
            advanced("jvmArgs", listOf("-XX:TieredStopAtLevel=1"))
            advanced("nodeJsArgs", listOf("--trace-turbo", "--trace-turbo-path=/tmp/"))
        }
    }
}
@qurbonzoda qurbonzoda added the enhancement New feature or request label Jan 24, 2024
@qurbonzoda
Copy link
Collaborator

Related issue: #81.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants